Non-Equilibrium Behavior in Dynamic Games through Gradient Play