Non-Equilibrium Physics of Non-Conservative Forces