Primitive potentials and Newton's laws from symmetry