Graph network based simulators can learn discontinuous, rigid contact dynamics