The project aims to explore the relationship between the symmetry group that characterizes a RNN's connectivity patterns, and the symmetry of the related neural manifolds. By exploiting groups and representation theory, we are able to gain a deeper understanding of this relationship, and subsequently to reveal how the manifold's invariance property is transferred from the state space to the latent space, where the manifold representation is fully uncovered.