Continual Vision-based Reinforcement Learning with Group Symmetries