Dynamical moduli spaces and abelian varieties