Challenges in unraveling astrophysical eccentric compact binaries