Arithmetic and Spectral Structures in Aperiodic Order