Floquet states of matter are states induced by periodic drives that lead to new dynamical phenomena. We showed that drive-induced states of matter, ranging from anomalous Anderson insulators to time crystals, exhibit a robustly quantized non-adiabatic Berry phase (NBP), thus revealing a universal way to distinguish them from static states of matter. This insight further allowed us to discover new dynamical topological phases by imposing appropriate quantization conditions on the NBP that can be generalized to other systems.