Recent developments in XR-related technologies enable us to extend the use of XR beyond laboratory settings and, therefore, beyond the common paradigm of head-mounted displays (HMD) or AR glasses. As the industry is pushing XR glasses to become the next-generation computer interface and mobile phone replacement, we see an opportunity to reconsider the future of XR interfaces beyond just this form factor and explore whether new affordances can be leveraged. In fact, while glasses represent the most convenient and practical wearable interface, users remain limited to a specific set of displays, raising concerns about privacy, social acceptability, and overreliance on the visual channel. Conversely, we believe that there is an opportunity to leverage the physicality of the world, including the human body and the surrounding space, to create more engaging XR experiences. In this workshop, our goal is to gather fresh insights and perspectives from HCI researchers, practitioners, and professionals on strategies and techniques to enhance interactions in XR beyond the conventional glasses framework. We will bring together experienced academics and emerging researchers within the interdisciplinary field of HCI. We anticipate developing research pathways to leverage physicality to investigate possibilities and obstacles beyond XR glasses, ultimately shaping a new approach to engaging with XR.