Project AR-Classroom

Run the Program

You can now double-click 'UWPPlayerLauncher.exe' (not 'AR-Classroom.exe') under the program's root directory to run the program.

Allow the program to access your webcam.

Learn and teach rotation matrices by observing the rotation axes, angles, and how they update the matrices.

Enjoy your AR-Classroom!

Errors and How to Fix Them

The errors we have found and how to fix them are listed below. For new errors, please contact the team.

1. If you see "Microsoft Visual C++ 2015 UWP Runtime Package installation failed" because "There's a new version of this package already installed", you can then skip installing this package.

2. Command line error message: System.IO.InvalidDataException: End of Central Directory record could not be found.

This error might arise from storing the program on a FAT32 file system. Try move the program to other drives with newer file system, e.g., NTFS.

3. If you use Parallels on Mac, and receives errors related to file system PrlSF, make sure to move the program folder to C:/ drive (that has NTFS). This will solve the problem.

4. For some laptop computers' internal webcams, the AR scene view may be flipped horizontally. In this case, contact the team. Thank you!

Understanding allied spatial transformations and their mathematical representations significantly contribute to studies in computer-aided design, computer graphics, computer vision, robotics, quantum mechanics, and other fields. However, students face significant difficulties when learning transformations and their mathematical representations. The project aims to gain new knowledge about how AR and AI-powered integrated embodiment and visualization may enhance students' learning of allied spatial transformations and mathematics, and how AR/AI-powered precise motion tracking of objects and people may help collect high resolution, in situ motion and scene data to enhance learning analytics. The project will identify the AR capabilities that can help students conceive, connect, and compare math conceptions of motions, mappings, and functions, and help overcome well-documented difficulties students face when learning spatial transformations and allied mathematical representations, in order to support their future development of expertise and career success across STEM/STEAM disciplines.

1. Xie, S., Wang, D., Yeh, S., Yan, W., and Song, D., Dynamic Intrinsic Parameter Rectification Network for Cameras with Optical Image Stabilization in Desktop Augmented Reality Applications, IEEE International Conference on Automation Science and Engineering (CASE), August 28 – September 1, 2024, Bari, Italy.

2.  Aguilar, S.D., Qian, C., Monjoree, U., Burte, H., Liew, J., Quek, F., Yasskin, P., Song, D. and Yan, W., AR-Classroom Usability: Implications for UX Research on AR Enabled Educational Technologies for 3D Matrix Algebra Learning, 2024 IEEE ASEE Frontiers in Education (FIE) Conference, Washington DC, October 13-16, 2024.

3. Monjoree, U., Aguilar, S.D., Qian, C., Van Huyck, C., Ye, Shu-Hao, Tranbarger, P., Solitare-Renaldo, L., Duane-Tessier, L., Burte, H., Quek, F., Yasskin, P., Song, D., Liew, J., and Yan, W., AR-Classroom: Integrating Conversational Artificial Intelligence With Augmented Reality Technology for Learning Spatial Transformations and Their Matrix Representation, 2024 IEEE ASEE Frontiers in Education (FIE) Conference, Washington DC, October 13-16, 2024.

4. Aguilar, S. D., Burte, H., Stautler, J., Mondal, S., Qian, C., Monjoree, U., Yasskin, P., Liew, J., Song, D., & Yan, W. Learning 3D matrix algebra using virtual and physical manipulatives: Qualitative analysis of the efficacy of the AR-Classroom. Human-Computer Interaction International 2024.

5. Burte, H., Aguilar, S. D., Stautler, J., Mondal, S., Qian, C., Monjoree, U., Yasskin, P., Liew, J., Song, D., & Yan, W. Learning 3D matrix algebra using virtual and physical manipulatives: Statistical analysis of quantitative data evaluating the efficacy of the AR-Classroom. Human-Computer Interaction International 2024.

6. Aguilar, S.D., Burte, H., Yasskin, P., Liew, J. Yeh, S., Qian, C. Monjoree, U., Song, D., & Yan, W. AR-Classroom: How Physical and Virtual Rotation in Augmented Reality Impacts Matrix Algebra Learning. Poster for presentation at the Psychonomic Society’s 2023 Annual Meeting.

7. Aguilar, S.D., Burte, H., Yasskin, P., Liew, J. Yeh, S., Qian, C. Song, D., Monjoree, U. & Yan, W. (2023). AR-Classroom: Usability of AR educational technology for learning rotations using three-dimensional matrix algebra. Paper accepted for presentation at the IEEE ASEE Frontier in Education conference.

8. Yeh, S., Qian, C., Song, D., Aguilar, S.D., Burte, H., Yasskin, P., Ashour, Z., Shaghaghian, Z., Monjoree, U. & Yan, W. (2023). AR-Classroom: Augmented Reality Technology for Learning 3D Spatial Transformations and Their Matrix Representation. Paper accepted for presentation at the IEEE ASEE Frontier in Education conference. 

9. Aguilar, S.D., Crabb, K., Stautler, J., & Burte, H. (2023, July). AR Classroom usability studies: Implications for enhancing educational technology. Poster for presentation at the Cognitive Science Conference. 

10. Aguilar, S.D., Burte, H., Yasskin, P., Liew, J. Yeh, S., Qian, C. Song, D., Monjoree, U. Scrudder, C. & Yan, W. (2023, July). AR-Classroom: Investigating user-app-interactions to enhance usability of AR technology for learning two- and three-dimensional rotations. Paper accepted for presentation at the Human Computer Interaction International Conference.

11. Aguilar, S. D., Burte, H., Shaghaghian, Z., Yasskin, P., Liew, J., & Yan, W. (2023, June). Enhancing Usability in AR and Non-AR Educational Technology: An Embodied Approach to Geometric Transformations. In International Conference on Human-Computer Interaction (pp. 3-21). Cham: Springer Nature Switzerland.

12. Duane-Tessier, L., Tranbarger, P., Yasskin, P., Aguilar, S., Burte, H., Jiang, Y., Liew, J., Monjoree, U., Qian, C., Quek, F., Scrudder, C., Shaghaghian, Z., Solitare-Renaldo, L., Song, D., Van Huyck, C., Yan, W., and Yeh, S., Augmented Reality and Artificial Intelligence for Learning Spatial Transformations, poster, Mathematical Association of America (MAA) MathFest, August 2-5, 2023, Tampa, FL.

13. Yeh, S., Xie, S., Yan, W., Song, D., Vision-Based Camera/Robot Pose Estimation Using Both Semantic and Geometric Features on LEGO Baseplates, IEEE International Conference on Automation Science and Engineering (CASE), Auckland, New Zealand, August 26-30, 2023.

14. Ashour, Z., Shaghaghian, Z., Yan, W., Building Information Modeling-Powered Augmented Reality and User Study for Learning Architectural Representations, IEEE International Conference on Automation Science and Engineering (CASE), Auckland, New Zealand, August 26-30, 2023.

15. Tillman, D., Yan, W., An, S., Liew, J., Lim, K., Garbrecht, L., and Yasskin, P., Work in Progress: Toward an Augmented Reality (AR) Learning Environment for Hispanic High School Students to Visualize and Embody STEM Spatial Transformations, 2023 ASEE (American Society for Engineering Education) Annual Conference & Exposition, Baltimore Convention Center, MD, June 25-28, 2023.

16. Alhazzaa, K., Dixit, M., and Yan, W.,  BIMThermoAR: Visualizing Building Thermal Simulation Using BIM-based Augmented Reality, CAAD Futures 2023, TU Delft in The Netherlands, 5-7 July 2023.

17. Alhazzaa, K. and Yan, W., Integrating Parametric Modeling, BIM, and Building Performance Analysis into Augmented Reality for Architectural Design and Education, Proceedings of the 7th International Conference on Virtual and Augmented Reality Simulations (ICVARS 2023), March 3rd-5th, 2023, Sydney, Australia. To be archived in ACM Digital Library.

18.  Ashour, Z., Shaghaghian, Z., and Yan, W., An Augmented Reality Application and User Study for Understanding and Learning Architectural Representations, 2-page extended abstract/poster paper, IEEE Conference on Virtual Reality + 3D User Interfaces (IEEE VR) 2023 Abstract and Workshop Proceedings.

19. Ashour, Z. and Yan, W., BIMxAR: Building Information Modeling-Powered Augmented Reality. Proceedings in the Conference of Association for Computer Aided Design in Architecture (ACADIA) 2022. Philadelphia, PA, October 26-29th, 2022.

20. Yeh, S., Wang, D., Yan, W., and Song, D., Detection of Camera Model Inconsistency and the Existence of Optical Image Stabilization System, IEEE International Conference on Automation Science and Engineering (CASE), Mexico City, Mexico, August 20-24, 2022.

21. Shaghaghian, Z., Burte, H., Song, D., Yan, W., Design and Evaluation of an Augmented Reality Application for Learning Spatial Transformations and Their Mathematical Representations, 2-page extended abstract/poster paper, IEEE Conference on Virtual Reality + 3D User Interfaces (IEEE VR) [1] 2022 Abstract and Workshop Proceedings.

22. Shaghaghian, Z., Burte, H., Song, D., and Yan W., (2022) Learning Spatial Transformations and their Math Representations through Embodied Learning in Augmented Reality. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies (LCT): Novel Technological Environments. Human-Computer Interaction International (HCII) 2022. Lecture Notes in Computer Science, vol 13329. Springer, Cham. https://doi.org/10.1007/978-3-031-05675-8_10. June 26-July 1, 2022.  

23. Tuzun Canadinc, S. and Yan, W., Augmented Reality (AR) for Enhancing Physical Architectural Models, Proceedings of the Conference of Education and Research in Computer Aided Architectural Design in Europe (eCAADe), Ghent, Belgium, September 13-16, 2022.

24. Shaghaghian, Z., Burte, H., Song, D., and Yan, W. Learning Geometric Transformations for Parametric Design: An AR-Powered Approach. CAAD Futures 2021 Proceedings, Springer.

Resources for learning rotations and their mathematical representations:

http://bim-sim.org/ARCH655/lectures/lecture5/2.html 

Ashour, Z. and Yan, W., BIM-Powered Augmented Reality for Advancing Human-Building Interaction, Proceedings of the 38th eCAADe Conference - Volume 1, pp. 169-178. (Online) TU Berlin, Berlin, Germany, 16-18 September 2020. http://papers.cumincad.org/cgi-bin/works/paper/ecaade2020_499