Research using MATHia and UpGrade
MATHia (formerly Cognitive Tutor)
Overview Papers
Anderson, J. R. (2002). Spanning seven orders of magnitude: A challenge for cognitive modeling. Cognitive Science, 26(1), 85–112. https://doi.org/10.1016/S0364-0213(01)00062-3
Fancsali, S.E., Ritter, S. (2020). Data-Intensive Learning Engineering & Applied Education Research with Carnegie Learning's MATHia Platform. In Proceedings of the First Workshop of the Learner Data Institute. [PDF]
Goldin, I. M., Pavlik Jr, P., & Ritter, S. (2016). Discovering Domain Models in Learning Curve Data. In Design Recommendations for Intelligent Tutoring Systems: Domain Modeling, R. A. Sottilare, A. C. Graesser, Xiangen Hu, A. Olney, B. Nye, and A. M. Sinatra, Eds. Vol. 4. US Army Research Laboratory. https://www.researchgate.net/publication/305776399_Discovering_Domain_Models_in_Learning_Curve_Data
Ritter, S., Anderson, J.R., Koedinger, K.R., Corbett, A. (2007). Cognitive Tutor: Applied Research in Mathematics Education. Psychonomic Bulletin & Review, 14(2), 249-255. [link] [PDF]
A Sample of Research Using MATHia & MATHia Data
Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z. (2004). Off-Task Behavior in the Cognitive Tutor Classroom: When Students “Game the System”. Proceedings of ACM CHI 2004: Computer-Human Interaction, 383-390.
Bernacki, M., Aleven, V., & Nokes-Malach, T. J. (2014). Stability and change in adolescents’ task-specific achievement goals and implications for learning mathematics with intelligent tutors. Computers in Human Behavior, 37, 73–80. https://doi.org/10.1016/j.chb.2014.04.009
Butcher, K. R., Aleven, V. (2013). Using student interactions to foster rule-diagram mapping during problem solving in an intelligent tutoring system. Journal of Educational Psychology, 105(4), 988-1009. https://doi.org/10.1037/a0031756
Koedinger, K.R., Aleven, V. (2007). Exploring the assistance dilemma in experiments with Cognitive Tutors. Educational Psychology Review, 19, 239-264. https://doi.org/10.1007/s10648-007-9049-0
Richey, J.E., Lobczowski, N.G., Carvalho, P.F., Koedinger, K. (2020). Comprehensive Views of Math Learners: A Case for Modeling and Supporting Non-math Factors in Adaptive Math Software. In Bittencourt, I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (Eds.) Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science, vol. 12163. Springer, Cham. https://doi.org/10.1007/978-3-030-52237-7_37
Walkington, C. A. (2013). Using adaptive learning technologies to personalize instruction to student interests: The impact of relevant contexts on performance and learning outcomes. Journal of Educational Psychology, 105(4), 932–945. https://doi.org/10.1037/a0031882
Evaluations and Impact
Cortes, K., J. Goodman, and T. Nomi. (2012). A Double Dose of Algebra. Education Next, December 15, 2012. https://www.educationnext.org/a-double-dose-of-algebra/
Pane, J.F., Griffin, B.A., McCaffrey, D.F., Karam, R. (2014). Effectiveness of Cognitive Tutor Algebra I at Scale. Educational Evaluation and Policy Analysis, 36(2), 127-144. https://doi.org/10.3102/0162373713507480
Zheng, G., Fancsali, S.E., Ritter, S. and Berman, S. (2019). Using Instruction-Embedded Formative Assessment to Predict State Summative Test Scores and Achievement Levels in Mathematics. Journal of Learning Analytics, 6(2), 153–174. https://doi.org/10.18608/jla.2019.62.11
UpGrade
Overview Papers
Ritter, S., Murphy, A., Fancsali, S. E., Fitkariwala, V., Patel, N., & Lomas, J. D. (2020). UpGrade: An Open Source Tool to Support A/B Testing in Educational Software. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/upgrade_ab
Ritter, S., Murphy, A., & Fancsali, S. E. (2020). Managing Group Random Assignment in UpGrade. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/managing_group
Research Using UpGrade
Patel, N., Raval, D., Fitkariwala, V., & Lomas, J. D. (2020). Optimizing an Educational Game Using UpGrade: Challenges and Opportunities. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/optimizing_an_educat
Ritter, S., Murphy, A., Fancsali, S.E. (2022). Curriculum-Embedded Experimentation. Proceedings of the Third Workshop on A/B Testing and Platform-Enabled Learning Research at Learning @ Scale 2022. [PDF]