Research using MATHia and UpGrade

MATHia (formerly Cognitive Tutor)

Overview Papers

Anderson, J. R. (2002). Spanning seven orders of magnitude: A challenge for cognitive modeling. Cognitive Science, 26(1), 85–112. https://doi.org/10.1016/S0364-0213(01)00062-3

Fancsali, S.E., Ritter, S. (2020). Data-Intensive Learning Engineering & Applied Education Research with Carnegie Learning's MATHia Platform. In Proceedings of the First Workshop of the Learner Data Institute. [PDF]

Goldin, I. M., Pavlik Jr, P., & Ritter, S. (2016). Discovering Domain Models in Learning Curve Data. In Design Recommendations for Intelligent Tutoring Systems: Domain Modeling, R. A. Sottilare, A. C. Graesser, Xiangen Hu, A. Olney, B. Nye, and A. M. Sinatra, Eds. Vol. 4. US Army Research Laboratory. https://www.researchgate.net/publication/305776399_Discovering_Domain_Models_in_Learning_Curve_Data

Ritter, S., Anderson, J.R., Koedinger, K.R., Corbett, A. (2007). Cognitive Tutor: Applied Research in Mathematics Education. Psychonomic Bulletin & Review, 14(2), 249-255. [link] [PDF]

A Sample of Research Using MATHia & MATHia Data

Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z. (2004). Off-Task Behavior in the Cognitive Tutor Classroom: When Students “Game the System”. Proceedings of ACM CHI 2004: Computer-Human Interaction, 383-390.

Bernacki, M., Aleven, V., & Nokes-Malach, T. J. (2014). Stability and change in adolescents’ task-specific achievement goals and implications for learning mathematics with intelligent tutors. Computers in Human Behavior, 37, 73–80. https://doi.org/10.1016/j.chb.2014.04.009

Butcher, K. R., Aleven, V. (2013). Using student interactions to foster rule-diagram mapping during problem solving in an intelligent tutoring system. Journal of Educational Psychology, 105(4), 988-1009. https://doi.org/10.1037/a0031756

Koedinger, K.R., Aleven, V. (2007). Exploring the assistance dilemma in experiments with Cognitive Tutors. Educational Psychology Review, 19, 239-264. https://doi.org/10.1007/s10648-007-9049-0

Richey, J.E., Lobczowski, N.G., Carvalho, P.F., Koedinger, K. (2020). Comprehensive Views of Math Learners: A Case for Modeling and Supporting Non-math Factors in Adaptive Math Software. In Bittencourt, I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (Eds.) Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science, vol. 12163. Springer, Cham. https://doi.org/10.1007/978-3-030-52237-7_37

Walkington, C. A. (2013). Using adaptive learning technologies to personalize instruction to student interests: The impact of relevant contexts on performance and learning outcomes. Journal of Educational Psychology, 105(4), 932–945. https://doi.org/10.1037/a0031882

Evaluations and Impact

Cortes, K., J. Goodman, and T. Nomi. (2012). A Double Dose of Algebra. Education Next, December 15, 2012. https://www.educationnext.org/a-double-dose-of-algebra/

Pane, J.F., Griffin, B.A., McCaffrey, D.F., Karam, R. (2014). Effectiveness of Cognitive Tutor Algebra I at Scale. Educational Evaluation and Policy Analysis, 36(2), 127-144. https://doi.org/10.3102/0162373713507480

Zheng, G., Fancsali, S.E., Ritter, S. and Berman, S. (2019). Using Instruction-Embedded Formative Assessment to Predict State Summative Test Scores and Achievement Levels in Mathematics. Journal of Learning Analytics, 6(2), 153–174. https://doi.org/10.18608/jla.2019.62.11

UpGrade

Overview Papers

Ritter, S., Murphy, A., Fancsali, S. E., Fitkariwala, V., Patel, N., & Lomas, J. D. (2020). UpGrade: An Open Source Tool to Support A/B Testing in Educational Software. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/upgrade_ab

Ritter, S., Murphy, A., & Fancsali, S. E. (2020). Managing Group Random Assignment in UpGrade. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/managing_group

Research Using UpGrade

Patel, N., Raval, D., Fitkariwala, V., & Lomas, J. D. (2020). Optimizing an Educational Game Using UpGrade: Challenges and Opportunities. In S. E. Fancsali, S. Ritter, & A. Murphy (Eds.), Proceedings of the First Workshop on Educational A/B Testing at Scale. EdTech Books. https://edtechbooks.org/ab_testing_2020/optimizing_an_educat

Ritter, S., Murphy, A., Fancsali, S.E. (2022). Curriculum-Embedded Experimentation. Proceedings of the Third Workshop on A/B Testing and Platform-Enabled Learning Research at Learning @ Scale 2022. [PDF]