With Other Universities

This is a comprehensive list of all 19 the randomized controlled trials that were done with 20 other universities.

Of these 19, Heffernan did 8 in collaboration plus 11 were done with the ETRIALS.

1. Comparing experimental conditions that give feedback with control conditions that represent "business as usual" where students don't get feedback until the next day.

   1. Estimating the effect of web-based homework. With Univ. of Illinois (UIC)

   2. Improving learning from homework using intelligent tutoring systems. With West Virginia University

2. Showing that ASSISTments Closes Achievement Gaps (between with lower achieving student and higher achieving students).

• 1. ASSISTments closes Achievement Gaps By Vanderbilt

3. Comparing hints versus step-by-step scaffolding questions, versus solution, versus worked examples.

• 1. What features of hints matter? With Carnegie Mellon, Columbia, and University of Pennsylvania

  2. Counterintuitive effects of online feedback in middle school math: results from a randomized controlled trial in ASSISTments By University of Colorado & UMaine

  3. From Here to There! A dynamic algebraic notation system improves understanding of equivalence in middle-school students By UMAINE

  4. A Comparison of Hints vs. Scaffolding in a MOOC with Adult Learners. With the University of Pennsylvania (UPENN)

  5. The impact of algebra worked example presentations on student learning. With Ottmar at WPI

4. Comparing worked examples to step-by-step feedback

• 1. Two experiments related to tutored problem solving vs. “pure”: worked examples. With Seton Hall University, Carnegie Mellon and Albert Einstein College of Medicine

5. Comparing different videos intended for motivational benefits

• 1. Adding teacher-created motivational video to an intelligent tutoring system. With University of Notre Dame

6. Comparing the Automatic Reassessment and Relearning System(ARRS) feature with other options.

   1. Comparing Automatic Reassessment and Relearning System with one time Mastery Learning. With Univ. of Illinois (UIC)

7. Comparing the difficulty of different problem types

• 1. The effect of language modification of mathematics story problems on problem-solving in ASSISTments By Southern Methodist University & University of North Dakota

  2. Spacing out!: Manipulating Spatial Features in Mathematical Expressions Affects Performance. By Ottmar at WPI

  3. Single Template vs. Multiple Templates: Examining the Effects of Problem Format on Performance. By ETS, Columbia and UPENN

  4. Using Thinkalouds to Understand Rule Learning and Cognitive Control Mechanisms Within an Intelligent Tutoring System By Univ Pittsburgh and Lehigh University

8. Comparing different instructional approaches

• 1. Blocking vs. Interleaving: Does skill pattern matter? With Carleton College

  2. Does asking students to self-report their confidence in affect their performance? With Harvard University

  3. Seeing language learning inside the math: cognitive analysis yields transfer. By Carnegie Mellon University

  4. Labeling Common and Uncommon Fractions Across Notation and Education. By University of Chicago & Boston College

Heffernan, C. (2022)