Crowdsourcing

The experiments listed here are meant to help us understand when CrowdSourcing might work and under what circumstances. We have collected these video, and are running these experiments this year. Our goal is to build an infrastructure to 1) collect these video easily (via our iPad app, android or website) and 2) learn what works. We have a journal article, listed below, that summarizes some our plans and results.

1. Comparing video versus text (video as a "Khan Academy" style screen capture)

2. Do mistake messages delivered through video help?

3. Comparing Text-Video-Nothing crossed by Hint and Misconception Messages (9 conditions). When is video better that text?

4. Comparing Video Feedback Provided by Multiple Students

5. Crowdsourcing Teacher Feedback

   1. The Patchwork Quilt Experiment: Comparing being taught by two teachers on three different problems with being taught by the same teacher on three problems

   2. Comparing Crowdsourced Teacher Video Feedback

We have one paper that summarize some of our efforts in crowdsourcing.

Heffernan, N., Ostrow, K., Kelly, K., Selent, D., VanInwgen, E., Xiong, X. & Williams, J. J. (accepted- but not final version). The Future of Adaptive Learning: Does the Crowd Hold the Key? International Journal of Artificial Intelligence in Education. 25 Vol2 A special issue focused on "The next 25 Years: How advanced, interactive educational technologies will change the world."

Heffernan, Cristina, 2015 Copyright