Data Challenge

Predicting Performance Based on the Analysis of Reading Behavior

As the adoption of digital learning materials in modern education systems is increasing, the analysis of reading behavior and their effect on student performance gains attention. The main motivation of this workshop is to foster research into the analysis of students’ interaction with digital textbooks, and find new ways in which it can be used to inform and provide meaningful feedback to stakeholders, such as: teachers, students and researchers. In this workshop, participants will be offered a chance to analyze the event logs from three different universities datasets with information on over 1000 students reading behaviors. Additional information on lecture schedules will also enable the analysis of learning context for further insights into the preview, in-class, and review reading strategies that learners employ.

We welcome submissions on some of the following topics(though not restrictive):

  • Student performance/at-risk prediction
  • Student reading behavior self-regulation profiles spanning the entire course
  • Preview, in-class, and review reading patterns
  • Student engagement analysis; and behavior change detection
  • Visualization methods to inform and provide meaningful feedback to stakeholders

Aligned with LAK’19 interest in “ways in which learning analytics can be used to promote inclusion and success”, in this workshop we will pay special attention to how different groups within the student cohort can be identified and analysis of reading logs can provide hints for how groups can be scaffolded appropriately to achieve success.

Participants will be encouraged to share their results and insights by submitting a paper for presentation at the workshop https://easychair.org/conferences/?conf=dclak19.

Participants will also be encouraged to contribute their programs/source code created in the workshop to an ongoing open learning analytics tool development project for inclusion as an analysis feature.

Tentative dates

  • March 4th or 5th at LAK 2019 in Tempe, USA.

Important Dates

  • Initial paper submission: December 3, 2018 (This can be an outline of work in progress with preliminary analysis)
  • Notification of acceptance: January 4, 2019
  • Registration deadline: January 8, 2019
  • Camera-Ready deadline: January 31, 2019

Submissions

Initial paper submissions should at least give an outline of work in progress with some preliminary analysis.

  • Full paper: 8-10 pages (Initial paper submission: 6 pages or more)
  • Short paper: 5-6 pages (Initial paper submission: 4 pages or more)
  • Poster paper: 2-3 pages (Initial paper submission: 1 page or more)

Submit papers using EasyChair: https://easychair.org/conferences/?conf=dclak19

All submissions to the workshop must follow the format of the Companion Proceedings Template (https://lak19.solaresearch.org/wp-content/uploads/2018/09/LAK19_Companion_Proceedings_Template.doc)

Organizing Committee

  • Brendan Flanagan (Kyoto University, Japan)
  • Atsushi Shimada (Kyushu University, Japan)
  • Stephen Yang (National Central University, Taiwan)
  • Bae-Ling Chen (Asia University, Taiwan)
  • Yang-Chia Shih (Asia University, Taiwan)
  • Hiroaki Ogata (Kyoto University, Japan)

PC Members

  • TBA (TBA)

Dataset

By downloading our dataset and using our dataset you have agreed to our Terms of Use.

The dataset for this data challenge includes 4 types of files:

Course_#_EventStream.csv
   - Data of the logged activity data from students' interactions with the BookRoll system.

Course_#_LectureMaterial.csv
   - Information about the length of the lecture materials used.

Course_#_LectureTime.csv 
   - Information about the schedule of the lectures. This can be used to analyze the preview/in-class/review reading behaviors.

Course_#_QuizScore.csv 
   - Data on the final score for each student. This can be used as a label for training and testing prediction models.

For a more description of the columns, please refer to the README file in the dataset download.

A link to download the dataset will be provided after your contact information has been registered and agreement with the terms of use have been met.

For more information about BookRoll and the learning analytics platform on which the data was collected, please refer to the following:

  • Hiroaki Ogata, Chengjiu Yin, Misato Oi, Fumiya Okubo, Atsushi Shimada, Kentaro Kojima, and Masanori Yamada, E-Book-based learning analytics in university education, Proceedings of the 23rd International Conference on Computer in Education (ICCE 2015) pp.401-406, 2015.
  • Digital teaching material delivery system "BookRoll"
  • Brendan Flanagan, Hiroaki Ogata, Integration of Learning Analytics Research and Production Systems While Protecting Privacy, Proceedings of the 25th International Conference on Computers in Education (ICCE2017), pp.333-338, 2017.
  • Hiroaki Ogata, Misato Oi, Kousuke Mohri, Fumiya Okubo, Atsushi Shimada, Masanori Yamada, Jingyun Wang, and Sachio Hirokawa, Learning Analytics for E-Book-Based Educational Big Data in Higher Education, In Smart Sensors at the IoT Frontier, pp.327-350, Springer, Cham, 2017.