How Scores Finalise

This process aims to encourage automatic scoring based on submission quality. Should a submission be redirected for moderation, the following triggers are built into the system to notify discrepancies and/or suspicious behaviour:

• Inconsistent scoring after 10 reviews

• Submission not reviewed in peer review process for an extended period.

The following improvements were made to encourage good and fair behaviour from teachers and learners.

• Notifications warning users of potential bad behaviour i.e submitting answers to quickly, taking less than 60sec to review submissions.

• Introduction of remark requests, credibility weighting and patterned behaviour.

• Unlike previous challenges, the teacher's score held equal weight to the learner’s score, and thus did not override previous learner scores within the system.

Types of inappropriate submissions:

• Plagiarism

• Irrelevant & repeated answers

• Inappropriate and explicit links included in submissions.

Regular system checks were implemented at the end of each new challenge week, with additional random checks and adjustments of scores by the systems managers.