Metrics Training Guide Documents

Attached you will find all of the documents necessary to train researchers on how to code quantity, quality, novelty and variety.

How to Use:

1. Coders should read both the Metric Descriptions document and the Additional Guidelines document in order to be able to use them for continuous reference during coding.

2. Coders should familiarize themselves with the Blank Template for Coding document and the Peanut Bin List & Descriptions.

3. Coders can code "Sample Set 1" or "Sample Set 1 (Labeled)" and compare answers to the Coding for Sample Set 1 document. Please note - this is the training phase.

4. Coders may then code "Sample Set 2". Multiple coders should compare sample set 2 data to ensure reasonable reliability.