Is the scoring and interpretation of the scoring consistent?
Are the assessment conditions and protocols the same for all students?
Minimum of 50 student work samples per assessment
Scored and cross-scored in core teams
Bias Review
Is the assessment fair to all students?
The Bias review ensures that items are clearly worded, are of appropriate difficulty and interest level, are unbiased, and will result in a full range of responses. Items are written so they do not provide an advantage or disadvantage (unrelated to an understanding of the content) to a student with certain personal characteristics, such as those related to gender, race, ethnicity, linguistics, religion, socioeconomic status, disability, or geographic region. Additionally, items do not provide an advantage or disadvantage due to experiences, interests, or opportunities common to the group that are unrelated to academic achievement.
The Bias review includes consideration of issues relevant to individuals with disabilities. A good question for a reviewer to ask: “Might this item offend or unfairly penalize examinees on the basis of personal characteristics such as gender, race, ethnicity, religion, socioeconomic status, disability, or geographic region?” Another question: “Will the subject matter and language of this item be acceptable?”
A listing of areas where bias may be found follows:
Gender - The following should be considered when reviewing items:
What terms are used to refer to humanity at large?
In what activities are boys and girls involved?
What emotions do characters display?
What situations are characters placed in?
How are pictures or visuals used?
Race, Ethnicity, or Culture - The following should be considered when reviewing items:
Portrayal of any group or group member in a demeaning, offensive, condescending, or insensitive way
Stereotyping any groups with respect to activities, emotions, language, or characteristics
Use of pictures that do not represent the diversity of the student population
Over‐inclusion or under‐inclusion of any group
Economic or Social Class - The following should be considered when reviewing items:
Contains an activity familiar to only one class or an activity that is not familiar to all classes
Portrayal of leisure activities that aren’t accessible to all children
Preference or dominance of values from any one class
Student Work Analysis Form
2015-16 Review
Sample:
Disaggregated annual DSPA proficiency as reported in PowerSchool
Multiple Measures
Are results combined and compared from multiple sources?