Part II: Drafting and Evaluating Questions
This brief tutorial addresses issues found in very early versions of ten questions that were ultimately revised, refined, and included in this study. After presenting each question, the question is discussed in terms of three questions:
- WHAT problem(s) are present in this question?
- WHY is it important to address this/these problems?
- HOW might this question be revised and refined to eliminate the problem(s)?
We address:
- asking the right question.
- avoiding questions with mixed attributes, and double-barreled questions.
- Selecting appropriate question types and response options/scales. Specifically addressing: open versus closed-end options, rating scales of known psychometric characteristics, developing an assessment tool, and providing all-inclusive but mutually-exclusive response options.
- the impact of thinking aloud pretesting, and formal testing.