Providing Effective Feedback to Maintain Quality and Consistency in a Qualitative Interviewing Team

Casey Tesfaye, Research Support Services Inc

Jessie Engel, Research Support Services

Daniela Glusberg, Research Support Services


Over the course of a number of thematically related qualitive in-depth interview studies, one project team has developed and implemented methods for providing ongoing feedback to interviewers throughout data collection, with a goal of evaluating quality and maintaining consistency. These methods include: evaluating a subset of interviews from each interviewer at prescribed intervals, evaluating interviewer quality along a set of key dimensions, providing interviewers with annotated transcripts when needed, and having regular debriefing sessions that focus on interview methods rather than interview findings. In this presentation, we will discuss the domains that have been most useful for providing effective feedback (such as “Covered all questions” “met question intents” “probed sufficiently” and “avoided leading probes”), the response format that has been most useful for each of the dimensions (not closed-ended), the type of inline feedback most effective in annotated transcripts, and a guide for productive discussion during debriefing meetings.Over the course of a number of thematically related qualitive in-depth interview studies, one project team has developed and implemented various methods for providing ongoing feedback to the interview team throughout data collection, with a goal of evaluating quality and maintaining consistency between interviewers. These methods include: evaluating a subset of interviews from each interviewer at prescribed intervals, evaluating interviewer quality along a set of key dimensions, providing interviewers with annotated transcripts when needed, and having regular debriefing sessions that focus on interview methods rather than interview findings. In this presentation, we will discuss the domains that have been most useful for providing effective feedback (such as “Covered all questions” “met question intents” “probed sufficiently” and “avoided leading probes”), the response format that has been most useful for each of the dimensions (not closed-ended), the type of inline feedback most effective in annotated transcripts, and a guide for productive discussion during debriefing meetings