The tutorial will be spread over 4 hours, including a coffee break.
Part 1 - Context and Motivation [30 mins]: A short, introductory talk where we will motivate the problem setup, giving examples of cultural subjectivity of annotations in practice and its impact throughout the AI pipeline.
Part 2: Live rater style annotation [30 mins] : A hands on annotation exercise where participants review and annotate AI generated text using binary and Likert scale questions.
COFFEE BREAK [30 minutes]
Part 3: Live open ended annotation [45 mins]: A hands on exercise where participants provide qualitative and open-ended responses as annotations towards text samples similar to Part 2.
Part 4: Comparison[45 minutes] : Comparison of annotations between annotators of different identities.
Part 5: Discussion [30 minutes] : Discussion on how this experiences shapes ideas for more culturally inclusive AI annotation processes.