The Human in the Loop:
A Symposium on Human-AI Collaboration in Language Assessment

A symposium of research at the intersection of language, assessment, and artificial intelligence (AI).

As Large Language Models (LLMs) are increasingly adopted in language testing, there is an urgent need to examine their reliability, fairness, transparency, and impact on diverse language users. AI is transforming the way in which languages are assessed, with growing consequences not only for learners but also for teachers. The implications of human-AI collaboration for accountability and equity require careful interdisciplinary examination and discussion.

This symposium will feature four invited speakers who are leading researchers in complementary fields: language assessment and applied linguistics, psychometrics and LLMs, and language assessment industry. Each speaker will deliver a presentation addressing how AI systems are or will be used in language assessment, and the risks and opportunities they pose. The workshop will also include a moderated panel discussion, an interactive open discussion to encourage dialogue across disciplines, and a poster session.

The photos taken on the day of the event are now available; see here.

This workshop is funded by the Cambridge Language Sciences Workshop Fund through the AI@Cam project “Improving Language Equity and Inclusion through AI”.