Email: tessa@audn.ai
Title: "Adversarial Risks in AI-Powered Language Assessment Platforms"
Authors: Ozgur Ozkan, Arun Baby, Sanchali Sharma, Tessa Hutchman
Abstract: As Large Language Models are deployed in high-stakes language assessments—scoring essays, conducting oral examinations, and generating test items—they introduce a novel attack surface absent from traditional psychometric frameworks. This poster synthesises emerging empirical evidence on adversarial vulnerabilities in LLM-based assessment systems, mapping attack vectors (prompt injection, role-based jailbreaks, voice social engineering) to their downstream impact on fairness and validity. We show that simple, low-sophistication attacks reliably manipulate LLM scoring outcomes across multiple domains, and propose continuous adversarial validation as a prerequisite for responsible deployment. Human oversight alone is insufficient: automated red-teaming must become part of the assessment quality assurance lifecycle.