ChatGPT Short Answer Detection

Kennesaw State University Capstone Project

Fall 2023

 

Mission of the project

With the emergence of large language models (LLM) and Artificial Intelligence (AI) assistants like ChatGPT, accompanying tremendous potentials are critical challenges. Indeed, these assistant systems can provide quality information with conveniences. However, the generated contents are highly problematic being seemingly indistinguishable from that of human. The implication of this issue is severe in science, education, and domains that value original contents. With such motivation, this project addresses the task of identifying ChatGPT-synthesized texts with a focus on education, specifically, in short-answer questions. The goal of the project is to develop an AI technology that identifies synthesized texts by comparing such contents to examples known to be from AI for the same questions. 

 

Data Collection

The first step in this process is to obtain data that includes both questions and human answers in a large scale for the model training.

Text Processing

The second step will be applying text processing techniques for building the model data by converting the text into numbers.


Model Development

Lastly, we have the similarity model that compares the two input texts using the processed data. 


 

Questions?

Contact Alfred Johnson ajohn604@students.kennesaw.edu to get more information on the project