DETECTING AI-GENERATED CONTENT
DETECTING AI-GENERATED CONTENT
Artificial Intelligence (AI)-generated writing is any text that is produced by AI systems, such as chatbots, text generators, or summarizers. AI-generated writing can be useful for many purposes, such as entertainment, education, or research. However, it can also be misused for deception, plagiarism, or manipulation. That’s why it’s important to be able to detect and evaluate AI-generated writing and to use it responsibly and ethically. Below you'll find information designed for this purpose.
Decoding AI-Generated Content: Recognizing Patterns and Pitfalls
To Err is Human: Human text usually contains typos and is extremely variable, whereas AI-generated content vary rarely makes typos and often generates "perfect" sounding text.
Logic Check: AI models sometimes make implausible or incorrect statements.
Survey Says: Large language models are more likely to use predictable words like "the," "it," or "is" rather than more uncommon words.
Testing, Testing: If ChatGPT is asked the same question (or is provided the same exact prompt) from multiple users, it will provide nearly the exact same response to each. This repetition of words, logic or reasoning can be indication of AI generated language.
Watch the Clock: ChatGPT cannot detect events that have occurred recently. This can lead to factually inaccurate information.
Practice Makes Perfect: Researchers from the University of Pennsylvania created a game to test how good humans are at spotting AI-written text—try the game and see how well you can identify computer generated language.
Battle of the Bots – AI vs. AI: Software exists that analyzes the different features of a text, including how fluently something reads, how often certain words appear, and whether there are predictable patterns, to determine the likelihood that it is composed of AI-generated content.
At this time, the Purdue System, including Purdue Global, does not recognize the validity of any AI detection tools.
AI Detection tools remain inaccurate and unreliable. Faculty must not use AI detection applications alone to conclude that there has been plagiarism or a violation of academic integrity. These indicators are only tools to prompt faculty to further investigate how the student completed the assignment.
Using Turnitin's AI Writing Indicator
Turnitin Videos & Podcasts
This video provides an overview of Turnitin’s new AI writing detection for educators and administrators.
This video explains how Turnitin's AI detection model deals with false positives and what constitutes a false positive.
Turnitin Blog Posts
A Closer Look at Turnitin's AI Detection Capabilities...
Turnitin’s (TII) AI detection tool/score is NOT visible to students.
To access the tool simply open the regular TII Originality Report—the AI “score” will be displayed in a small, blue box labeled, AI.
When instructors first access the new AI detection tool there are guidance resources provided that walk them through this new aspect of the TII Originality Report.
Considerations
Turnitin (TII) launched its AI detection tool on April 4th, 2023.
The detection tool is currently trained on ChatGPT and ChatGPT 3.5–it has not been fully trained on ChatGPT 4.
Just like with other instance of plagiarism, the TII Originality Report should always be read carefully to determine whether a breach of academic integrity has occurred with the use of AI. Please do not use AI detection applications alone to conclude that there has been plagiarism or a violation of academic integrity. For instance, do not judge a submission by a percentage only. Finally, the current Student Code of Conduct should be followed for cases involving the use of AI.
Use as a learning moment.
© 2023 PG AI Task Force | Webmaster: William Ashley Johnson | Contact: wjohnson3@purdueglobal.edu