Beating AI Bots

Below are the two presentations I have given about AI and what faculty can do to hinder student misuse of AI. One focuses on the problems and eight potential solutions to those problems (presented in March 2023 to the faculty of Hope International University). The second presentation is an improvement upon the first (presented in September 2023 to the faculty or Dominican University, IL). Many of the "solutions" mentioned in these presentations are outlined here and others are available, in more depth, on the other tabs (try ACRL's Frames).

Contact email: sejung@hiu.edu OR profstevejung@gmail.com

[HINT - DOWNLOAD THE FILE, THE 'PREVIEW' DOESN'T SHOW ALL TEXT ON ALL SLIDES]

Thwarting Chatbots and AI.pptx

Thwarting Chatbots and AI

Here is the presentation given at HIU. Below is the list of "solutions". Use them individually, or in combination.

A. Lower-division option – footnotes or annotated reference page

B. Upper-division/grad option – appendix including evaluation of method

(Aug. 8, 2023 - I think there are a couple more I would add - ensure that the assignments connect to lecture and/or the textbook. Those will not be on the web and the AI will not have access, thus another chance to thwart the bot. Another opportunity would be to require that the student must write about a personal connection/reflection about the subject. AI can fake some of this, but if the faculty member knows the students, this becomes harder to fake.)

 ** Instructions / Rubrics found below

23.4 1 Beating the Bots.pptx

Beating the Bots

After a discussion about what Generative AI writing tools can do (and why they have hallucinations) I move onto 9 things an instructor can do to put a speedbump / hinder a student from misusing AI. Use these individually or together.

 **  Instructions / Rubrics found below

01 FRAME creating 8.13.20.docx

Require Reference Page

A reference page, by itself, is a good thing and will discourage plagiarism. One that is turned in early requires the student to do the research early. It will also cause problems with AI systems that cannot do active research.

02 FRAME use 8.13.20.docx

Require more formats

More information formats is a good thing. It makes the student aware of different resources and opens their minds to different types of research. This also causes problems with AI, in that, right now, it cannot use other resources than what it was fed/taught (mostly ebooks, wikipedia, and social media).

05 FRAME explain search 8.13.20.docx

Explain search strategy

AI can produce citations, but it cannot tell us how it found the resources. This makes the student explain all the details of their search. The bot cannot do that.

GENERIC CRAAP Evaluation Checklist rev 1 18.doc

Evaluation (form)

This is a generic CRAAP form evaluating Currency, Relevancy, Authority, Accuracy, and Purpose or Persuasion. It is not a perfect instrument, but a tool that can help student think about the resource they are using and if they should be using it.

12.1 FRAME evaluation currency 8.13.20.docx

Evaluation of resources

The file to the left, and the four found below, are all evaluation assignments. Each one evaluates one aspect of the "CRAAP" model (Currency, Relevancy, Authority, Accuracy, and Purpose or Persuasion).

(Currency)

12.2 FRAME evaluation relevancy 8.13.20.docx

(Relevancy)

12.3 FRAME evaluation authority 8.13.20.docx

(Authority)

12.4 FRAME evaluation accuracy 8.13.20.docx

(Accuracy)

12.5 FRAME evaluation purpose persuasion 8.13.20.docx

(Purpose or Persuasion)