Topic 4. 

Issues and Concerns

Possible Issues and Challenges of AI for Educators

Generative AI has given rise to a multitude of applications that are transforming our lives. However, like any emerging technology, it comes with its own set of issues and challenges. Before we start to explore the possible issues and challenges of GenAI for educators, let us quickly introduce you with one of  such issues is the phenomenon of 'AI hallucination':

Example: AI Hallucination

According to IBM, AI hallucination is "a phenomenon wherein a large language model (LLM)—often a generative AI chatbot or computer vision tool—perceives patterns or objects that are nonexistent or imperceptible to human observers, creating outputs that are nonsensical or altogether inaccurate".

On the right side, you can see an example of hallucination that DALL-E 2 created with a prompt "1960's art of cow getting abductied by UFO in midwest". While the image has all the elements in the prompt, the AI did not get the full context. This may have potential for artistic creation sometimes, but when it comes to accracy of the outputs (especially text-based ones), AI halluciation can impose great risks on its users.

Image from https://www.sify.com/ai-analytics/the-hilarious-and-horrifying-hallucinations-of-ai/

IBM continues that "the best way to mitigate the impact of AI hallucinations is to stop them before they happen", and they present steps we can take to avoide hallucination as much as possible. One step is to rely on human oversight:

"Making sure a human being is validating and reviewing AI outputs is a final backstop measure to prevent hallucination. Involving human oversight ensures that, if the AI hallucinates, a human will be available to filter and correct it. A human reviewer can also offer subject matter expertise that enhances their ability to evaluate AI content for accuracy and relevance to the task".  (see the full steps HERE.) 

What issues and concerns does GenAI impose on education?

Hallucination is just one of the issues that generative AI has. While generative AI offers immense benefits, educators should also consider potential issues, challenges, and considerations when incorporating it into their teaching. Here are two examples of issues and concerns identified by the academic insutitutes and the creator of ChatGPT (OpenAI). 

Center for Teaching Innovation (CTI) at Cornell University identifies the issues and concerns of GenAI in teaching

There are many open questions, including legal questions, regarding the ethical design, development, use, and evaluation of generative AI in teaching and learning. While generative AI may potentially be powerfully useful, concerns and sensitivities surround a number of key issues including: 

CTI suggests a few questions from ethics and equity standpoints "for instructors to consider, and to invite students to consider, when critically evaluating AI or Generative AI content:

(Read the full article here: https://teaching.cornell.edu/generative-artificial-intelligence/ethical-ai-teaching-and-learning)

The creators of GenAI apps are aware of such risks. Here is an excerpt from OpenAI, a creator of ChatGPT:

We recognize that many school districts and higher education institutions do not currently account for generative AI in their policies on academic honesty. We also understand that some students may have used these tools for assignments without disclosing their use of AI. In addition to potentially violating school honor codes, such cases may be against our terms of use: users must be at least 13 years old and users between the ages of 13 and 18 must have parental or guardian permission to use the platform."

OpenAI then suggets the following appraoches that people have found helpfu to alleviate tensions from such issuses and challenges: 

"One technique some teachers have found useful is encouraging students to share specific conversations from ChatGPT. This can have many benefits:

(Read a full article here: https://help.openai.com/en/articles/8313351-how-can-educators-respond-to-students-presenting-ai-generated-content-as-their-own)

What about GenAI for content creation?

In addition (and since we introduced the topic of "GenAI for multimodal Content Creation), we would like to call for your attention on the following items when you want to use Generative AI toosl for your teaching content creation:

Incorporating AI into education is a promising development, but it's not without its challenges. By considering these points, educators can make informed decisions and implement AI effectively in their content creation processes.

What About Students?

Allowing students to use generative AI in their learning presents several potential challenges and considerations:

In conclusion, while generative AI has the potential to significantly enhance learning, it also presents several challenges that educators must navigate carefully.

Be Prepared.

Then how can educators best prepare themselves to leverage the benefits of generative AI while effectively addressing the challenges in order to enhance their students' learning experiences?

Educators can prepare themselves to leverage the benefits of generative AI and address the challenges in several ways:

By taking these steps, educators can effectively leverage the benefits of generative AI and enhance their students' learning experiences.

Additional Resources