Topic 4.
Issues and Concerns
Possible Issues and Challenges of AI for Educators
Generative AI has given rise to a multitude of applications that are transforming our lives. However, like any emerging technology, it comes with its own set of issues and challenges. Before we start to explore the possible issues and challenges of GenAI for educators, let us quickly introduce you with one of such issues is the phenomenon of 'AI hallucination':
Example: AI Hallucination
According to IBM, AI hallucination is "a phenomenon wherein a large language model (LLM)—often a generative AI chatbot or computer vision tool—perceives patterns or objects that are nonexistent or imperceptible to human observers, creating outputs that are nonsensical or altogether inaccurate".
On the right side, you can see an example of hallucination that DALL-E 2 created with a prompt "1960's art of cow getting abductied by UFO in midwest". While the image has all the elements in the prompt, the AI did not get the full context. This may have potential for artistic creation sometimes, but when it comes to accracy of the outputs (especially text-based ones), AI halluciation can impose great risks on its users.
Image from https://www.sify.com/ai-analytics/the-hilarious-and-horrifying-hallucinations-of-ai/
IBM continues that "the best way to mitigate the impact of AI hallucinations is to stop them before they happen", and they present steps we can take to avoide hallucination as much as possible. One step is to rely on human oversight:
"Making sure a human being is validating and reviewing AI outputs is a final backstop measure to prevent hallucination. Involving human oversight ensures that, if the AI hallucinates, a human will be available to filter and correct it. A human reviewer can also offer subject matter expertise that enhances their ability to evaluate AI content for accuracy and relevance to the task". (see the full steps HERE.)
What issues and concerns does GenAI impose on education?
Hallucination is just one of the issues that generative AI has. While generative AI offers immense benefits, educators should also consider potential issues, challenges, and considerations when incorporating it into their teaching. Here are two examples of issues and concerns identified by the academic insutitutes and the creator of ChatGPT (OpenAI).
Center for Teaching Innovation (CTI) at Cornell University identifies the issues and concerns of GenAI in teaching:
“There are many open questions, including legal questions, regarding the ethical design, development, use, and evaluation of generative AI in teaching and learning. While generative AI may potentially be powerfully useful, concerns and sensitivities surround a number of key issues including:
Transparency and oversight: as many generative AI are developed and owned by corporations, how can we know how the tools are trained or what safeguards exist protecting users against inaccurate information or harmful interactions?
Political impact: what protections exist against generative AI being used to spread inaccurate or discriminatory content?
Environmental impact: as generative AI tools are trained with ever larger data sets, requiring more and more energy consumption, what is the energy use impact on the environment?
Diversity, non-discrimination and fairness: how can we ensure that tools avoid unfair bias and are universally accessible?
Privacy, data governance, technical robustness and safety: how is user data or copyrighted material used, stored, or shared? Who has access to user data? (European Commission, 2022)."
CTI suggests a few questions from ethics and equity standpoints "for instructors to consider, and to invite students to consider, when critically evaluating AI or Generative AI content:
Is the AI-generated content accurate? How can you test or assess the accuracy?
Can other credible sources (outside of generative AI) validate the data or item produced?
How does the information generated impact or influence your thinking on this topic?
Who is represented in this data? Is the data inclusive in terms of the material’s scope and the perspectives that it presents?
Knowing LLMs may also be collecting the data your students input (i.e., in their prompts), how will you make students aware of this practice so they will in turn safeguard their own privacy?"
(Read the full article here: https://teaching.cornell.edu/generative-artificial-intelligence/ethical-ai-teaching-and-learning)
The creators of GenAI apps are aware of such risks. Here is an excerpt from OpenAI, a creator of ChatGPT:
“We recognize that many school districts and higher education institutions do not currently account for generative AI in their policies on academic honesty. We also understand that some students may have used these tools for assignments without disclosing their use of AI. In addition to potentially violating school honor codes, such cases may be against our terms of use: users must be at least 13 years old and users between the ages of 13 and 18 must have parental or guardian permission to use the platform."
OpenAI then suggets the following appraoches that people have found helpfu to alleviate tensions from such issuses and challenges:
"One technique some teachers have found useful is encouraging students to share specific conversations from ChatGPT. This can have many benefits:
Showing their work and formative assessment:
Educators can analyze student interactions with ChatGPT to observe critical thinking and problem-solving approaches.
Shared links can enable students to review each other's work, fostering a collaborative environment.
By keeping a record of their conversations with AI, students can reflect on their progress over time. They can see how their skills in asking questions, analyzing responses, and integrating information have developed. Teachers can also use these records to provide personalized feedback and support individual growth.
Information and AI literacy:
Students can demonstrate their ability to interact with AI and their understanding of the shortcomings of AI systems. Educators can assess the quality of the questions asked, the relevance of the information obtained, and how well the student understood to challenge, double-check, and consider potential biases in that information.
We anticipate a future where the use of AI tools like ChatGPT is commonplace. Encouraging responsible use helps students prepare for a future where they may be expected to leverage AI in different contexts.
Creating accountability:
Sharing interactions with the model ensures that students are held accountable for the way they use AI in their work. Educators can verify that students are engaging with the tool responsibly and meaningfully, rather than simply copying answers.
(Read a full article here: https://help.openai.com/en/articles/8313351-how-can-educators-respond-to-students-presenting-ai-generated-content-as-their-own)
What about GenAI for content creation?
In addition (and since we introduced the topic of "GenAI for multimodal Content Creation), we would like to call for your attention on the following items when you want to use Generative AI toosl for your teaching content creation:
Data Privacy: AI systems often require large amounts of data to function effectively. Ensuring the privacy and security of student data is crucial.
Quality Control: While AI can generate content, the quality may not always meet the standards required for effective teaching. Educators would need to review and possibly edit the content generated by AI.
Technical Knowledge: Using AI tools might require a certain level of technical knowledge. Not all educators may be comfortable or familiar with these technologies.
Cost: Depending on the AI platforms and services, there could be significant costs involved. Schools and educators will need to weigh these costs against the benefits.
Equity: There's a risk that only students with access to certain technologies can benefit from AI-powered education. It's important to ensure that all students have equal access to these learning opportunities.
Depersonalization: While AI can personalize content to individual learning styles, it lacks the human touch that often makes learning engaging and meaningful. The role of a teacher in motivating and inspiring students shouldn't be underestimated.
Reliability: AI systems can make mistakes or fail. Having a backup plan in place is important.
Incorporating AI into education is a promising development, but it's not without its challenges. By considering these points, educators can make informed decisions and implement AI effectively in their content creation processes.
What About Students?
Allowing students to use generative AI in their learning presents several potential challenges and considerations:
Regulation: Schools need to be ready to regulate the use of AI. This may involve developing guidelines for acceptable use, monitoring student interactions with the AI, and addressing any issues that arise.
Plagiarism: Generative AI systems could potentially be used for plagiarism. This can undermine academic integrity and the learning process. It's crucial to educate students about proper use and the importance of original work.
Academic Misconduct: Some classes or schools consider the use of generative AI to be academic misconduct. Clear policies and dialogue are necessary to avoid such misunderstandings.
Psychological Reactance: Banning generative AI could drive students to want access more through heightened attention and psychological reactance. Striking a balance between restriction and freedom is important.
Equity: While generative AI can support diversity and inclusion by creating personalized assessments, it also requires that all students have access to the necessary technology. Ensuring equal access is a significant consideration.
Adjustment: Generative AI can automatically adjust teaching routes and difficulty based on students' learning progress. However, this requires careful monitoring to ensure that the AI is accurately assessing and responding to student needs.
In conclusion, while generative AI has the potential to significantly enhance learning, it also presents several challenges that educators must navigate carefully.
Be Prepared.
Then how can educators best prepare themselves to leverage the benefits of generative AI while effectively addressing the challenges in order to enhance their students' learning experiences?
Educators can prepare themselves to leverage the benefits of generative AI and address the challenges in several ways:
Education and Training: Educators should familiarize themselves with AI technologies, their applications, and their limitations. This might involve taking courses, attending workshops, or seeking guidance from experts.
Collaboration with Technology Experts: Collaborating with AI experts or tech-savvy colleagues can help educators understand how to best use AI in their teaching. They can provide valuable insights into the practical aspects of implementing AI tools.
Pilot Testing: Before fully integrating AI into their teaching, educators should conduct pilot tests to assess the effectiveness of the AI tools and identify any potential issues.
Data Security Awareness: Educators should be aware of data privacy laws and best practices to ensure the security and privacy of student data.
Budget Planning: Educators should consider the costs of AI tools and plan their budgets accordingly. They could also explore grants or other funding opportunities for incorporating technology into education.
Flexibility: Educators should be prepared to adapt their teaching methods as needed. If an AI tool isn't working as expected, they should be ready to try different approaches or tools.
Inclusive Learning Strategies: To ensure equity, educators should strive to implement AI tools that are accessible to all students, regardless of their technological capabilities.
Maintaining Human Touch: Despite the automation that AI brings, educators should remember the importance of human interaction in education. They should strive to maintain personal connections with their students.
By taking these steps, educators can effectively leverage the benefits of generative AI and enhance their students' learning experiences.
Additional Resources
[Reading] Guidance for generative AI in education and research by UNESCO: https://unesdoc.unesco.org/ark:/48223/pf0000386693
[Reading] University of Michigan - Guidance for Faculty/Instructors: https://genai.umich.edu/guidance/faculty
[Reading] University of San Francisco - GenAI: Guidelines for Academic Integrity: https://myusf.usfca.edu/ets/generative-AI/academic-integrity
[Reading] Artificial Intelligence and the Future of Teaching and Learning: Insights and Recommendations
[Reading] Should schools ban or integrate generative AI in the classroom?
[Reading] Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
[Video] What is AI Ethics? (06:09)