Bias in AI is a common but difficult problem to solve. Oftentimes, it can go unnoticed and affect real world outcomes such as the quality of a person's medical treatment, whether or not someone is hired for a job, and much more. As AI becomes more present in society, bias will become a bigger problem which needs to be addressed. To help students become more aware of AI and bias, we propose the design of an interactive web application which can give students both technical and ethical insights into AI. By teaching students to recognize the implicit biases which exist in modern AI models, they will be better equipped to navigate the world of AI. Students will learn how the training data directly affects the model behavior. Students will begin by being provided data samples for a classification task. Upon reviewing the samples, students will be asked to complete a timed classification task where they must best use their given samples to classify new samples. This could be classifying written digits, fruits, etc. Once the student is done, a model trained on the same data will repeat the task. Students can then see the difference in their preformance compared to hte models. After seeing bias in the models preformance, students will have a chance to changeFrom this, students should learn about how models learn from data and how bias can be hidden in samples.
Students will learn about how computers learn from data as well as the ethics surrounding AI.
The four page outlines on the left are not inclusive of all the pages a student might interact with. For example, there could possibly be a menu screen which prompts the user to start playing the game. The four pages on the left are as follows: the initial page which gives students training samples before their classification exercise, the timed exercise, an overview of student vs model performance, and finally real world examples of models which exhibit bias. Not included here is a page where students can try to reduce the trained models bias by changing the training samples.
Students will learn from the training data, classify a set of samples, and gain an understanding of bias in AI. Additionally, students will observe a bias model while it classifies samples and review real world cases of AI bias.
Student classification task metrics such as how fast they classify new samples.
How many times they revise the model to improve its performance on the task.
How long the student is engaged with the system. (rough metric for student interest)
Survey questions regarding student understanding of bias.
Questions regarding how models learn and understand.
By engaging with the idea of bias through a game setting, students will have a better understanding of how bias becomes a problem in the first place. By applying this new awareness to real life scenarios of bias, students will be able to see the ethical implications of AI in the modern world.
Cognimates or machinelarningforkids + Scratch
One of the reasons why AI has been taught to kids is so that they understand the applicability and behave responsibly while they are dealing with it. At the level of K-12 , Kids are not expected to learn the more technical details of machine learning, instead they can be focused on general intuition of the algorithms and how they are applied.
We address this by providing an interactive interface where we can give accessibility of these algorithms in the form of blocks and now kids can understand how input is given to specific algorithms and what kind of output the algorithms give in return . Later we build the real application scenarios on scratch so that kids can now relate to these algorithms . This might enforce the kids to think about which algorithms are behind these applications they use in daily life . Once they can conceptualize about the algorithm they would be interact with AI better
We would create machine learning algorithms on cognimates or machine learningforkids , and visualize them as blocks on scratch platforms. Kids interact with these blocks by video, voice, or drawing and understand the intuitions of how these blocks work. Now after they get comfortable with a few machine learning algorithms blocks in Scratch then we introduce them to scenario based questioning, where kids now see visual scenarios and have to guess the machine learning algorithm block that is best suited in the scenario.
How different algorithms will do different things , image recognition involves webcam/uploading sprite, vs voice to speech recognition - involves kids talking about something using a microphone or drawing the sprites .
qualitative (interview, survey)
Trigger their thinking capability , how kids would use these recognition item in other applications. Ask a student scenario , how a combination of these algorithms are used .
For example in the case of recognition what algorithms among can be used , now kids should identify the algorithms image recognition + voice recognition
They deal responsibly with these applications and can build their thinking capability to use different combinations of these algorithms . Better Awareness of the model the students can understand the limitations of the model, saying these models don't detect everything .
We would like to visually show the limitations of these algorithms, especially Bias . However we might be much more conclusive on this idea in future .