I hope to focus my problem of practice on an exploration of whether a chatbot that uses natural language understanding can engage students in science-centered conversations. These dialogues between student and computer will be designed, prototyped, tested, and redesigned. They will be evaluated through the lens of whether or not such conversations can be developed into a useful form of assessment.
Chatbots can be designed in a very scripted way, prompting students for predictable answers. They can also be designed to dynamically move the conversation in a particular direction, based on the answers that a student provides. This creates an opportunity to probe student thinking in a more thorough way--one that mirrors what a live teacher might do. Natural language understanding allows a chatbot to understand the many different ways that a student might express an idea. Chatbots can be trained to understand a variety of slang or dialectic speech, allowing for the possibility of an equitable assessment vehicle.
The idea of using a chatbot as a form of assessment draws on several intriguing possibilities:
natural language understanding: computer algorithms that can understand input in human language, either written or spoken.
machine learning: Computer programs that can "learn" because they are trained to recognize and respond to data in such a way that it can respond to new, but similar situations.
There are many Performance Expectations in the NGSS and the Nebraska science standards that are conducive to using conversation as a component of assessment. For the purposes of this problem of practice, I hope to identify a few of these and design conversation-based assessments with them. As a design project in a relatively unknown area of development, the scope is difficult to fully define at this stage. The challenge of this problem of practice lies in the technical task of constructing a piece of software that will perform in this way, as well as in identifying the possible forks and branches that may occur in such a conversation. A potential strength of the conversation-based format lies in the possibility of leveraging those branches to help make student thinking visible, possibly even helping the student to identify and clarify their ideas in the process. I see two possible pieces to this.