Embedded Files
A robot that follows you and answers all of your questions.
What is it?
What is it?
Recently there has been much talk about “assistant robots”, in places such as hospitals or museums, that could follow someone around and provide assistance in things such as answering questions. My proposed solution to this need is this mobile follower robot. It will follow a person around, and when asked a question, it will respond using an AI chatbot to come up with the best possible answer.
Goal 1: Following
Goal 1: Following
The robot should be able to follow a person around. Where you go, the robot goes. I will do this using computer vision.
Goal 2: Obstacle Avoidance
Goal 2: Obstacle Avoidance
The robot should be able to detect if something is blocking its path. It will do this using depth sensors.
Goal 3: Voice Recognition
Goal 3: Voice Recognition
The robot should be able to know when a person is talking to it, and it should be able to clearly understand what the person is saying.
Goal 4: Answering Questions
Goal 4: Answering Questions
The robot should be able to output accurate answers to the user's questions. It will do this using an AI chatbot, such as ChatGPT by OpenAI. It will output the reply via a speaker.
Planned Hardware
Planned Hardware
The base that I will be using is the TurtleBot2. Currently, I am thinking it will follow a location tracker that will be with the person. To do this, it will need camera data, distance, and inertial sensors. For user interaction, it will need a screen, a voice recognition system with a microphone, and a speaker.
Planned Software
Planned Software
For the location tracking part, I will need to find a good computer vision model that can detect a person. Then it needs to lock to that person and stay a certain distance away from them. It will also be programmed to respond to situations such as when an obstacle is in its way. For user interaction, I will program a user control to make it stop following, go to a home base, come closer to the user, etc. I will do the programming in C++ and ROS 2. For the voice recognition system, I will need to train the system on my voice and recognize certain command words. Then I will need to connect it to the AI that will be generating the responses.
Rough Timeline
Rough Timeline
This timeline may be changed according to project due dates, requirements, and constraints.
Week 1: Planning and research, find specific hardware and software components.
Weeks 2-4: Hardware setup, purchase necessary parts, and put them together.
Weeks 5-7: Software development, give the robot the ability to follow a person around.
Weeks 8-10: Testing and refinement, make sure the robot works and is user-friendly.
Week 11: Finalization and documentation, be ready to present the robot.
Page updated
Google Sites
Report abuse