the main challenges faced by your stakeholder
the main challenges faced by your stakeholder
Students cannot fully experience the surgical procedure during training.
Students may be able to view the procedure on a projected screen from the surgeon's perspective in the da Vinci Surgical System, but it can be challenging for them to identify where to focus. If they miss a critical point, it becomes difficult to catch up or re-engage with the lecture.
If students want to ask the lecturer a question, it can be difficult and time-consuming to pinpoint the specific issue or demonstrate their proposed actions to verify if their ideas are correct.
Once the lecture ends, students can only review the process by books or recalling, but it's not realistic enough and limited to current media.
If they practice again, they won't receive a score to evaluate their current proficiency level.
current design for your project
corresponding solution: clearly point out different functionalities of your solution, and how users interact with these features.(1-2mins)
By having both the lecturer and students wear the same electronic handwear and footwear, students can mimic the lecturer's actions, allowing them to easily experience every step of the actual procedure.
By implementing an eye tracker for both the lecturer and students, the lecturer's gaze trajectory can be easily seen by students. This allows students to follow the lecturer's focus, and the lecturer can easily highlight where to concentrate, making the learning process clear and understandable.
Conversely, if a student wants to raise a question to the lecturer, they can use their eye tracker to pinpoint the specific area of concern and utilize the electronic handwear and footwear to demonstrate their proposed actions, thus concretizing their idea.
By storing all data collected from the electronic handwear, footwear, eye tracker, and the screen of the da Vinci Surgical System during surgery, students can later log into the system, select the organ they want to practice on, and put on the electronic handwear and footwear. This allows them to practice and watch past surgical procedures repeatedly, making them feel like they're learning in real time, thus enhancing their learning experience.
Once enough data is collected, we can train an expert system on different organs and wounds. When students wear their electronic handwear and footwear and operate the simulated surgical procedure, they can receive a similarity score compared to a proficient surgeon. This system provides feedback on areas for improvement, helping students to become more like professionals.
Conclusion and Future Work
Future Work
"Recent advancements in portable da Vinci simulators using virtual reality are paving the way for groundbreaking developments in surgical training. By integrating our project with these VR simulators, we envision a future where surgeons can overcome geographical and time constraints to perform procedures with unprecedented flexibility. Surgeons will no longer need to endure the discomfort of being confined to the current da Vinci machine console for extended periods. Instead, they will benefit from enhanced ergonomics and a more immersive, dynamic training environment, making long procedures more comfortable and efficient."