Augmenting Expertise in Surgical Training
Augmenting Expertise in Surgical Training
Embedded Files
This project involved the design, development, deployment and evaluation of a video annotation tool in surgical training.
My role here was to lead a team of researchers and developers to design a gesturing system and conduct an experiment in a simulated OR for the evaluation of the system at outcome and process levels.
The idea of video annotation for surgery partially came from an interview with surgical residents and fellows:
The design is guided by our understanding of their communication - seeing the actions and the knowledge.
We tested it out with our surgeon collaborators, in terms of quality of instruction, time to task completion, economy of movement, number of errors and gaze behavior. The system was perceived to enhance trainees' efficiency and accuracy in following instructions, with their gaze pattern more approaching to experts'.
We brought it to an international surgical conference - SAGES, to evaluate the usefulness and acceptance of this tool among a broader audience. After the attendees tried out the system in our paper model tasks, we administered a questionnaire on the user experience, the perceived tool objectives, attitude, and intention to use.
The tool was further assessed at process level to investigate the impact of this tool on trainees' learning behaviors. With the use of mixed methods, we illustrated that the communication becomes more imbalanced and the trainees become less active when using the single-user gesturing tool and highlighted the needs to grant all parties the same level of access to a shared display and suggest further directions in designing a shared display for instructional collaborative tasks.
We have a series of publications from this project:
Feng, Y., McGowan, H., Semsar, A., Zahiri, H., George, I., Park, A., Kleinsmith, A., Mentis, H. M. Virtual Pointer for Gaze Guidance in Laparoscopic Surgery. Surgical endoscopy.
Feng, Y., Chhikara, J., Ramsey, J., Mentis, H.M. (Submitted). Perceived usefulness and acceptance of communication support system in laparoscopic surgery. AMIA Annual Symposium 2019.
Feng, Y., Katie, Li., Semsar, A., Zahiri, H., George, I., Park, A., Kleinsmith, A., Mentis, H. M. (To be appeared in 2019). Communication Cost of Single User Gesturing Tool in Laparoscopic Surgical Training. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), Glasgow, UK. (Acceptance Rate: 23.8%)
Feng, Y., McGowan, H., Semsar, A., Zahiri, H., George, I., Turner, T., Park, A., Kleinsmith, A., Mentis, H. M. (2018). A virtual pointer to support the adoption of professional vision in laparoscopic training. International Journal of Computer Assisted Radiology and Surgery, 1-10.
Google Sites
Report abuse