27 Augmented Reality and Haptics … Computer Vision News Computer Vision News We chose three different surgical planning scenarios, including mitral valve delineation, hip tumor resection, and pedicle screw placement to cover planning with soft tissue with complex geometry, hard tissue, and implant placement. Our surgical planning platforms were developed using Unity, and they all provided the same features, like adding and deleting a landmark, navigating through the 3D scene to modify the surgical plan, and saving it. To test the usability of the platforms, we conducted user studies at Concordia and McGill University with non-clinicians (novices) and at Montreal General Hospital with clinicians (experts). We looked at time, and usability based on the NASA-TLX and system-specific questions. Results of the NASA-TLX questionnaire suggest that overall, the haptics system has the highest workload for clinicians, which contradicts the results of our novices’ experience and previous studies. Regarding time, results showed AR was the most time-consuming for both groups compared to the other two interfaces. We predict this may be due to the unfamiliarity of the users with MR devices, as an AR expert surgeon finished planning on HoloLens faster than other users. We also found that the preferences for input and display type varied based on the surgical scenario, suggesting different planning scenarios may benefit from different interaction and visualization methods. For example, for cases involving implant placement, users suggested that AR provides better depth perception and more degrees of freedom for controlling the position and rotation of the implant. In the future, we aim to plan more complex surgeries involving robotics surgery and robot trajectory planning.
RkJQdWJsaXNoZXIy NTc3NzU=