Abstract
Background
In this paper we present a landmark‐based augmented reality (AR) endoscope system for endoscopic paranasal and transnasal surgeries along with fast and automatic calibration and registration procedures for the endoscope.
Methods
Preoperatively the surgeon selects natural landmarks or can define new landmarks in CT volume. These landmarks are overlaid, after proper registration of preoperative CT to the patient, on the endoscopic video stream. The specified name of the landmark, along with selected colour and its distance from the endoscope tip, is also augmented. The endoscope optics are calibrated and registered by fast and automatic methods. Accuracy of the system is evaluated in a metallic grid and cadaver set‐up.
Results
Root mean square (RMS) error of the system is 0.8 mm in a controlled laboratory set‐up (metallic grid) and was 2.25 mm during cadaver studies.
Conclusions
A novel landmark‐based AR endoscope system is implemented and its accuracy is evaluated. Augmented landmarks will help the surgeon to orientate and navigate the surgical field. Studies prove the capability of the system for the proposed application. Further clinical studies are planned in near future. Copyright © 2009 John Wiley & Sons, Ltd.