Isosurface Visualization Using Augmented Reality for Improving Tumor Resection Outcomes

Abstract

Tumor resection techniques have significantly improved survival rates in cancer patients. However, these require chemotherapy or radiation as follow-up procedures. With the advent of Mixed Reality technology, a wide range of possibilities have opened for the field of surgery. This work explores the use of mixed reality for maximizing tumor margin removed during surgical procedures. An isosurface reconstruction algorithm was integrated with the Microsoft HoloLens, a self-contained holographic computer, to enable visualization of Computed Tomography (CT) imaging superimposed in 3D on the patient. The results suggest that though the device has limitations at its current stage, the Microsoft HoloLens could be used for planning and overlaying the imaging information on the patient for excision of lesions in real-time. The modules developed could also be extended to other types of surgery involving visualization of Digital Imaging and Communication in Medicine (DICOM) files.