JMIR Publications

ABSTRACT

Background:

In light of its recent growth and development, virtual reality (VR) technology has started to gain attention as a possible new system to be introduced in education/training and also as a form of surgical support in medical settings. Three-dimensional (3D) models are useful for surgical teams sharing images. Preoperatively presenting cases using 3D models and visualizing actual previous surgeries has immense impact as well as major educational effects. In addition, 3D model presentation methods include both monitors and head-mounted displays (HMD). In the near future, 3D printers will also be used. Additionally, smartphones are now widespread, and various medical applications have also been developed. Multifunctional smartphones are becoming more and more capable of creating a VR/AR environment with ease. With the use of Google Cardboards, simple HMDs can be built, as well. However, since no experiments have been reported in which a 3D model of an organ had actually been observed in such an observation environment, we are yet to determine what positive effects or issues it may have and/or face.

Objective:

To study the issues that occur while observing a 3D model of an organ created based on an actual surgical case through use of a smartphone-based, simple HMD. Upon completion, we evaluate and gather feedback on the performance and usability of the simple observation environment that we have created.

Methods:

We downloaded our data to a smartphone (Galaxy S6, Samsung) and created a simple HMD system using Google Cardboard. Seventeen medical students performed two experiments: observation conducted by a single observer and another one carried out by multiple observers using a simple HMD. Then, they assessed the results by responding to a questionnaire survey.

Results:

We received a largely favorable response in the evaluation of the dissection model but also a low score due to visually-induced motion sickness and eye fatigue. In an introspective report on simultaneous observation made by multiple observers, positive opinions appraised clear image quality and shared understanding, whereas displeasure caused by visually-induced motion sickness, eye fatigue, and hardware problems was also expressed.

Conclusions:

We established a simple system that enables multiple persons to observe a 3D model created with the use of OsiriX. Although observation conducted by multiple observers was successful, problems likely occurred due to poor smartphone performance. Improving smartphone and augmented reality (AR) marker performance may be key factors in establishing a low-cost/user-friendly 3D observation environment.