Accepted for/Published in: JMIR Human Factors
Date Submitted: Dec 27, 2024
Date Accepted: Mar 23, 2025
Utilizing Gesture and Speech to Control Surgical Lighting Systems
ABSTRACT
Background:
Surgical lighting systems provide optimal lighting conditions for the operating room personnel. Current systems are mainly adjusted by hand, where surgeons either accommodate the light themselves or communicate their requirements to an assistant to ensure optimal surgical conditions. This poses challenges to maintaining sterility, proper accessibility, illumination, and potential collision problems. Furthermore, the personnel operating the light may not have deep medical knowledge or equipment expertise.
Objective:
This work introduces a touch-free interaction concept for controlling the surgical lighting system using speech and gestures.
Methods:
We employed an iterative user-centered design (UCD) approach with participatory design sessions. This process involved conducting a literature review, several observations of actual surgical sites, and engaging stakeholders through interviews and focus groups. Additionally, we carried out two user studies: one in a virtual reality setup and another in a living lab environment.
Results:
Our findings indicate that our interaction concept is a viable alternative for controlling the SLS. Despite some technical limitations, surgical experts found the system intuitive and useful, recognizing the significant potential for touch-free lighting adjustments in the operating room. The combination of speech and gesture modalities was seen as helpful and even necessary, with some interactions better suited to one modality over the other. Offering both modalities for each interaction also provided greater flexibility.
Conclusions:
Our findings suggest that our proposed touch-free interaction concept can enhance surgical conditions and has the potential to replace traditional adjustment.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.