Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Serious Games

Date Submitted: Nov 17, 2021
Date Accepted: Apr 7, 2022

The final, peer-reviewed published version of this preprint can be found here:

Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

Knobel SEJ, Kaufmann BC, Geiser N, Gerber SM, Müri RM, Nef T, Nyffeler T, Cazzoli D

Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

JMIR Serious Games 2022;10(2):e34884

DOI: 10.2196/34884

PMID: 35612894

PMCID: 9178455

Effects of virtual reality-based multi-modal audio-tactile cueing in patients with spatial attention deficits. A pilot study

  • Samuel Elia Johannes Knobel; 
  • Brigitte Charlotte Kaufmann; 
  • Nora Geiser; 
  • Stephan Moreno Gerber; 
  • René M Müri; 
  • Tobias Nef; 
  • Thomas Nyffeler; 
  • Dario Cazzoli

ABSTRACT

Background:

Virtual reality (VR) devices are increasingly used in medicine and other areas for a broad spectrum of applications, from training to rehabilitation. One of the possible applications of VR is an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention, so-called hemispatial neglect. One approach to ameliorate neglect is to apply cross-modal cues (i.e., cues in other sensory modalities than the visual one) to guide visual attention towards the neglected space. So far, no study investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients.

Objective:

This pilot study thus aims to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a three-dimensional VR setting, in patients suffering from neglect, as well as obtaining preliminary results concerning the effects of different types of cues compared to non-cued conditions on visual attention allocation in these patients.

Methods:

In our bird search task, the patients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped in order to be able to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at four different presentation angles (lateral and paracentral, on the left and the right), and either with (auditory, tactile, audio-tactile) or without (no cue) a spatially meaningful cue (cue type). The task usability, feasibility and two simple in-task measures (performance, early orientation) were assessed in 12 right-hemispheric stroke patients with neglect, 5 with and 7 without additional somatosensory impairment (group).

Results:

The new setup showed high usability (10.2±1.85 ; max=12) and no relevant side effects (0.833±0.834 ; max=21). A repeated-measures ANOVA on task performance data, with presentation angle, cue type and group as factors, revealed a significant main effect of cue type (F30,3=9.863, p<0.001) and a significant three-way interaction (F90,9=2.057, p=0.042). Post-hoc analyses revealed that for patients without somatosensory impairment, any cue led to a better performance than no cue for targets on the left side; audio-tactile cues did not seem to have additive effects. In patients with somatosensory impairment, performance was better with both auditive and audio-tactile cueing than with no cue, at every presentation angle; conversely, tactile cueing alone had no significant effect at any presentation angle. Analysis of early orientation data showed that any type of cue (auditory, tactile or audio-tactile) triggered better orientation in both groups for the lateral presentation angles, possibly reflecting an early alerting effect.

Conclusions:

Overall, audio-tactile cueing seems to be a promising method to guide patients’ attention. For instance, this could be used in the future as an add-on supporting attentional orientation during established therapeutic approaches. Clinical Trial: none


 Citation

Please cite as:

Knobel SEJ, Kaufmann BC, Geiser N, Gerber SM, Müri RM, Nef T, Nyffeler T, Cazzoli D

Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

JMIR Serious Games 2022;10(2):e34884

DOI: 10.2196/34884

PMID: 35612894

PMCID: 9178455

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.