Research on the Music Interaction System Based on the Emotional Recognition of the Elderly in Smart Homes: Randomized Controlled Trial
ABSTRACT
Background:
The advent of the Smart Home 3.0 era imposes higher technical requirements for the construction of the home ecosystem. Music is an effective means for humans to regulate their emotions. The emergence of multimodal technology facilitates the use of music for emotional regulation by the elderly in their home environment. Therefore, it is necessary to carry out further research on the emotional issues of the music interaction system in smart homes that are targeted at elderly users.
Objective:
This study aimed to establish the mapping relationship between music parameters and emotional states based on the Valence-Arousal (VA) emotional model and through the analysis of electroencephalogram (EEG) signals. In addition, a novel Multimodal Fusion-Adaptive Wellness Interaction (MF-AWI) model was constructed to match the most suitable music and meet the emotional needs of elderly users.
Methods:
A total of 68 elderly participants aged between 60 and 75 years old were recruited. Four groups of music stimulus materials were formulated to conduct an experimental study on the relationship between the emotions of elderly subjects and music parameters. Finally, the MF-AWI model was constructed. With the recreational sofa as the main body, multi-modal emotional intelligent adaptive interaction was realized.
Results:
During the experiment, approximately 68,970,528 EEG signal data were collected. After analyzing the EEG bands and extracting the Event-Related Potential (ERP) data, the following results were obtained: For P200, the music stimulus materials showed significant differences and activation in the left parietal and occipital lobe regions. For N400, there were significant differences and activation in the prefrontal lobe region due to the music stimulus materials. For P300, the music stimulus materials led to significant differen ces and activation in the occipital lobe region and the central line region of the temporal area.
Conclusions:
Elderly users respond in a way that the A1 stimulus material, namely the music material with positive valence and high arousal (+V + A), can soothe the emotional state of elderly users. This provides a theoretical basis and evidence for the music interaction regulation module in smart home systems.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.