Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Dec 18, 2023
Date Accepted: Apr 25, 2024
Date Submitted to PubMed: Apr 29, 2024

The final, peer-reviewed published version of this preprint can be found here:

Instruments for Measuring Psychological Dimensions in Human-Robot Interaction: Systematic Review of Psychometric Properties

Vagnetti R, Camp N, Story M, Ait-Belaid K, Mitra S, Zecca M, Di Nuovo A, Magistro D

Instruments for Measuring Psychological Dimensions in Human-Robot Interaction: Systematic Review of Psychometric Properties

J Med Internet Res 2024;26:e55597

DOI: 10.2196/55597

PMID: 38682783

PMCID: 11187516

Instruments for Measuring Psychological Dimensions in Human-Robot Interaction: A Systematic Review of Psychometric Properties.

  • Roberto Vagnetti; 
  • Nicola Camp; 
  • Matthew Story; 
  • Khaoula Ait-Belaid; 
  • Suvo Mitra; 
  • Massimiliano Zecca; 
  • Alessandro Di Nuovo; 
  • Daniele Magistro

ABSTRACT

Background:

Numerous user-related psychological dimensions can significantly influence the dynamics between humans and robots. For developers and researchers, it is crucial to have a comprehensive understanding of the psychometric properties of the available instruments used to assess these dimensions, as they indicate the reliability and validity of the assessment.

Objective:

This study aims to provide a review of the instruments available for assessing the psychological aspects between people and social and domestic robots, offering a summary of their psychometric properties and the quality of the evidence.

Methods:

A systematic review was conducted following the PRISMA guidelines across different databases including Scopus, PubMed and IEEEXplore. The research strategy included studies that reported the development and psychometric validation of instruments designed to assess individuals' psychological dimensions related to robots. Studies concentrating on industrial robots, rescue robots, robotic arms, or those primarily concerned with technology validation or measuring anthropomorphism were excluded. Independent reviewers extracted instruments properties and methodological quality of their evidence following the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines.

Results:

From 3,828 identified records, the research strategy yielded 34 articles that validated and examined the psychometric properties of 27 instruments designed to assess individuals' psychological dimensions in relation to social and domestic robots. These instruments encompass a broad spectrum of psychological dimensions. While most studies predominantly focused on structural validity and internal consistency, consideration of other psychometric properties was frequently inconsistent or absent. Most of the instruments were targeted at both adults and older adults (18 years old and above). There is a limited number of instruments specifically designed for children, older adults, and healthcare contexts.

Conclusions:

Given the strong interest in assessing psychological dimensions in the human-robot relationship, there is a need to develop new instruments using more rigorous methodologies and to consider a broader range of psychometric properties. This is essential to ensure the creation of reliable and valid measures for assessing people's psychological dimensions toward social and domestic robots. Among the limitations, the review included instruments applicable to both social robots and domestic robots, while excluding those for some specific types of robots (e.g., industrial robots). Clinical Trial: This work was supported by the EPSRC and NIHR (grant number EP/W031809/1, IMACTIVE). The review was not registered with any relevant database.


 Citation

Please cite as:

Vagnetti R, Camp N, Story M, Ait-Belaid K, Mitra S, Zecca M, Di Nuovo A, Magistro D

Instruments for Measuring Psychological Dimensions in Human-Robot Interaction: Systematic Review of Psychometric Properties

J Med Internet Res 2024;26:e55597

DOI: 10.2196/55597

PMID: 38682783

PMCID: 11187516

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.