Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Mental Health

Date Submitted: Jun 13, 2023
Open Peer Review Period: Jun 13, 2023 - Jun 27, 2023
Date Accepted: Jan 21, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Psychometric Assessment of an Item Bank for Adaptive Testing on Patient-Reported Experience of Care Environment for Severe Mental Illness: Validation Study

FERNANDES S, Brousse Y, Zendjidjian X, Riedberger J, Cano D, LLorca PM, Samalin L, Dassa D, Trichard C, LAPREVOTE V, Sauvaget A, ABBAR M, Misdrahi D, Berna F, Lancon C, Coulon N, El Hage W, Rozier Pe, Benoit M, GIORDANA B, Caqueo-Urizar A, Yon D, Tran B, Auquier P, Fond G, Boyer L

Psychometric Assessment of an Item Bank for Adaptive Testing on Patient-Reported Experience of Care Environment for Severe Mental Illness: Validation Study

JMIR Ment Health 2024;11:e49916

DOI: 10.2196/49916

PMID: 38753416

PMCID: 11140279

Measuring the patient-reported experience of the care environment for severe mental illnesses: psychometric evaluation of an item bank for computerized adaptive testing (PREMIUM-CE)

  • Sarah FERNANDES; 
  • Yann Brousse; 
  • Xavier Zendjidjian; 
  • Jeremie Riedberger; 
  • Delphine Cano; 
  • Pierre-Michel LLorca; 
  • Ludovic Samalin; 
  • Daniel Dassa; 
  • Christian Trichard; 
  • Vincent LAPREVOTE; 
  • Anne Sauvaget; 
  • Mocrane ABBAR; 
  • David Misdrahi; 
  • Fabrice Berna; 
  • Christophe Lancon; 
  • Nathalie Coulon; 
  • Wissam El Hage; 
  • Pierre-emmanuel Rozier; 
  • Michel Benoit; 
  • BRUNO GIORDANA; 
  • Alejandra Caqueo-Urizar; 
  • DongKeon Yon; 
  • Bach Tran; 
  • Pascal Auquier; 
  • Guillaume Fond; 
  • Laurent Boyer

ABSTRACT

Background:

The care environment significantly influences the experiences of patients with severe mental illness (SMI) and the quality of their care. While a welcoming and stimulating environment enhances patient satisfaction and health outcomes, psychiatric facilities often prioritize staff workflow over patient needs, leading to a prison-like atmosphere and limited social interactions. Addressing these challenges is crucial to improve patient experiences and outcomes in mental health care.

Objective:

This study aimed to establish an item bank (PREMIUM-CE) and develop a computerized adaptive test (CAT) to measure the care environment experience of adult patients with schizophrenia, bipolar disorder, or major depressive disorder.

Methods:

Psychometric analyses included assessments of item response theory (IRT) model assumptions, IRT model fit, differential item functioning (DIF), item bank validity, and CAT simulations.

Results:

In this multicenter cross-sectional study, 498 patients were recruited from outpatient and inpatient settings. The 13-item bank was sufficiently unidimensional, had no item bias, and fit the IRT model well (RMSEA = 0.088, 95% CI [0.073–0.103], CFI = 0.967, TLI = 0.961). CAT simulations demonstrated that assessments could be performed with only 7 items, with correlations of 0.98 between CAT and the full item bank.

Conclusions:

The PREMIUM-CE item bank and its CAT version have shown excellent psychometric properties, making them reliable measures for evaluating the patient experience of the care environment among adults with SMI in both out- and in-patient settings. These measures are a valuable addition to the existing landscape of patient experience assessment, capturing what truly matters to patients and enhancing the understanding of their care experiences. Clinical Trial: The trial registration is NCT02491866. The assessment protocol was approved by the relevant ethical review board (CPP-Sud Méditerranée V, n°2014-A01152-45). All data are collected anonymously.


 Citation

Please cite as:

FERNANDES S, Brousse Y, Zendjidjian X, Riedberger J, Cano D, LLorca PM, Samalin L, Dassa D, Trichard C, LAPREVOTE V, Sauvaget A, ABBAR M, Misdrahi D, Berna F, Lancon C, Coulon N, El Hage W, Rozier Pe, Benoit M, GIORDANA B, Caqueo-Urizar A, Yon D, Tran B, Auquier P, Fond G, Boyer L

Psychometric Assessment of an Item Bank for Adaptive Testing on Patient-Reported Experience of Care Environment for Severe Mental Illness: Validation Study

JMIR Ment Health 2024;11:e49916

DOI: 10.2196/49916

PMID: 38753416

PMCID: 11140279

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.