This paper has been accepted and is currently in production.
It will appear shortly on 10.2196/98825
The final accepted version (not copyedited yet) is in this tab.
Psychometric Evaluation of a Modified Self-Report v-NOTECHS Scale Among Undergraduate Nursing Students After Immersive Virtual Reality Simulation: Cross-Sectional Study
ABSTRACT
Background:
Non-technical skills (NTS) are essential competencies in nursing practice; however, validated self-report instruments for assessing NTS within immersive virtual reality (IVR) simulation contexts remain scarce.
Objective:
This study evaluated the psychometric properties of the Virtual NOTECHS (v-NOTECHS) scale, a modified self-report instrument measuring self-perceived NTS among nursing students following IVR clinical simulation.
Methods:
In this cross-sectional study, all 245 undergraduate nursing students enrolled in a fundamental nursing course at one Hong Kong university were invited to participate. Following a 2-hour pre-clinical IVR simulation session, participants completed the 21-item v-NOTECHS scale, adapted from the revised NOTECHS scale and comprising five domains. Confirmatory factor analysis (CFA) with robust maximum likelihood estimation evaluated the hypothesized five-factor model. Internal consistency was assessed using Cronbach alpha and composite reliability (CR), convergent validity using standardized factor loadings and average variance extracted (AVE), and discriminant validity using the Fornell-Larcker criterion, heterotrait-monotrait (HTMT) ratios, and latent factor correlation confidence intervals. Second-order and unidimensional models were compared with the hypothesized model, and a sensitivity analysis excluded the weakest-performing item.
Results:
Of 270 questionnaires submitted, 236 were analyzed, representing 236 of 245 enrolled students (96.3%), with no missing data. The five-factor model fitted the data acceptably (χ²₁₇₉ = 303.3, χ²/df = 1.70, CFI = 0.946, TLI = 0.936, RMSEA = 0.073, 90% CI 0.058-0.087, SRMR = 0.045). Standardized loadings ranged from 0.527 to 0.889. Cronbach alpha (0.789-0.923), CR (0.795-0.925), and AVE (0.560-0.709) met established thresholds across all five domains. Discriminant validity was not supported. Latent intercorrelations ranged from 0.806 to 0.942, all 10 factor pairs violated the Fornell-Larcker criterion, and 8 of 10 HTMT ratios were at or above 0.85. A second-order model fitted no worse than the correlated five-factor model (Δχ² = 10.9, Δdf = 5, P=.053), whereas a unidimensional model was rejected (Δχ² = 77.6, Δdf = 10, P<.001). Between 89 and 136 of 236 participants (37.7%-57.6%) selected the maximum response option on each item.
Conclusions:
This study provides preliminary psychometric support for the v-NOTECHS in one cohort of Hong Kong undergraduate nursing students. The five domains were not statistically separable, and their covariation was accounted for by a single higher-order factor, so subscale scores should be interpreted as facets of a general self-appraisal rather than as independent indices. Obtained under conditions of restricted response variability, these findings support the v-NOTECHS as a context-bound measure of self-perceived NTS that is complementary to, rather than a replacement for, observer-based NOTECHS assessment. Further validation is required before broader application.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.