Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Sep 20, 2021
Date Accepted: May 26, 2022
Date Submitted to PubMed: May 26, 2022

The final, peer-reviewed published version of this preprint can be found here:

Evaluation of Normalization After Implementation of the Digital Dutch Obstetric Telephone Triage System: Mixed Methods Study With a Questionnaire Survey and Focus Group Discussion

Engeltjes B, Rosman A, Scheele F, Vis C, Wouters E

Evaluation of Normalization After Implementation of the Digital Dutch Obstetric Telephone Triage System: Mixed Methods Study With a Questionnaire Survey and Focus Group Discussion

JMIR Form Res 2022;6(6):e33709

DOI: 10.2196/33709

PMID: 35616176

PMCID: 9250067

Evaluation of normalization after implementation of the digital Dutch Obstetric Telephone Triage System: Mixed methods design with questionnaire and focus group discussion.

  • Bernice Engeltjes; 
  • Ageeth Rosman; 
  • Fedde Scheele; 
  • Christiaan Vis; 
  • Eveline Wouters

ABSTRACT

Background:

The Dutch Obstetric Telephone Triage System (DOTTS) was developed to improve the quality of acute obstetric care. To achieve optimal effect, DOTTS should be adopted in the daily care process by triage staff. The outcome of implementation was evaluated in nine hospitals.

Objective:

The aim of this study was to gain insight into the degree of implementation (normalization) and to evaluate which lessons can be learned from the implementation of DOTTS that can help optimize current and new implementations.

Methods:

An evaluation study with a mixed methods design was performed. All triage staff in hospitals who implemented DOTTS before 1 September 2019 were invited to complete the Normalization MeAsure Development (NoMAD) questionnaire between December 2019 and July 2020. The questionnaire is based on the Normalization Process Theory. This self-report questionnaire gives insight into the work people do in order to integrate and embed new practice in routine care. Normalization Process Theory is based on four constructs: coherence, cognitive participation, collective action and reflexive monitoring. Within the questionnaire each construct is represented by 4-7 questions. Questions could be scored on a 5-point Likert scale. Descriptive statistics were used for analysis of questionnaire scores. Subsequently, analysis of questionnaires were discussed during a focus group. Template analysis following the four constructs of NPT was used for analyzing the results of the focus group.

Results:

In total 173 triage-staff members completed the NoMAD questionnaire. Ninety percent of the participants had used DOTTS for over six months. The digital application was used as much as possible or always by 79.1% of the participants (n=137). The overall Normalization Process Score was 3.77 (SD=0.36). The constructs Coherence and Cognitive Participation scored 4.01 (SD=0.47) and 4.05 (SD=0.45) respectively. Collective Action scored 3.5 (SD=0.45) and Reflexive Monitoring scored 3.72 (SD=0.47). Analysis of the focus group discussion showed that the added value of DOTTS was seen as a quality improvement for pregnant women. Dedication of the complete multidisciplinary implementation team, with specific support from the medical staff, as well as proper use by all disciplines involved in the triage is important for facilitating normalization. Participants appreciated training and evaluation and indicated a need for ongoing training and evaluation in relation to goal achievement.

Conclusions:

The DOTTS has been integrated into normal care in daily practice. Evaluation by NoMAD-questionnaires gave a positive overall score. These results are in line or, in some aspects better, when compared to other evaluation studies. Key factors in the normalization process of the DOTTS in obstetric triage are the shared added value for stakeholders, the dedication of the complete multidisciplinary implementation team and implementation plans that are tailor made in the practical context of the hospital.


 Citation

Please cite as:

Engeltjes B, Rosman A, Scheele F, Vis C, Wouters E

Evaluation of Normalization After Implementation of the Digital Dutch Obstetric Telephone Triage System: Mixed Methods Study With a Questionnaire Survey and Focus Group Discussion

JMIR Form Res 2022;6(6):e33709

DOI: 10.2196/33709

PMID: 35616176

PMCID: 9250067

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.