Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Previously submitted to: Journal of Medical Internet Research (no longer under consideration since Nov 27, 2024)

Date Submitted: Jun 2, 2023

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

The EnACT framework: Achieving meaningful patient and public involvement in digital innovation, implementation and evaluation using a modified Delphi methodology

  • Rebecca Louise Baines; 
  • Hannah Bradwell; 
  • Sebastian Stevens; 
  • Samantha Prime; 
  • Katie Edwards; 
  • Jennifer Catherine Camaradou; 
  • Miles Sibley; 
  • Arunangsu Chatterjee

ABSTRACT

Background:

Defined as a public priority, digital health is considered essential for creating sustainable and equitable health care systems on an international scale.

Objective:

However, while widely acknowledged as beneficial, recent research shows that patients and the public are rarely involved in the design, implementation, and evaluation of digital health technologies. Furthermore, stakeholder consensus on the principles that underpin meaningful involvement in digital health specifically is not yet readily available.

Methods:

This research draws on a four-phase methodology: i) extensive systematic review of peer-reviewed literature; ii) inductive thematic analysis of review findings; iii) co-design workshop to identify best practice principles; and iv) consensus testing of identified principles amongst key stakeholders using a modified Delphi methodology. This manuscript reports on phases three and four only. The systematic review methodology and findings are reported elsewhere.

Results:

Thirteen principles categorised into four headings (i) engage, ii) acknowledge, reward and value, iii) communicate and iv) trust and transparency) termed the EnACT framework were co-designed by workshop participants. Nine principles achieved ‘essential’ consensus (>75% agreement) status by 14 expert respondents. Principles with the highest level of consensus included: providing clear assurances and information about patient confidentiality, data privacy and security (100%) and creating a space where people feel safe and supported in sharing their digital innovation ideas and suggestions (100%). Providing clear assurances and information about patient confidentiality, data privacy and security was repeatedly described as essential and totally non-negotiable by participants. Principles that failed to achieve consensus included: co-designing engaging activities and evaluation methods (50% essential vs 50% desirable); building in sufficient time and resources (57% vs 43%); developing a feedback loop (71% vs 29%) and advertising the potential benefits of being involved (43% vs 57%). One prevailing justification for categorising principles as desirable was a perceived disparity between ‘preferable’ or ‘desirable’ best practise, and the ‘realities’ of implementing such principles. With the exception of one principle categorised as irrelevant by one innovator, no other principles were considered irrelevant. No alternative principles were suggested by expert respondents.

Conclusions:

This research advances existing knowledge and understanding by providing previously unavailable consensus on the principles that underpin meaningful Patient Public Involvement in digital health innovation, implementation and evaluation. Expert respondents suggest such principles should be aspired to wherever possible to ensure involvement optimisation. However, stakeholders need to be sufficiently supported and operating within adequately resourced and receptive environments if high quality involvement is to become a reality. Failure to do so may mean patient and public involvement in digital health continues to remain a rarely practised, or tokenistic exercise that jeopardises innovation relevance, value, and utility, ultimately endangering the desired vision of digital health creating sustainable and equitable health care systems on an international scale.


 Citation

Please cite as:

Baines RL, Bradwell H, Stevens S, Prime S, Edwards K, Camaradou JC, Sibley M, Chatterjee A

The EnACT framework: Achieving meaningful patient and public involvement in digital innovation, implementation and evaluation using a modified Delphi methodology

JMIR Preprints. 02/06/2023:49468

DOI: 10.2196/preprints.49468

URL: https://preprints.jmir.org/preprint/49468

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.