Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Macdonald T, Dinnes J, Maniatopoulos G, Taylor-Philips S, Shinkins B, Hogg J, Dunbar K, Solebo (L, Sutton H, Attwood J, Pogose M, Given-Wilson R, Greaves F, Macrae C, Pearson R, Bamford D, Tufail A, Liu X, Denniston AK
Target Product Profile for a Machine Learning–Automated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Study
Protocol: Target Product Profile for a Machine Learning Automated Retinal Imaging Analysis Software for use in English Diabetic Eye Screening: a Mixed Methods Study
Trystan Macdonald;
Jac Dinnes;
Gregory Maniatopoulos;
Sian Taylor-Philips;
Bethany Shinkins;
Jeffry Hogg;
Kevin Dunbar;
(Ameenat) Lola Solebo;
Hannah Sutton;
John Attwood;
Michael Pogose;
Rosalind Given-Wilson;
Felix Greaves;
Carl Macrae;
Russell Pearson;
Daniel Bamford;
Adnan Tufail;
Xiaoxuan Liu;
Alastair K Denniston
ABSTRACT
Background:
Diabetic eye screening (DES) is a promising use case for machine learning technologies which may improve clinical, economic, and service outcomes. All these outcomes could however be negatively impacted by the implementation of machine learning technologies if these are not developed, evaluated and implemented appropriately. Target product profiles (TPPs) summarise the clinical, economic and technical characteristics necessary for successful product implementation, aiming to produce technologies that are of utility and value to patients and end-users.
Objective:
Produce a TPP for a machine learning-enabled automated retinal imaging analysis software (ML-ARIAS) for use in DES in England, to guide product development, evaluation and deployment.
Methods:
This work will consist of three phases. Phase 1 will establish what characteristics should be addressed in an ML-ARIAS TPP. A list of candidate characteristics for inclusion in the TPP will be generated from the following sources: an overview of systematic reviews of diagnostic test TPPs; a systematic review of digital health/AI TPPs; and the National Institute for Health and Care Excellence’s Evidence Standards Framework for Digital Health Technologies. This list of candidate characteristics (e.g. ‘Target Population’) will be mapped against the technology and use case and those not relevant excluded following review by a multistakeholder group. Specifications for these characteristics (e.g. people with diabetes >12 years old) will be drafted following a series of semi-structured interviews with stakeholders in Phase 2. Phase 3 will consist of a multi-stakeholder Delphi consensus study consisting of two online rounds and an in-person consensus meeting to finalise the TPP.
Results:
Phase 1 is currently underway and expected to be completed by November 2023, Phase 2 February 2024 and Phase 3 July 2024 with publication of the final TPP.
Conclusions:
The development of a TPP for an ML-ARIAS for use in UK DES with multi-stakeholder involvement will help developers produce tools that serve the needs of patients, healthcare systems and their staff. The TPP development process will also provide methods and a template for others to produce similar documents for AI diagnostic tests in other disease areas. Clinical Trial: Submitted to JMIR Preprints
Citation
Please cite as:
Macdonald T, Dinnes J, Maniatopoulos G, Taylor-Philips S, Shinkins B, Hogg J, Dunbar K, Solebo (L, Sutton H, Attwood J, Pogose M, Given-Wilson R, Greaves F, Macrae C, Pearson R, Bamford D, Tufail A, Liu X, Denniston AK
Target Product Profile for a Machine Learning–Automated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Study