Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Jun 29, 2022
Date Accepted: Dec 29, 2022

The final, peer-reviewed published version of this preprint can be found here:

Multiple Automated Health Literacy Assessments of Written Health Information: Development of the SHeLL (Sydney Health Literacy Lab) Health Literacy Editor v1

Ayre J, Bonner C, Muscat DM, Dunn AG, Harrison E, Dalmazzo J, Mouwad D, Aslani P, Shepherd H, McCaffery KJ

Multiple Automated Health Literacy Assessments of Written Health Information: Development of the SHeLL (Sydney Health Literacy Lab) Health Literacy Editor v1

JMIR Form Res 2023;7:e40645

DOI: 10.2196/40645

PMID: 36787164

PMCID: 9975914

Multiple automated health literacy assessments of written health information: Development of the Sydney Health Literacy Lab (SHeLL) Health Literacy Editor v1

  • Julie Ayre; 
  • Carissa Bonner; 
  • Danielle M Muscat; 
  • Adam G Dunn; 
  • Eliza Harrison; 
  • Jason Dalmazzo; 
  • Dana Mouwad; 
  • Parisa Aslani; 
  • Heather Shepherd; 
  • Kirsten J McCaffery

ABSTRACT

Background:

Producing health information that people can easily understand is challenging and time-consuming. Existing guidance is often subjective and lacks specificity. This paper outlines development of the Sydney Health Literacy Lab (SHeLL) Health Literacy Editor, an automated tool to facilitate implementation of health literacy guidelines for the production of easy to read written health information.

Objective:

The SHeLL Health Literacy Editor aimed to assist Australian health information providers to develop health education materials for patients or community members (herein referred to as ‘consumers’) that adhere to health literacy guidelines to improve the quality, safety, and reading ease of written health information.

Methods:

Existing health literacy and relevant writing guidelines were collated. Items amenable to programmable automated assessment were incorporated into the Editor. A set of natural language processing methods were also adapted for use in the SHeLL editor.

Results:

The Editor comprises six assessments: readability, complex language, passive voice, text structure, lexical density/diversity, and person-centred language. These are presented as global scores, with additional, more specific feedback flagged in the text itself. Feedback is provided in real-time such that users can iteratively revise and improve the text. The design also includes a ‘text preparation’ mode, a hierarchy of assessments to help prioritise those that are most important, and a function that exports the analysis and revised text.

Conclusions:

The SHeLL Health Literacy Editor is an innovative new tool to improve the quality and safety of written health information. It provides objective, immediate feedback on a range of factors, complementing readability with other, less widely used but important objective assessments such as complex and person-centred language. This is a scalable intervention to support the uptake of health literacy guidelines by health services and providers of health information. Clinical Trial: N/A


 Citation

Please cite as:

Ayre J, Bonner C, Muscat DM, Dunn AG, Harrison E, Dalmazzo J, Mouwad D, Aslani P, Shepherd H, McCaffery KJ

Multiple Automated Health Literacy Assessments of Written Health Information: Development of the SHeLL (Sydney Health Literacy Lab) Health Literacy Editor v1

JMIR Form Res 2023;7:e40645

DOI: 10.2196/40645

PMID: 36787164

PMCID: 9975914

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.