Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 30, 2019
Date Accepted: Feb 7, 2020

The final, peer-reviewed published version of this preprint can be found here:

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development

Di Tosto G, McAlearney AS, Fareed N, Huerta T

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development

J Med Internet Res 2020;22(6):e16849

DOI: 10.2196/16849

PMID: 32530435

PMCID: 7320309

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Outpatient Portal Use and Patient Engagement as Measured by Log File Analysis

  • Gennaro Di Tosto; 
  • Ann Scheck McAlearney; 
  • Naleef Fareed; 
  • Timothy Huerta

ABSTRACT

Background:

Web-based outpatient portals help patients engage in the management of their health by allowing them to access their medical information, schedule appointments, track their medications and communicate with their physicians and care team members. Initial studies have shown that portal adoption positively affects health outcomes, but early studies typically relied on survey data. Using data from health portal applications, we conducted systematic assessments of patients’ use of an outpatient portal to examine how patients engage with the tool.

Objective:

We aimed to document the functionality of an outpatient portal in the context of outpatient care by mining portal usage data, and to provide insights into how patients use this tool.

Methods:

Using audit log files from the outpatient portal associated with the electronic health record (EHR) implemented at a large, multi-hospital academic medical center, we investigated the behavioral traces of a study population of 2,607 patients who used the portal between July 2015 and February 2019. Patient portal use was defined as having an active account and having accessed any portal function more than once during the study timeframe.

Results:

Through our analysis of audit logfile data of the number and type of user interactions, we developed a taxonomy of functions and actions, and computed analytic metrics including frequency and comprehensiveness of use. We additionally documented the computational steps required to diagnose artifactual data and arrive at valid usage metrics.

Conclusions:

In discussing the full methodological choices made in our analysis, we hope to promote the replicability of our study at other institutions and contribute to the establishment of best practices that can facilitate the adoption of behavioral metrics that enable measurement of patient engagement based on outpatient portal use.


 Citation

Please cite as:

Di Tosto G, McAlearney AS, Fareed N, Huerta T

Metrics for Outpatient Portal Use Based on Log File Analysis: Algorithm Development

J Med Internet Res 2020;22(6):e16849

DOI: 10.2196/16849

PMID: 32530435

PMCID: 7320309

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.