JMIR Publications

ABSTRACT

Background:

Primary care research networks can generate important information in the setting where most patients are seen and treated. However, this requires a suitable information technology infrastructure (ITI), which the North Rhine-Westphalian General Practice Research Network (NRW-GPRN) is looking to implement.

Objective:

This mixed-methods research study aims to evaluate (Study 1) requirements for an ITI and (Study 2) the usability of an IT solution already available on the market, the FallAkte Plus (FA+) system for the NRW-GPRN, which comprises eight primary care university institutes of Germany’s largest state.

Methods:

Study 1: A survey was conducted among researchers from the institutes to identify the requirements for a suitable information technology infrastructure. The questionnaire consisted of standardized questions with open-ended responses. Study 2: A mixed-method approach combining a think-aloud approach and a quantitative survey was employed to evaluate the usability and acceptance of the FA+ system among three user groups: researchers, general practitioners, and practice assistants. Respondents were asked to assess the usability with the validated System Usability Scale (SUS) and to test a short questionnaire on vaccination management through FA+.

Results:

Study 1: Five out of eight institutes participated in the requirements survey. A total of 32 user requirements related primarily to study management were identified, including data entry, data storage, and user access management. Study 2: 36 participants (24 researchers and 12 general practitioners/practice assistants) were surveyed in the mixed-methods study of an already existing IT solution. The tutorial video and handouts explaining how to use the FA+ system were well received. Researchers, unlike practice personnel, were concerned about data security and data protection regarding the system’s emergency feature, which enables access to all patient data. The median overall SUS rating was 60; whereby practice personnel (M = 82) gave higher ratings than researchers (M = 44). Users appreciated the option to integrate data from practices and other healthcare facilities. However, they voted against use of the FallAkte Plus system due to a lack of support for various study formats.

Conclusions:

Usability assessments vary markedly by professional group and role. In its current stage of development, the FallAkte Plus system does not fully meet the requirements for a suitable ITI. Improvements in user interface, performance, interoperability, security, and advanced features are necessary to make it more effective and user-friendly. Collaborating with end users and incorporating their feedback is crucial for the successful development of any practice network research ITI.