Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: May 13, 2025
Date Accepted: Oct 1, 2025

The final, peer-reviewed published version of this preprint can be found here:

Evaluating the Accuracy of the Frysian Questionnaire for Differentiation of Musculoskeletal Complaints for Triage of Musculoskeletal Diseases: Algorithm Development and Validation Study

Maarseveen TD, Reimann F, al Hasan A, Schilder A, Zhang D, Wink F, Hendriks L, Knevel R, Bos R

Evaluating the Accuracy of the Frysian Questionnaire for Differentiation of Musculoskeletal Complaints for Triage of Musculoskeletal Diseases: Algorithm Development and Validation Study

JMIR Med Inform 2025;13:e77345

DOI: 10.2196/77345

PMID: 41248315

PMCID: 12622856

Evaluating FRYQ Questionnaire Accuracy for Triage of Musculoskeletal Diseases: Retrospective Machine Learning study

  • Tjardo DaniĆ«l Maarseveen; 
  • Floor Reimann; 
  • Ahmed al Hasan; 
  • Annemarie Schilder; 
  • Dan Zhang; 
  • Freke Wink; 
  • Lidy Hendriks; 
  • Rachel Knevel; 
  • Reinhard Bos

ABSTRACT

Background:

Inflammatory Rheumatic Diseases (IRDs) affect 5% of the general population, while 35% of the population experiences Musculoskeletal Complaints (MSCs). IRDs cause early disability, reduced life-expectancy and considerable healthcare costs. Early diagnosis is essential to prevent long-term damage. Similarly important is the early identification of patients with MSCs without IRDs to prevent unnecessary healthcare expenses. Of the population referred to the rheumatologist, 60% have non-inflammatory MSCs while only 20% of patients with an IRD see a rheumatologist within three months of symptom onset. The need for digital predictive (triage) tools for Rheumatic and Musculoskeletal Diseases led to the development of the Frysian Questionnaire for differentiation of MSK complaints (FRYQ).

Objective:

To assess if FRYQ questionnaire can distinguish inflammatory rheumatic disease (IRD) from non-IRDs in general, and Rheumatoid arthritis and Fibromyalgia specifically, in newly referred patients.

Methods:

The FRYQ is an 87-item tool (20 open, 67 closed-ended questions) used to triage new rheumatology patients at Frisius Medical Center in the Netherlands. We analyzed data from two sources: Dataset A with 728 outpatient clinic patients and Dataset B with 373 patients from the JPAST study. We built a classifier using eXtreme Gradient Boosting to distinguish inflammatory from non-inflammatory conditions based on closed-ended questions. Using Elastic Net regularization optimized with Bayesian techniques through 1000 iterations, we identified the most informative questions. Data was split 80/20 for model construction and performance estimation. We evaluated classification using ROC-curve analysis and assessed feature importance through SHAP analysis. To test generalizability, we replicated our analysis on Dataset B. Finally, we examined whether the questions of the FRYQ could be used to identify specific conditions beyond the general categories of IRD and non-IRD, specifically for detecting Fibromyalgia and Rheumatoid arthritis.

Results:

Feature selection reduced the questionnaire from 67 to 28 items while maintaining discriminative power. After initial development, the model showed stable performance when applied to the external validation cohort, achieving an AUC-ROC of 0.72 (95% CI: 0.67-0.78) for distinguishing inflammatory from non-inflammatory conditions. A clinical threshold of 0.30 provided a sensitivity of 71% and specificity of 56% in the external validation. The FRYQ demonstrated even stronger performance in identifying fibromyalgia specifically (AUC-ROC 0.78) and moderate ability to detect rheumatoid arthritis (AUC-ROC 0.74) in the external validation. Key discriminating features included symptom duration, pain response to movement, anti-inflammatory medication effectiveness, and presence of specific comorbidities.

Conclusions:

The FRYQ questionnaire effectively distinguishes inflammatory from non-inflammatory rheumatic conditions prior to specialist consultation and shows particular strength in identifying fibromyalgia. This tool could potentially improve rheumatology triage, reducing delays for patients requiring urgent specialist care while directing others to more appropriate resources. Prospective studies are needed to determine its impact on clinical outcomes and healthcare efficiency.


 Citation

Please cite as:

Maarseveen TD, Reimann F, al Hasan A, Schilder A, Zhang D, Wink F, Hendriks L, Knevel R, Bos R

Evaluating the Accuracy of the Frysian Questionnaire for Differentiation of Musculoskeletal Complaints for Triage of Musculoskeletal Diseases: Algorithm Development and Validation Study

JMIR Med Inform 2025;13:e77345

DOI: 10.2196/77345

PMID: 41248315

PMCID: 12622856

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.