JMIR Publications

ABSTRACT

Prognosis, diagnosis and treatment of many genetic disorders and familial diseases significantly improves if family history of the patient is known. Such information is often written in free-text of clinical notes. Our aim is to develop automated methods that enable access to this data through natural language processing. In particular, we use information extraction using transformers for extracting disease mentions from notes. Our experiments show that a combination of domain-adaptive pretraining together with intermediate-task pretraining method achieves a F1 Score of 81.63% for extraction of diseases and family members from notes when tested on a public shared task dataset by National NLP Clinical Challenges. In comparison, the 2019 n2c2/OHNLP Shared-Task the median F1 score of all the 17 participating teams is 76.59%.