• Conference paper
  • AIME 2024
  • Lecture Notes in Computer Science, vol 14844
  • Peer reviewed

Mining Disease Progression Patterns for Advanced Disease Surveillance

CureMD Research, New York

Disease Mining

Abstract

In this paper, we present a smart disease surveillance system that reveals insights into disease trajectories indicating risks of subsequent diseases starting from the current health conditions, for individual patients or populations. Using a pattern mining algorithm, we extract disease trajectory patterns from temporally modeled encounters of 17 million patients in the medical knowledge graph and develop a disease surveillance system on 477,933 mined patterns of disease progression. The system predicts future disease trajectory of individual patients and facilitates in-depth exploration into disease mechanisms, root causes and future disease progression at a patient cohort level thereby enabling early interventions for complex diseases and promoting an evidence based precision medicine approach for healthcare providers.

Key findings

17MPatients’ encounters mined
477,933Progression patterns
2Levels: patient and cohort
  1. 1Surveillance that looks forward: the system shows disease trajectories that indicate the risk of subsequent diseases, starting from a patient's current health conditions, for individual patients or whole populations.
  2. 2Built on 17 million patients: their encounters are modeled in time order inside a medical knowledge graph.
  3. 3Patterns mined, not hand-coded: a pattern mining algorithm extracts disease trajectory patterns from those encounters, and the surveillance system runs on the 477,933 patterns of disease progression it found.
  4. 4Predicts the patient's next diagnoses: for an individual patient, the system predicts the future disease trajectory.
  5. 5Explains progression across a cohort: for a patient cohort, it supports in-depth exploration of disease mechanisms, root causes and future disease progression.
  6. 6Built for early intervention: the aim is earlier intervention in complex diseases and an evidence-based precision medicine approach for healthcare providers.

Why this matters

Most care responds to the diagnosis in front of the clinician. A trajectory view asks a different question: for patients with this history, what tends to come next? Answered from the time-ordered encounters of 17 million patients, it gives a provider a reason to look for the next likely condition before it presents, which is where early intervention in complex disease starts.

The same patterns serve two users. A clinician sees one patient's likely next diagnoses; a population health or research team explores root causes and progression across a cohort. The abstract reports the system's scale rather than its predictive accuracy; the knowledge graph model, the mining algorithm and a worked patient example are in the full paper.

Keywords

  • Disease Trajectories
  • Knowledge Graph
  • Pattern mining
  • Data Science

Authors and affiliations

Amna Basharat

Muddassar Farooq

Syed Hamail Hussain Zaidi

CureMD Research

80 Pine St 21st Floor, New York, NY, 10005, USA

Editors and affiliations

Joseph Finkelstein

University of Utah, Salt Lake City, UT, USA

Robert Moskovitch

Ben-Gurion University of the Negev, Beer Sheva, Israel

Enea Parimbelli

University of Pavia, Pavia, Italy

References

  1. 1.Aspland, E., Gartner, D., Harper, P.: Clinical pathway modelling: a literature review. Health Syst. 10(1), 1 to 23 (2021). doi:10.1080/20476965.2019.1652547
  2. 2.Hidalgo, C.A., Blumm, N., Barabási, A.L., Christakis, N.A.: A dynamic network approach for the study of human phenotypes. PLoS Comput. Biol. 5(4), e1000353 (2009). doi:10.1371/journal.pcbi.1000353
  3. 3.Jensen, A.B., et al.: Temporal disease trajectories condensed from population-wide registry data covering 6.2 million patients. Nature Commun. 5(1), 4022 (2014).
  4. 4.Murtagh, F.E., Murphy, E., Sheerin, N.S.: Illness trajectories: an important concept in the management of kidney failure (2008).

Paper copyright 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG.

Peer-reviewed publications

All publications

February 2024

Workshop paper

An Explainable AI Framework for Treatment Failure Model for Oncology Patients

Zaidi, S.H.H., Hashmat, B., Farooq, M. Explainable Artificial Intelligence and Process Mining Applications for Healthcare, Communications in Computer and Information Science, vol 2020, pp. 25 to 35. Springer. doi:10.1007/978-3-031-54303-6_3

June 2023

Conference paper

Boosted Random Forests for Predicting Treatment Failure of Chemotherapy Regimens

Shahid, M.U., Farooq, M. Artificial Intelligence in Medicine. AIME 2023, Lecture Notes in Computer Science, vol 13897, pp. 13 to 24. Springer. doi:10.1007/978-3-031-34344-5_2

June 2023

Journal abstract

Explainable AI and machine learning algorithms to predict treatment failures for patients with cancer

Farooq, M., Shahid, M.U. Journal of Clinical Oncology 41, 16_suppl, e13577. ASCO Annual Meeting 2023. doi:10.1200/JCO.2023.41.16_suppl.e13577

June 2023

Journal abstract

A smart clinical cohort selection system for clinical oncology research

Basharat, A., Farooq, M. Journal of Clinical Oncology 41, 16_suppl, e13613. ASCO Annual Meeting 2023. doi:10.1200/JCO.2023.41.16_suppl.e13613

x

Interested in CureMD? Let's talk.

Tell us about yourself & a CureMD Consultant will contact you shortly.

 chatbtn