skip to main content
10.1145/2623330.2623754acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Unsupervised learning of disease progression models

Published:24 August 2014Publication History

ABSTRACT

Chronic diseases, such as Alzheimer's Disease, Diabetes, and Chronic Obstructive Pulmonary Disease, usually progress slowly over a long period of time, causing increasing burden to the patients, their families, and the healthcare system. A better understanding of their progression is instrumental in early diagnosis and personalized care. Modeling disease progression based on real-world evidence is a very challenging task due to the incompleteness and irregularity of the observations, as well as the heterogeneity of the patient conditions. In this paper, we propose a probabilistic disease progression model that address these challenges. As compared to existing disease progression models, the advantage of our model is three-fold: 1) it learns a continuous-time progression model from discrete-time observations with non-equal intervals; 2) it learns the full progression trajectory from a set of incomplete records that only cover short segments of the progression; 3) it learns a compact set of medical concepts as the bridge between the hidden progression process and the observed medical evidence, which are usually extremely sparse and noisy. We demonstrate the capabilities of our model by applying it to a real-world COPD patient cohort and deriving some interesting clinical insights.

Skip Supplemental Material Section

Supplemental Material

p85-sidebyside.mp4

mp4

317.6 MB

References

  1. F. Baty, P. M. Putora, B. Isenring, T. Blum, and M. Brutsche. Comorbidities and burden of COPD: a population based case-control study. PLoS ONE, 8(5):e63285, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  2. M. Cohen, A. Grossman, D. Morabito, M. M. Knudson, A. Butte, and G. Manley. Identification of complex metabolic states in critically injured patients using bioinformatic cluster analysis. Critical Care, 14(1):R10, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  3. W. De Winter, J. DeJongh, T. Post, B. Ploeger, R. Urquhart, I. Moules, D. Eckland, and M. Danhof. A mechanism-based disease progression model for comparison of long-term effects of pioglitazone, metformin and gliclazide on disease processes underlying type 2 diabetes mellitus. Journal of pharmacokinetics and pharmacodynamics, 33(3):313--343, 2006.Google ScholarGoogle Scholar
  4. M. Decramer, W. Janssens, and M. Miravitlles. Chronic obstructive pulmonary disease. Lancet, 379(9823):1341--1351, Apr 2012.Google ScholarGoogle ScholarCross RefCross Ref
  5. K. Exarchos, T. Exarchos, C. Bourantas, M. Papafaklis, K. Naka, L. Michalis, O. Parodi, and D. Fotiadis. Prediction of coronary atherosclerosis progression using dynamic bayesian networks. In EMBC, pages 3889--3892, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  6. G. I. for Chronic Obstructive Lung Disease. Global strategy for the diagnosis, management, and prevention of copd, January 2014.Google ScholarGoogle Scholar
  7. Y. Halpern and D. Sontag. Unsupervised learning of noisy-or bayesian networks. In UAI, pages 272--281, 2013.Google ScholarGoogle Scholar
  8. K. Ito, S. Ahadieh, B. Corrigan, J. French, T. Fullerton, and T. Tensfeldt. Disease progression meta-analysis model in alzheimer's disease. Alzheimer's & Dementia, 6(1):39--53, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  9. C. H. Jackson, L. D. Sharples, S. G. Thompson, S. W. Duffy, and E. Couto. Multistate markov models for disease progression with classification error. Journal of the Royal Statistical Society: Series D (The Statistician), 52(2):193--209, 2003.Google ScholarGoogle Scholar
  10. P. Metzner, I. Horenko, and C. Schütte. Generator estimation of markov jump processes based on incomplete observations nonequidistant in time. Physical Review E, 76(6):066702, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  11. D. Mould. Models for disease progression: new approaches and uses. Clinical Pharmacology & Therapeutics, 92(1):125--131, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  12. T. M. Post, J. I. Freijer, J. DeJongh, and M. Danhof. Disease system analysis: basic disease progression models in degenerative disease. Pharmaceutical research, 22(7):1038--1049, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  13. L. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257--286, 1989.Google ScholarGoogle ScholarCross RefCross Ref
  14. M. A. Shwe, B. Middleton, D. Heckerman, M. Henrion, E. Horvitz, H. Lehmann, and G. Cooper. Probabilistic diagnosis using a reformulation of the internist-1/qmr knowledge base. Meth. Inform. Med, 30:241--255, 1991.Google ScholarGoogle ScholarCross RefCross Ref
  15. R. Sukkar, E. Katz, Y. Zhang, D. Raunig, and B. T. Wyman. Disease progression modeling using hidden markov models. In EMBC, pages 2845--2848. IEEE, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  16. J. Yang, J. J. McAuley, J. Leskovec, P. LePendu, and N. Shah. Finding progression stages in time-evolving event sequences. In WWW, pages 783--794, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. Zhou, J. Liu, V. A. Narayan, and J. Ye. Modeling disease progression via fused sparse group lasso. In KDD, pages 1095--1103. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. J. Zhou, J. Liu, V. A. Narayan, and J. Ye. Modeling disease progression via multi-task learning. NeuroImage, 78(0):233--248, 2013.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Unsupervised learning of disease progression models

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      KDD '14: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining
      August 2014
      2028 pages
      ISBN:9781450329569
      DOI:10.1145/2623330

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 24 August 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      KDD '14 Paper Acceptance Rate151of1,036submissions,15%Overall Acceptance Rate1,133of8,635submissions,13%

      Upcoming Conference

      KDD '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader