The Virtuous Circles of Clinical Information Systems: a Modern Utopia

 

 Permissions and Reprints

Summary

Context: Clinical information systems (CIS) are developed with the aim of improving both the efficiency and the quality of care.

Objective: This position paper is based on the hypothesis that such vision is partly a utopian view of the emerging eSociety.

Methods: Examples are drawn from 15 years of experience with the fully integrated Georges Pompidou University Hospital (HEGP) CIS and temporal data series extracted from the data warehouses of Assistance Publique - Hôpitaux de Paris (AP-HP) acute care hospitals which share the same administrative organization as HEGP. Three main virtuous circles are considered: user satisfaction vs. system use, system use vs. cost efficiency, and system use vs quality of care.

Results: In structural equation models (SEM), the positive bidirectional relationship between user satisfaction and use was only observed in the early HEGP CIS deployment phase (first four years) but disappeared in late post-adoption (≥8 years). From 2009 to 2013, financial efficiency of 20 AP-HP hospitals evaluated with stochastic frontier analysis (SFA) models diminished by 0.5% per year. The lower decrease of efficiency observed between the three hospitals equipped with a more mature CIS and the 17 other hospitals was of the same order of magnitude than the difference observed between pediatric and non-pediatric hospitals. Outcome quality benefits that would bring evidence to the system use vs. quality loop are unlikely to be obtained in a near future since they require integration with population-based outcome measures including mortality, morbidity, and quality of life that may not be easily available.

Conclusion: Barriers to making the transformation of the utopian part of the CIS virtuous circles happen should be overcome to actually benefit the emerging eSociety.

• References

• 1 Degoulet P. Success criteria for a clinical information system.. In: TIC Saude 2013/ ICT in Health 2013. Brazilian Internet Steering Committee; Sao Paulo: 2014. p. 235-42.
  Google Scholar
• 2 Degoulet P. Hospital Information Systems.. In: Venot A, Burgun A, Quantin C. (eds). Medical Informatics, e-Health.. Paris: Springer-Verlag; 2014. p. 289-313.
  Google Scholar
• 3 HIMSS Analytics 2015. http://www.himssanalytics.org/home/index.aspx.
  PubMed
• 4 ONC 2013 http://www.healthit.gov/providers-professionals/how-attain-meaningful-use.
  PubMed
• 5 Hillestad R, Bigelow J, Bower A, Girosi F, Meili R, Scoville R. et al. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs.. Health Aff (Millwood) 2005; 24 (Suppl. 05) 1103-17.
  CrossrefPubMedGoogle Scholar
• 6 Walker J, Pan E, Johnston D, Adler-Mistein J, Bates D, Middleton B. The value of health care information exchange and interoperability.. Health Aff (Millwood) 2005 Jan-Jun;Suppl Web Exclusives:W5-10-W5-18.
  PubMedGoogle Scholar
• 7 Chaudry B, Wang J, Wu S, Maglione M, Mojica W, Roth E. et al. Systematic review: Impact of health information technology on quality, efficiency, and costs of medical care.. Ann Intern Med 2006; 144 (Suppl. 10) 742-52.
  CrossrefPubMedGoogle Scholar
• 8 Meyer R, Degoulet P. Assessing the Capital Efficiency of Healthcare Information Technologies Investments: An Econometric Perspective: Yearb Med Inform. 2008: 114-27.
  PubMedGoogle Scholar
• 9 Payne T, Bates DW, Berner ES, Bernstam EV, Covvey HD, Frisse ME. et al. Healthcare information technology and economics.. J Am Med Inform Assoc 2013; 20: 212-217.
  CrossrefPubMedGoogle Scholar
• 10 Bassi J, Lau F. Measuring value for money: a scoping review on economic evaluation of health information systems.. J Am Med Inform Assoc 2013; 20 (Suppl. 02) 792-801.
  CrossrefPubMedGoogle Scholar
• 11 More T. De optimo rei publicae statu, deque nova insula Utopia “Of a republic’s best state and of the new island Utopia”.. Louvain: Thierry Martens; 1516
  Google Scholar
• 12 Degoulet P, Marin L, Lavril Le, Bozec C, Delbecke E, Meaux JJ. et al. The HEGP component-based clinical information system.. Int J Med Inform 2003; 69: 115-26.
  CrossrefPubMedGoogle Scholar
• 13 Ammenwerth E, Mansmann U, Iller C, Eichstadter R. Factors affecting and affected by user acceptance of computer-based nursing documentation: results of a two-year study.. J Am Med Inform Assoc 2003; 10: 69-84.
  CrossrefPubMedGoogle Scholar
• 14 Palm JM, Dart T, Dupuis I, Leneveut L, Degoulet P. Clinical information system post-adoption evaluation at the Georges Pompidou university hospital.. AMIA Annu Symp Proc 2010; 582-6.
  PubMedGoogle Scholar
• 15 Hadji B, Martin G, Dupuis I, Campoy E, Degoulet P. 14 Years longitudinal evaluation of clinical information systems acceptance.. Int J Med Inform 2016; 86: 20-9.
  CrossrefPubMedGoogle Scholar
• 16 Hadji B, Degoulet P. Information sytem end-user satisfaction and continuance intention: A unified modeling approach.. J Biomed Inform 2016; 61: 185-93.
  CrossrefPubMedGoogle Scholar
• 17 DeLone WH, McLean ER. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update.. Journal of Management Information Systems 2003; 19c (Suppl. 04) 9-30.
  PubMedGoogle Scholar
• 18 Petter S, McLean ER. A meta-analytic assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level.. Information & Management 2009; 46 (Suppl. 03) 159-66.
  CrossrefPubMedGoogle Scholar
• 19 Davis F. Perceived usefulness, perceived ease of use, and user acceptance of information technology.. MIS Quarterly. 1989; 13: 319-40.
  CrossrefPubMedGoogle Scholar
• 20 Lee YA, Kozar KA, Larsen KRT. The Technology Acceptance Model: Past, Present and Future.. Comm Assoc Inf Syst 2003; 12 (Suppl. 50) 752-80.
  PubMedGoogle Scholar
• 21 Venkatesh V, Morris M, Davis G. et al. User Acceptance of Information Technology: Toward a Unified View.. Manag Inf Syst Q 2003; 27: 425-78.
  CrossrefPubMedGoogle Scholar
• 22 Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model.. MIS Quarterly 2001; 25 (Suppl. 03) 351-70.
  CrossrefPubMedGoogle Scholar
• 23 Kline RB. Principles and practice of structural equation modeling.. Guilford Press; 2011
  Google Scholar
• 24 Sidorov J. It ain’t necessarily so: the electronic health record and the unlikely prospect of reducing health care costs.. Health Aff (Millwood) 2006; 25 (Suppl. 04) 1079-85.
  CrossrefPubMedGoogle Scholar
• 25 Riskin L, Koppel R, Riskin D. Re-examining health IT policy: what will it take to derive value from our investments?. J Am Med Inform Assoc 2015; 22: 459-64.
  PubMedGoogle Scholar
• 26 CMS 2016.. National expenditures 2014 highlights.. Available at https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/NationalHealthExpendData/Downloads/highlights.pdf [accessed January 5, 2016].
  PubMedGoogle Scholar
• 27 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems.. J Am Med Inform Assoc 2015; 22 (Suppl. 02) 465-71.
  CrossrefPubMedGoogle Scholar
• 28 Beard N, Elo K, Hitt LM, Housman MG, Mansfield G. Information technology and hospital performance: An econometric analysis of costs and quality.. PricewaterhouseCoopers; 2007 http://assets.wharton.upenn.edu/~housman/files/PwCWhitePaper.pdf.
  PubMedGoogle Scholar
• 29 Furukawa MF, Raghu TS, Shao BB. Electronic medical record and cost efficiency in hospital medical-surgical units.. Inquiry 2010; 20: 110-23.
  PubMedGoogle Scholar
• 30 Weiner JP, Kfuri T, Chan KC, Fowles JB. e-Iatro-genesis: the most critical unintended consequence of CPOE and other HIT.. J Am Med Inform Assoc 2007; 14: 387-88.
  CrossrefPubMedGoogle Scholar
• 31 Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE. et al. Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors.. JAMA 2005; 293 (Suppl. 10) 1197-203.
  CrossrefPubMedGoogle Scholar
• 32 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequence elated to computerized provider order entry.. J Am Med Inform Assoc 2007; 14 (Suppl. 04) 415-23.
  CrossrefPubMedGoogle Scholar
• 33 Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review.. J Am Med Inform Assoc 2005; 12 (Suppl. 05) 505-16.
  CrossrefPubMedGoogle Scholar
• 34 Meyer R, Degoulet P, Omnes L. Impact of Health Care Information Technology on Hospital Productivity Growth: a Survey in 17 Acute University Hospitals.. Stud Health Technol Inform 2007; 129 (Suppl. 01) 203-7.
  PubMedGoogle Scholar
• 35 Hadji B, Meyer R, Mellikeche S, Escalon S, Degoulet P. Assessing the relationships between hospital resources and activities: a systematic review.. J Med Syst 2014; 38-127.
  PubMedGoogle Scholar
• 36 Farrell MJ. The Measurement of Productive Efficiency.. J R Stat Soc Ser Gen 1957; 120: 253-90.
  PubMedGoogle Scholar
• 37 Aigner D, Lovell CAK, Schmidt P. Formulation and estimation of stochastic frontier production function models.. J Econom 1977; 6: 21-37.
  CrossrefPubMedGoogle Scholar
• 38 Rosko MD, Mutter RL. Stochastic frontier analysis of hospital inefficiency. A review of empirical issues and an assessment of robustness.. Med Care Res Rev 2008; 65 (Suppl. 02) 131-66.
  CrossrefPubMedGoogle Scholar
• 39 Meyer R, Degoulet P. Choosing the right amount of healthcare information technologies investments.. Int J Med Inform 2010; 79: 235-31.
  PubMedGoogle Scholar
• 40 Kauskal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety. A systematic review.. Arch Intern Med 2003; 163: 1409-16.
  CrossrefPubMedGoogle Scholar
• 41 Garg AX, Adhikari NKJ, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J. et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcome. A systematic review.. JAMA 2005; 293 (Suppl. 10) 1223-38.
  CrossrefPubMedGoogle Scholar
• 42 Murphy SN, Weber G, Mendis M, Chueh HC, Churchill S, Glaser JP. et al. Serving the Enterprise and beyond with Informatics for Integrating Biology and the Bedside (i2b2).. J Am Med Inform Assoc 2010; 17 (Suppl. 02) 124-30.
  CrossrefPubMedGoogle Scholar
• 43 Zapletal E, Rodon E, Grabar N, Degoulet P. Methodology of integration of a clinical data warehouse with a clinical information system.. Stud Health Technol Inform 2010; 160 (Suppl. 01) 193-7.
  PubMedGoogle Scholar
• 44 Kho AN, Rasmussen LV, Connolly JJ, Peissig PL, Starren J, Hakonarson H. et al. Pratical challenges in integrating genomic data into the electronic health record.. Genet Med 2013; 15 (Suppl. 10) 772-8.
  CrossrefPubMedGoogle Scholar
• 45 Canuel V, Rance B, Avillach P, Degoulet P, Burgun A. Translational Research Platforms Integrating Clinical and Omics Data: a Review of Publicly Available Solutions.. Brief Bioinform 2015; 16 (Suppl. 02) 280-90.
  CrossrefPubMedGoogle Scholar
• 46 Rance B, Canuel V, Countouris H, Laurent-Puig P, Burgun A. Integrating Heterogeneous Biomedical Data for Cancer Research: the CARPEM infrastructure.. Appl Clin Inform 2016; 7 (Suppl. 02) 260-74.
  Article in Thieme ConnectPubMedGoogle Scholar
• 47 Caruba T, Colombet I, Gillaizeau F, Bruni V, Korb V, Prognon P. et al. Chronology of prescribing error during the hospital stay and prediction of pharmacist’s alerts overriding: a prospective analysis.. BMC Health Serv Res 2010; Jan 12 10: 13.
  CrossrefPubMedGoogle Scholar
• 48 Berdot S, Sabatier B, Gillaizeau F, Caruba T, Durieux P. Evaluation of drug administration errors in a teaching hospital.. BMC Health Serv Res 2012; 12: 60.
  CrossrefPubMedGoogle Scholar
• 49 Sellier E, Colombet I, Sabatier B, Breton G, Nies J, Zapletal E. et al. Effect of alerts for drug dosage adjustments in inpatients with renal insufficiency.. J Am Med Inform Assoc 2009; 16: 203-10.
  CrossrefPubMedGoogle Scholar
• 50 Estellat C, Colombet I, Vautier S, Huault-Quentel Durieux P, Sabatier B. Impact of pharmacy validation in a computerized physician order entry context.. Int J Qual Health Care 2007; 9 (Suppl. 05) 317-25.
  PubMedGoogle Scholar
• 51 Girardeau Y, Trivin C, Durieux P, Le Beller C, Louet Agnes LL. et al. Detection of Drug-Drug Interactions Inducing Acute Kidney Injury by Electronic Health Records Mining.. Drug Saf 2015; 38 (Suppl. 09) 799-809.
  CrossrefPubMedGoogle Scholar
• 52 Boussadi A, Caruba T, Zapletal E, Sabatier B, Durieux P, Degoulet P. A clinical data warehouse-based process for refining medication orders alerts.. J Am Med Inform Assoc 2012; 19 (Suppl. 05) 782-5.
  CrossrefPubMedGoogle Scholar
• 53 McDowell I. Measuring Health.. 3rd Edition. New York: Oxford University Press; 2006
  Google Scholar
• 54 Welch WP, Bazarko D, Ritten K, Burgess Y, Harmon R, Sandy LG. Electronic health records in four community physician practice: impact on quality and cost of care.. J Am Med Inform Assoc 2007; 14: 320-8.
  CrossrefPubMedGoogle Scholar
• 55 Zhou L, Soran C, Jenter CA, Volk LA, Orav EJ, Bates DW. et al. The relationship between electronic record use and quality of care over time.. J Am Med Inform Assoc 2009; 16 (Suppl. 04) 457-64.
  CrossrefPubMedGoogle Scholar
• 56 Ancker JA, Kern LM, Edwards A. et al. Association between healthcare quality and use of electronic health record functions in ambulatory care.. J Am Med Inform Assoc 2015; 22: 864-71.
  CrossrefPubMedGoogle Scholar
• 57 Mekhjian Kumar RR, Kuehn L, Bentley TD, Teater P, Thomas A. et al. Immediate benefits realized following implementation of physician order entry at an academic medical center.. J Am Med Inform Assoc 2002; 9: 529-39.
  CrossrefPubMedGoogle Scholar
• 58 Kuperman GJ, Gibson RF. Computer physician order entry: benefits, costs, and issues.. Ann Intern Med 2003; 139: 31-9.
  CrossrefPubMedGoogle Scholar
• 59 Wright A, Feblowitz J, Samal L, McCoy B, Sittig DF. The Medicare electronic health record incentive program: provider performance on core and menu measures.. Health Serv Res 2014; 49 (Suppl. 02) 325-46.
  CrossrefPubMedGoogle Scholar
• 60 Roski J, McClellan M. Measuring health care performance now, not tomorrow; essential steps to support effective health reform.. Health Aff (Millwood) 2011; 30: 682-9.
  CrossrefPubMedGoogle Scholar
• 61 Garrido T, Kumar S, Lekas J, Lindberg M, Kadiyala D, Whippy A. et al. e-Measures: insight into the challenges and opportunities of automating publicly reported quality measures.. J Am Med Inform Assoc 2014; 21: 181-4.
  CrossrefPubMedGoogle Scholar