Abstract
Background
Pay-for-performance (P4P) intents to stimulate both more effective and more efficient health care delivery. To date, evidence on whether P4P itself is an efficient method has not been systematically analyzed.
Objective
To identify and analyze the existing literature regarding economic evaluation of P4P.
Data sources
English, German, Spanish, and Turkish language literature were searched in the following databases: Business Source Complete, the Cochrane Library, Econlit, ISI web of knowledge, Medline (via PubMed), and PsycInfo (January 2000–April 2010).
Study selection
Articles published in peer-reviewed journals and describing economic evaluations of P4P initiatives. Full economic evaluations, considering costs and consequences of the P4P intervention simultaneously, were the prime focus. Additionally, comparative partial evaluations were included if costs were described and the study allows for an assessment of consequences. Both experimental and observational studies were considered.
Results
In total, nine studies could be identified. Three studies could be regarded as full economic evaluations, and six studies were classified as partial economic evaluations. Based on the full economic evaluations, P4P efficiency could not be demonstrated. Partial economic evaluations showed mixed results, but several flaws limit their significance. Ranges of costs and consequences were typically narrow, and programs differed considerably in design. Methodological quality assessment showed scores between 32% and 65%.
Conclusion
The results show that evidence on the efficiency of P4P is scarce and inconclusive. P4P efficiency could not be demonstrated. The small number and variability of included studies limit the strength of our conclusions. More research addressing P4P efficiency is needed.
Similar content being viewed by others
References
Parke, D.W.: Impact of a pay-for-performance intervention: financial analysis of a pilot program implementation and implications for ophthalmology (an American Ophthalmological Society thesis). Trans. Am. Ophthal. Soc. 105, 448–460 (2007)
Kizer, K.W.: Establishing health care performance standards in an era of consumerism. J. Am. Med. Assoc. 286, 1213–1217 (2001)
Institute of Medicine: Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC (2001)
Casalino, L.P.: Markets and medicine–barriers to creating a “business case for quality”. Perspect. Biol. Med. 46, 38–51 (2003)
McGlynn, E.A., Asch, S.M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., Kerr, E.A.: The quality of health care delivered to adults in the United States. N. Engl. J. Med. 348, 2635–2645 (2003)
Endsley, S., Kirkegaard, M., Baker, G., Murcko, A.C.: Getting rewards for your results: pay-for-performance programs. Fam. Pract. Manag. 11, 45–50 (2004)
Sorian, R.: Measuring, Reporting, and Rewarding Performance in Health Care. The Commonwealth Fund (2006)
Wilson, J.F.: Lessons for health care could be found abroad. Ann. Intern. Med. 146, 473–476 (2007)
Rowe, J.W.: Pay-for-performance and accountability: related themes in improving health care. Ann. Intern. Med. 145, 695–699 (2006)
Rosenthal, M.B.: Beyond pay for performance—emerging models of provider-payment reform. N. Engl. J. Med. 359, 1197–1200 (2008)
Fung, C.H., Lim, Y., Mattke, S., Damberg, C., Shekelle, P.G.: Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann. Intern. Med. 148, 111–123 (2008)
Rosenthal, M.B., Landon, B.E., Normand, S.T.: Employers’ use of value-based purchasing strategies. J. Am. Med. Assoc. 298, 2281–2288 (2007)
Nahra, T.A., Reiter, K.L., Hirth, R.A., Shermer, J.E., Wheeler, J.R.: Cost-effectiveness of hospital pay-for-performance incentives. Med. Care Res. Rev. 63, 49S–72S (2006)
Emmert, M.: Pay for Performance (P4P) im Gesundheitswesen. Ein Ansatz zur Verbesserung der Gesundheitsversorgung? Books on Demand, Norderstedt (2008)
Rosenthal, M.B., Landon, B.E., Howitt, K., Song, H.R., Epstein, A.M.: Climbing up the pay-for-performance learning curve: where are the early adopters now? Health Affair 26, 1674–1682 (2007)
Rhoads, K.F., Konety, B.M., Dudley, R.A.: Performance measurement, public reporting, and pay-for-performance. Urol. Clin. N. Am. 36, 37–48, vi (2009)
Christianson, J.B., Leatherman, S., Sutherland, K.: Lessons from evaluations of purchaser pay-for-performance programs: a review of the evidence. Med. Care Res. Rev. 65, 5S–35S (2008)
Brien, S.E., Dixon, E., Ghali, W.A.: Measuring and reporting on quality in health care: a framework and road map for improving care. J. Surg. Oncol. 99, 462–466 (2009)
Hillman, A.L., Pauly, M.V., Kerstein, J.J.: How do financial incentives affect physicians’ clinical decisions and the financial performance of health maintenance organizations? N. Engl. J. Med. 321, 86–92 (1989)
Hellinger, F.J.: The impact of financial incentives on physician behavior in managed care plans: a review of the evidence. Med. Care Res. Rev. 53, 294–314 (1996)
Gosden, T., Forland, F., Kristiansen, I.S., Sutton, M., Leese, B., Giuffrida, A., Sergison, M., Pedersen, L.: Capitation, salary, fee-for-service and mixed systems of payment: effects on the behaviour of primary care physicians. Cochrane Db. Syst. Rev. (Online), CD002215 (2000)
Town, R., Wholey, D.R., Kralewski, J., Dowd, B.: Assessing the influence of incentives on physicians and medical groups. Med. Care Res. Rev. 61, 80S–118S (2004)
Wheeler, J.R., White, B., Rauscher, S., Nahra, T.A., Reiter, K.L., Curtin, K.M., Damberg, C.L.: Pay-for-performance as a method to establish the business case for quality. J. Health Care Finance 33, 17–30 (2007)
Lindenauer, P.K., Remus, D., Roman, S., Rothberg, M.B., Benjamin, E.M., Ma, A., Bratzler, D.W.: Public reporting and pay for performance in hospital quality improvement. N. Engl. J. Med. 356, 486–496 (2007)
Landon, B.E., Schneider, E.C., Tobias, C., Epstein, A.M.: The evolution of quality management in Medicaid managed care. Health Affair 23, 245–254 (2004)
Bufalino, V., Peterson, E.D., Burke, G.L., LaBresh, K.A., Jones, D.W., Faxon, D.P., Valadez, A.M., Brass, L.M., Fulwider, V.B., Smith, R., Krumholz, H.M., Schwartz, J.S.: Payment for quality: guiding principles and recommendations: principles and recommendations from the American Heart Association’s Reimbursement, Coverage, and Access Policy Development Workgroup. Circulation 113, 1151–1154 (2006)
Nichols, L.M., O‘Malley, A.S.: Hospital payment systems: will payers like the future better than the past? Health Affair 25, 81–93 (2006)
Kouides, R.W., Bennett, N.M., Lewis, B., Cappuccio, J.D., Barker, W.H., LaForce, F.M.: Performance-based physician reimbursement and influenza immunization rates in the elderly. The primary-care physicians of Monroe County. Am. J. Prev. Med. 14, 89–95 (1998)
Dudley, R.A., Miller, R.H., Korenbrot, T.Y., Luft, H.S.: The impact of financial incentives on quality of health care. Milbank Q. 76, 649–686, 511 (1998)
Hanchak, N.A., Schlackman, N., Harmon-Weiss, S.: U.S. Healthcare’s quality-based compensation model. Health Care Financ. Rev. 17, 143–159 (1996)
Scott, I.A.: Pay for performance in health care: strategic issues for Australian experiments. Med. J. Aust. 187, 31–35 (2007)
Petersen, L.A., Woodard, L.D., Urech, T., Daw, C., Sookanan, S.: Does pay-for-performance improve the quality of health care? Ann. Intern. Med. 145, 265–272 (2006)
Campbell, S.M., Reeves, D., Kontopantelis, E., Sibbald, B., Roland, M.: Effects of pay for performance on the quality of primary care in England. N. Engl. J. Med. 361, 368–378 (2009)
Schatz, M., Blaiss, M., Green, G., Aaronson, D.: Pay for performance for the allergist-immunologist: potential promise and problems. J. Allergy Clin. Immun. 120, 769–775 (2007)
Dudley, R.A., Frölich, A., Rabinowitz, D.L., Talavera, J.A., Broadhead, P., Luft, H.S.: Strategies to support quality-based purchasing: a review of the evidence. Agency for Healthcare Research and Quality. Rockville (2004)
Armour, B.S., Pitts, M.M., Maclean, R., Cangialose, C., Kishel, M., Imai, H., Etchason, J.: The effect of explicit financial incentives on physician behavior. Arch. Intern. Med. 161, 1261–1266 (2001)
Amundson, G., Solberg, L.I., Reed, M., Martini, E.M., Carlson, R.: Paying for quality improvement: compliance with tobacco cessation guidelines. Jt. Comm. J. Qual. Saf. 29, 59–65 (2003)
Roski, J., Jeddeloh, R., An, L., Lando, H., Hannan, P., Hall, C., Zhu, S.: The impact of financial incentives and a patient registry on preventive care quality: increasing provider adherence to evidence-based smoking cessation practice guidelines. Prev. Med. 36, 291–299 (2003)
Kahn, J.M., Scales, D.C., Au, D.H., Carson, S.S., Curtis, J.R., Dudley, R.A., Iwashyna, T.J., Krishnan, J.A., Maurer, J.R., Mularski, R., Popovich Jr, J., Rubenfeld, G.D., Heffner, J.E.: An official American thoracic society policy statement: pay-for-performance in pulmonary, critical care, and sleep medicine. Am. J. Resp. Crit. Care 181, 752–761 (2010)
Ryan, A.M.: Effects of the premier hospital quality incentive demonstration on medicare patient mortality and cost. Health Serv. Res. 44, 821–842 (2009)
Nelson, A.R.: Pay-for-performance programs: ethical questions and unintended consequences. J. Fam. Pract. 56, 16A–18A (2007)
McDonald, R., Roland, M.: Pay for performance in primary care in England and California: comparison of unintended consequences. Ann. Fam. Med. 7, 121–127 (2009)
Buetow, S.: Pay-for-performance in New Zealand primary health care. J. Health Organ. Manag. 22, 36–47 (2008)
Schatz, M.: Does pay-for-performance influence the quality of care? Curr. Opin. Allergy Clin. Immunol. 8, 213–221 (2008)
Sachverständigenrat zur Begutachtung der Entwicklung im Gesundheitswesen: Gutachten 2007 des Sachverständigenrates zur Begutachtung der Entwicklung im Gesundheitswesen. Kooperation und Verantwortung–Voraussetzungen einer zielorientierten Gesundheitsversorgung (2007). http://dipbt.bundestag.de/dip21/btd/16/063/1606339.pdf. Accessed 18 November 2009
Smith, A.L.: Merging P4P and disease management: how do you know which one is working? J. Manag. Care Pharm. 13, 7–10 (2007)
Greene, S.E., Nash, D.B.: Pay for performance: an overview of the literature. Am. J. Med. Qual. 24, 140–163 (2009)
Greene, R.A., Beckman, H.B., Mahoney, T.: Beyond the efficiency index: finding a better way to reduce overuse and increase efficiency in physician care. Health Affair 27, w250–w259 (2008)
Hahn, J.: Pay-for-performance in health care. http://www.vascularweb.org/professionals/Government_Relations/PDF_Doc/CRS%20report%20on%20P4P.pdf (2006). Accessed 7 August 2009
O‘Kane, M.E.: Performance-based measures: the early results are in. J. Manag. Care Pharm. 13, 3–6 (2007)
Bailit Health Purchasing: The feasibility and cost effectiveness of making pay-for-performance opportunities available to Texas Medicaid providers. (2008). http://www.hhsc.state.tx.us/reports/Pay-for-Performance_0209.pdf. Accessed 3 June 2009
Peiro, S., Garcia-Altes, A.: Possibilities and limitations of results-based management, pay-for-performance and the redesign of incentives. 2008 SESPAS report. Gac. Sanit. 22, 143–155 (2008)
Scott, A., Peter, S., Ait, O.D., Willenberg, L., Naccerella, L., Furler, J., Young, D.: The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database. Syst. Rev. (2010)
Mehrotra, A., Damberg, C.L., Sorbero, M.E., Teleki, S.S.: Pay for performance in the hospital setting: what is the state of the evidence? Am. J. Med. Qual. 24, 19–28 (2009)
Institute of Medicine: Rewarding provider performance. Aligning incentives in medicare. Free executive summary. (2007). http://www.nap.edu/catalog/11723.html. Accessed 7 October 2009
Williams, T., Yanagihara, D., McDermott, S., Rose, L.: The California Pay for Performance Program. The second chapter. Measurement years 2006–2009. Oakland (2009)
Robinson, J.C., Williams, T., Yanagihara, D.: Measurement of and reward for efficiency in California’s Pay-for-Performance Program. Health Affair 28, 1438–1447 (2009)
Higgins, J.P.T., Green, S. (eds.): Cochrane handbook for systematic reviews of interventions. Wiley, Chichester (2008)
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen: Allgemeine Methoden, Version 3. (2008). http://www.iqwig.de/download/IQWiG_Methoden_Version_3_0.pdf. Accessed 24 November 2009
Graf von der Schulenburg, J.-M., Greiner, W., Jost, F., Klusen, N., Kubin, M., Leidl, R., Mittendorf, T., Rebscher, H., Schöffski, O., Vauth, C., Volmer, T., Wahler, S., Wasem, J., Weber, C.: Deutsche Empfehlungen zur gesundheitsökonomischen Evaluation–dritte und aktualisierte Fassung des Hannoveraner Konsens. Gesundh ökon Qual manag 12, 285–290 (2007)
Craig, D., Rice, S.: NHS Economic Evaluation Database Handbook (2007). http://www.york.ac.uk/inst/crd/pdf/nhseed-handb07.pdf. Accessed 11 August 2009
Eldridge, C., Palmer, N.: Performance-based payment: some reflections on the discourse, evidence and unanswered questions. Health Policy Plann. 24, 160–166 (2009)
Kilpatrick, K.E., Lohr, K.N., Leatherman, S., Pink, G., Buckel, J.M., Legarde, C., Whitener, L.: The insufficiency of evidence to establish the business case for quality. Int. J. Qual. Health Care 17, 347–355 (2005)
Reiter, K.L., Kilpatrick, K.E., Greene, S.B., Lohr, K.N., Leatherman, S.: How to develop a business case for quality. Int. J. Qual. Health Care 19, 50–55 (2007)
Leatherman, S., Berwick, D., Iles, D., Lewin, L.S., Davidoff, F., Nolan, T., Bisognano, M.: The business case for quality: case studies and an analysis. Health Affair 22, 17–30 (2003)
Schöffski, O.: Grundformen gesundheitsökonomischer Evaluationen. In: Schöffski, O., Graf von der Schulenburg, J.-M. (eds.) Gesundheitsökonomische Evaluationen, pp. 65–94. Springer, Berlin (2008)
Drummond, M.F., Sculpher, M.J., Torrance, G., O′Brien, B.J., Stoddart, G.L.: Methods for the economic evaluation of health care programmes. Oxford University Press, Oxford (2005)
Shemilt, I., Mugford, M., Byford, S., Drummond, M., Eisenstein, E., Knapp, M., Mallender, J., McDaid, D., Vale, L., Walker, D.: Incorporating economics evidence. In: Higgins, J.P.T., Green, S. (eds.) Cochrane Handbook for Systematic Reviews of Interventions, pp. 449–480. Wiley, Chichester (2008)
Volpp, K.G., Pauly, M.V., Loewenstein, G., Bangsberg, D.: P4P4P: an agenda for research on pay-for-performance for patients. Health Affair 28, 206–214 (2009)
Long, J.A., Helweg-Larsen, M., Volpp, K.G.: Patient opinions regarding ‘pay for performance for patients’. J. Gen. Intern. Med. 23, 1647–1652 (2008)
Drummond, M.F., Jefferson, T.O.: Guidelines for authors and peer reviewers of economic submissions to the BMJ. Brit. Med. J. 313, 275–283 (1996)
Gonzalez-Perez, J.G.: Developing a scoring system to quality assess economic evaluations. Eur. J. Health Econ. 3, 131–136 (2002)
Hawe, P., Shiell, A., Riley, T., Gold, L.: Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J. Epidemiol. Commun. Health 58, 788–793 (2004)
Nicholson, S., Pauly, M.V., Wu, A.Y., Murray, J.F., Teutsch, S.M., Berger, M.L.: Getting real performance out of pay-for-performance. Milbank Q. 86, 435–457 (2008)
Kahneman, D., Tversky, A.: Prospect theory: an analysis of decision under risk. Econometrica 2, 263–291 (1979)
Rosenthal, M.B., Frank, R.G., Li, Z., Epstein, A.M.: Early experience with pay-for-performance: from concept to practice. J. Am. Med. Assoc. 294, 1788–1793 (2005)
Rosenthal, M.B., Dudley, R.A.: Pay-for-performance: will the latest payment trend improve care? J. Am. Med. Assoc. 297, 740–744 (2007)
Damberg, C.L., Sorbero, M.E., Mehrotra, A., Teleki, S.S., Lovejoy, S., Bradley, L.: An environmental scan of pay for performance in the hospital setting: final report. Santa Monica, CA (2007)
Conrad, D.A.: Lessons to apply to national comprehensive healthcare reform. Am. J. Manag. Care 15, 306–321 (2009)
Mehrotra, A., Adams, J.L., Thomas, J.W., McGlynn, E.A.: Cost profiles: should the focus be on individual physicians or physician groups? Health Affair 29, 1532–1538 (2010)
Huang, I., Diette, G.B., Francesco, D., Frangakis, C., Wu, A.W.: Variations of physician group profiling indicators for asthma care. Am. J. Manag. Care 11, 38–44 (2005)
Mehrotra, A., Sorbero, M.E.S., Damberg, C.L.: Using the lessons of behavioral economics to design more effective pay-for-performance programs. Am. J. Manag. Care 16, 497–503 (2010)
Adams, J.L., Mehrotra, A., Thomas, J.W., McGlynn, E.A.: Physician cost profiling—reliability and risk of misclassification. N. Engl. J. Med. 362, 1014–1021 (2010)
Frey, B.S.: On the relationship between intrinsic and extrinsic work motivation. Int. J. Ind. Organ. 4, 427–439 (1997)
Deci, E.L., Koestner, R., Ryan, R.M.: A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychol. Bull. 125, 627–668 (1999). (discussion 692–700)
Marshall, M., Harrison, S.: It’s about more than money: financial incentives and internal motivation. Qual. Saf. Health Care 14, 4–5 (2005)
Holmstrom, B., Milgrom, P.: Multitask principal-agent analyses: incentive contracts, asset ownership, and job design. J. Law Econ. Organ. 1, 24–52 (1991)
Prendergast, C.: The provision of incentives in firms. J. Econ. Lit. 1, 7–63 (1999)
Donabedian, A.: The quality of care. How can it be assessed? J. Am. Med. Assoc. 260, 1743–1748 (1988)
Heath, C., Larrick, R.P., Wu, G.: Goals as reference points. Cogn. Psychol. 38, 79–109 (1999)
An, L.C., Bluhm, J.H., Foldes, S.S., Alesci, N.L., Klatt, C.M., Center, B.A., Nersesian, W.S., Larson, M.E., Ahluwalia, J.S., Manley, M.W.: A randomized trial of a pay-for-performance program targeting clinician referral to a state tobacco quitline. Arch. Intern. Med. 168, 1993–1999 (2008)
Lee, T.T., Cheng, S.H., Chen, C.C., Lai, M.S.: A pay-for-performance program for diabetes care in Taiwan: a preliminary assessment. Am. J. Manag. Care 16, 65–69 (2010)
Norton, E.C.: Incentive regulation of nursing homes. J. Health Econ. 11, 105–128 (1992)
Rosenthal, M.B., Li, Z., Robertson, A.D., Milstein, A.: Impact of financial incentives for prenatal care on birth outcomes and spending. Health Serv. Res. 44, 1465–1479 (2009)
Curtin, K., Beckman, H., Pankow, G., Milillo, Y., Greene, R.A.: Return on investment in pay for performance: a diabetes case study. J. Healthcare Manag. 51, 365–376 (2006)
Caro, J.J., Nord, E., Siebert, U., McGuire, A., McGregor, M., Henry, D., Pouvourville, G. de, Atella, V., Kolominsky-Rabas, P.: The efficiency frontier approach to economic evaluation of health-care interventions. Health Econ. (2010)
Roeg, D., van de Goor, I.: Garretsen, H.: Towards quality indicators for assertive outreach programmes for severely impaired substance abusers: concept mapping with Dutch experts. Int. J. Qual. Health Care 17, 203–208 (2005)
Roland, M.: Linking physicians’ pay to the quality of care—a major experiment in the United Kingdom. N. Engl. J. Med. 351, 1448–1454 (2004)
Doran, T., Fullwood, C., Gravelle, H., Reeves, D., Kontopantelis, E., Hiroeh, U., Roland, M.: Pay-for-performance programs in family practices in the United Kingdom. N. Engl. J. Med. 355, 375–384 (2006)
Walker, S., Mason, A.R., Claxton, K., Cookson, R., Fenwick, E., Fleetcroft, R., Sculpher, M.: Value for money and the Quality and Outcomes Framework in primary care in the UK NHS. Br. J. Gen. Pract. 60, 213–220 (2010)
Mattke, S., Seid, M., Ma, S.: Evidence for the effect of disease management: Is $1 billion a year a good investment? Am. J. Manag. Care 13, 670–676 (2007)
Steuten, L., Lemmens, K., Vrijhoef, B.: Health technology assessment of asthma disease management programs. Curr. Opin. Allergy Clin. Immunol. 7, 242–248 (2007)
Werner, R.M., Bradlow, E.T.: Public reporting on hospital process improvements is linked to better patient outcomes. Health Affair 29, 1319–1324 (2010)
Robinowitz, D.L., Dudley, R.A.: Public reporting of provider performance: can its impact be made greater? Annu. Rev. Publ. Health 27, 517–536 (2006)
Acknowledgments
The authors are grateful to Frauke Hübsch and Collin Devin Maddox for their support and comments on earlier drafts. We would like to thank Professor Michael Drummond for his helpful recommendation regarding the study quality appraisal.
Conflict of interest
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Emmert, M., Eijkenaar, F., Kemter, H. et al. Economic evaluation of pay-for-performance in health care: a systematic review. Eur J Health Econ 13, 755–767 (2012). https://doi.org/10.1007/s10198-011-0329-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10198-011-0329-8