Abstract
The size of the study should be considered early in the planning phase. In some instances, no formal sample size is ever calculated. Instead, the number of participants available to the investigators during some period of time determines the size of the study. Many clinical trials that do not carefully consider the sample size requirements turn out to lack the statistical power or ability to detect intervention effects of a magnitude that has clinical importance. In 1978, Freiman and colleagues [1] reviewed the power of 71 published randomized controlled clinical trials which failed to find significant differences between groups. “Sixty-seven of the trials had a greater than 10% risk of missing a true 25% therapeutic improvement, and with the same risk, 50 of the trials could have missed a 50% improvement.” The situation was not much improved in 1994, when a similar survey found only 16% of negative trials had 80% power for a 25% effect, and only 36% for a 50% effect [2]. In other instances, the sample size estimation may assume an unrealistically large intervention effect. Thus, the power for more realistic intervention effects will be low or less than desired. The danger in studies with low statistical power is that interventions that could be beneficial are discarded without adequate testing and may never be considered again. Certainly, many studies do contain appropriate sample size estimates, but in spite of many years of critical review many are still too small [3, 4].
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Freiman JA, Chalmers TC, Smith H, Jr., Kuebler RR. The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 “negative” trials. N Engl J Med 1978;299:690–694.
Moher D, Dulberg CS, Wells GA. Statistical power, sample size, and their reporting in randomized controlled trials. JAMA 1994;272:122–124.
Chan AW, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet 2005;365:1159–1162.
Halpern SD, Karlawish JH, Berlin JA. The continuing unethical conduct of underpowered clinical trials. JAMA 2002;288:358–362.
Altman DG. Statistics and ethics in medical research: III How large a sample? Br Med J 1980;281:1336–1338.
Brown BW. Statistical Controversies in the Design of Clinical-Trials - Some Personal Views. Control Clin Trials 1980;1:13–27.
Campbell MJ, Julious SA, Altman DG. Estimating sample sizes for binary, ordered categorical, and continuous outcomes in two group comparisons. BMJ 1995;311:1145–1148.
Day SJ, Graham DF. Sample size estimation for comparing two or more treatment groups in clinical trials. Stat Med 1991;10:33–43.
Donner A. Approaches to sample size estimation in the design of clinical trials—a review. Stat Med 1984;3:199–214.
Gore SM. Statistics in question. Assessing clinical trials—trial size. Br Med J (Clin Res Ed) 1981;282:1687–1689.
Lachin JM. Introduction to sample size determination and power analysis for clinical trials. Control Clin Trials 1981;2:93–113.
Phillips AN, Pocock SJ. Sample size requirements for prospective studies, with examples for coronary heart disease. J Clin Epidemiol 1989;42:639–648.
Schlesselman JJ. Planning a longitudinal study. I. Sample size determination. J Chronic Dis 1973;26:553–560.
Schouten HJ. Planning group sizes in clinical trials with a continuous outcome and repeated measures. Stat Med 1999;18:255–264.
Streiner DL. Sample size and power in psychiatric research. Can J Psychiatry 1990;35:616–620.
Whitehead J. Sample sizes for phase II and phase III clinical trials: an integrated approach. Stat Med 1986;5:459–464.
Chow SC, Shao J, Wang H. Sample size calculations in clinical research, ed 2nd ed. Boca Raton, Taylor & Francis, 2008.
Desu MM, Raghavarao D. Sample Size Methodology. Boston, Academic Press, 1990.
Julious SA. Sample Sizes for Clinical Trials. Chapman and Hall, 2009.
Machin D, Campbell MJ, Tan S-B, Tan S-H. Sample Size Tables for Clinical Studies, ed 3rd. Wiley-Blackwell, 2008.
Odeh RE, Fox M. Sample Size Choice: Charts for Experiments with Linear Models, ed 2nd. New York, Marcel Dekker, 1991.
Braunholtz DA, Edwards SJ, Lilford RJ. Are randomized clinical trials good for us (in the short term)? Evidence for a “trial effect”. J Clin Epidemiol 2001;54:217–224.
Paynter NP, Sharrett AR, Louis TA, et al. Paired comparison of observed and expected coronary heart disease rates over 12 years from the Atherosclerosis Risk in Communities Study. Ann Epidemiol 2010;20:683–690.
Brancati FL, Evans M, Furberg CD, et al. Midcourse correction to a clinical trial when the event rate is underestimated: the Look AHEAD (Action for Health in Diabetes) Study. Clin Trials 2012;9:113–124.
McClure LA, Szychowski JM, Benavente O, Coffey CS. Sample size re-estimation in an on-going NIH-sponsored clinical trial: the secondary prevention of small subcortical strokes experience. Contemp Clin Trials 2012;33:1088–1093.
Wittes J. On changing a long-term clinical trial midstream. Statist Med 10-15-2002;21:2789–2795.
Armitage P, Berry G, Mathews J. Statistical Methods in Medical Research, ed 4th. Malden MA, Blackwell Publishing, 2002.
Brown BW, Hollander M. Statistics - A Biomedical Introduction. New York, John Wiley and Sons, 1977.
Dixon WJ, Massey FJ Jr. Introduction to Statistical Analysis, ed 3rd. New York, McGraw-Hill, 1969.
Fisher L, Van Belle G. Biostatistics - A Methodology for the Health Sciences. New York, John Wiley and Sons, 1993.
Fisher L, Van Belle G, Heagerty PL, Lumley TS. Biostatistics - A Methodology for the Health Sciences. New York, John Wiley and Sons, 2004.
Fleiss JL, Levin B, Paik MC. Statistical Methods for Rates and Proportions, ed 3rd. John Wiley & Sons, Inc., 2003.
Remington RD, Schork MA. Statistics With Applications to the Biological and Health Sciences. Englewood Cliffs, Prentice-Hall, 1970.
Rosner B. Fundamentals of Biostatistics, ed 3rd. Boston, PWS-Kent, 1990.
Schork MA, Remington RD. Statistics With Applications to the Biological and Health Sciences, ed 3rd. Englewood Cliffs, Prentice-Hall, 2000.
Snedecor GW, Cochran WG. Statistical Methods, ed 8th. Ames, Iowa State University Press, 1989.
Woolson RF, Clarke WR. Statistical Methods for the Analysis of Biomedical Data. Wiley, 2011.
Canner PL, Klimt CR. The Coronary Drug Project. Experimental design features. Control Clin Trials 1983;4:313–332.
Davis BR, Cutler JA, Gordon DJ, et al. Rationale and design for the Antihypertensive and Lipid Lowering Treatment to Prevent Heart Attack Trial (ALLHAT). ALLHAT Research Group. Am J Hypertens 1996;9:342–360.
Dunnett CW. A multiple comparison procedure for comparing several treatments with a control. J Am Statist Assoc 1955;50:1096–1121.
Costigan T. Bonferroni inequalities and intervals; in Armitage P, Colton T (eds): Encyclopedia of Biostatistics. John Wiley and Sons, 2007.
Brittain E, Schlesselman JJ. Optimal Allocation for the Comparison of Proportions. Biometrics 1982;38:1003–1009.
The Cardiac Arrhythmia Suppression Trial (CAST) Investigators. Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. N Engl J Med 1989;321:406–412.
Rothman KJ. A show of confidence. N Engl J Med 1978;299:1362–1363.
Brown BW, Hollander M. Statistics: A Biomedical Introduction. Wiley, 2009.
McHugh RB, Le CT. Confidence estimation and the size of a clinical trial. Control Clin Trials 1984;5:157–163.
Armitage P, McPherson CK, Rowe BC. Repeated Significance Tests on Accumulating Data. J R Stat Soc Ser A 1969;132:235–244.
Bristol DR. Sample sizes for constructing confidence intervals and testing hypotheses. Statist Med 1989;8:803–811.
Casagrande JT, Pike MC, Smith PG. An Improved Approximate Formula for Calculating Sample Sizes for Comparing Two Binomial Distributions. Biometrics 1978;34:483–486.
Day SJ. Optimal placebo response rates for comparing two binomial proportions. Statist Med 1988;7:1187–1194.
Fleiss JL, Tytun A, Ury HK. A Simple Approximation for Calculating Sample Sizes for Comparing Independent Proportions. Biometrics 1980;36:343–346.
Fu YX, Arnold J. A Table of Exact Sample Sizes for Use with Fisher’s Exact Test for 2 × 2 Tables. Biometrics 1992;48:1103–1112.
Gail MH, Gart JJ. The Determination of Sample Sizes for Use with the Exact Conditional Test in 2 x 2 Comparative Trials. Biometrics 1973;29:441–448.
Gail MH. The determination of sample sizes for trials involving several independent 2 × 2 tables. J Chronic Dis 1973;26:669–673.
Haseman JK. Exact Sample Sizes for Use with the Fisher-Irwin Test for 2 × 2 Tables. Biometrics 1978;34:106–109.
Lachenbruch PA. A note on sample size computation for testing interactions. Statist Med 1988;7:467–469.
McMahon RP, Proschan M, Geller NL, et al. Sample size calculation for clinical trials in which entry criteria and outcomes are counts of events. Statist Med 1994;13:859–870.
Ury HK, Fleiss JL. On Approximate Sample Sizes for Comparing Two Independent Proportions with the Use of Yates’ Correction. Biometrics 1980;36:347–351.
Wacholder S, Weinberg CR. Paired versus Two-Sample Design for a Clinical Trial of Treatments with Dichotomous Outcome: Power Considerations. Biometrics 1982;38:801–812.
Connor RJ. Sample Size for Testing Differences in Proportions for the Paired-Sample Design. Biometrics 1987;43:207–211.
Donner A. Statistical Methods in Ophthalmology: An Adjusted Chi-Square Approach. Biometrics 1989;45:605–611.
Gauderman W, Barlow WE. Sample size calculations for ophthalmologic studies. Arch Ophthalmol 1992;110:690–692.
Rosner B. Statistical Methods in Ophthalmology: An Adjustment for the Intraclass Correlation between Eyes. Biometrics 1982;38:105–114.
Rosner B, Milton RC. Significance Testing for Correlated Binary Outcome Data. Biometrics 1988;44:505–512.
Hayes RL, Moulton LH. Cluster Randomised Trials. Chapman and Hall, 2009.
Cytel: SiZ. Cambridge, MA, Cytel Software Corporation, 2011.
Elashoff JD. nQuery Advisor Version 7.0 User’s Guide. Cork, Ireland, Statistical Solutions, 2007.
Pezzullo JC. Web Pages that Perform Statistical Calculations. Computer Program 2014.
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria, R Foundation for Statistical Computing, 2013.
SAS Institute: Getting Started with the SAS Power and Sample Size Application. Cary, NC, SAS Institute Inc., 2004.
Shiboski S. Power and Sample Size Programs. Department of Epidemiology and Biostatistics, University of California San Francisco. Computer Program 2006.
StataCorp: Stata: Release 13. College Station, TX, StataCorp, 2013.
TIBCO Software I: SPLUS. TIBCO Softward Inc., 2008.
Feigl P. A Graphical Aid for Determining Sample Size when Comparing Two Independent Proportions. Biometrics 1978;34:111–122.
Aspirin Myocardial Infarction Study Research Group. A randomized, controlled trial of aspirin in persons recovered from myocardial infarction. JAMA 1980;243:661–669.
Beta Blocker Heart Attack Trial Research Group. A randomized trial of propranolol in patients with acute myocardial infarction: I. mortality results. JAMA 1982;247:1707–1714.
CASS Principle Investigators and Their Associates. Coronary artery surgery study (CASS): a randomized trial of coronary artery bypass surgery. Survival data. Circulation 1983;68:939–950.
The Coronary Drug Project Research Group. The Coronary Drug Project: Design, Methods, and Baseline Results. Circulation 1973;47:I–1.
Hypertension Detection and Follow-up Program Cooperative Group. Five-year findings of the hypertension detection and follow-up program: I. reduction in mortality of persons with high blood pressure, including mild hypertension. JAMA 1979;242:2562–2571.
The Intermittent Positive Pressure Breathing Trial Group. Intermittent Positive Pressure Breathing Therapy of Chronic Obstructive Pulmonary Disease A Clinical Trial. Ann Intern Med 1983;99:612–620.
Multiple Risk Factor Intervention Trial Research Group. Multiple risk factor intervention trial: Risk factor changes and mortality results. JAMA 1982;248:1465–1477.
Packer M, Carver JR, Rodeheffer RJ, et al. Effect of Oral Milrinone on Mortality in Severe Chronic Heart Failure. N Engl J Med 1991;325:1468–1475.
Barlow W, Azen S. The effect of therapeutic treatment crossovers on the power of clinical trials. Control Clin Trials 1990;11:314–326.
Halperin M, Rogot E, Gurian J, Ederer F. Sample sizes for medical trials with special reference to long-term therapy. J Chronic Dis 1968;21:13–24.
Lakatos E. Sample size determination in clinical trials with time-dependent rates of losses and noncompliance. Control Clin Trials 1986;7:189–199.
Lavori P. Statistical Issues: Sample Size and Dropout; in Benkert O, Maier W, Rickels K (eds): Methodology of the Evaluation of Psychotropic Drugs. Springer Berlin Heidelberg, 1990, pp 91–104.
Newcombe RG. Explanatory and pragmatic estimates of the treatment effect when deviations from allocated treatment occur. Statist Med 1988;7:1179–1186.
Schork MA, Remington RD. The determination of sample size in treatment-control comparisons for chronic disease studies in which drop-out or non-adherence is a problem. J Chronic Dis 1967;20:233–239.
Wu MC, Fisher M, DeMets D. Sample sizes for long-term medical trial with time-dependent dropout and event rates. Control Clin Trials 1980;1:111–124.
Pentico DW. On the Determination and Use of Optimal Sample Sizes for Estimating the Difference in Means. Am Stat 1981;35:40–42.
Dawson JD, Lagakos SW. Size and Power of Two-Sample Tests of Repeated Measures Data. Biometrics 1993;49:1022–1032.
Kirby AJ, Galai N, Munoz A. Sample size estimation using repeated measurements on biomarkers as outcomes. Control Clin Trials 1994;15:165–172.
Laird NM, Wang F. Estimating rates of change in randomized clinical trials. Control Clin Trials 1990;11:405–419.
Lipsitz SR, Fitzmaurice GM. Sample size for repeated measures studies with binary responses. Statist Med 1994;13:1233–1239.
Nam J. A Simple Approximation for Calculating Sample Sizes for Detecting Linear Trend in Proportions. Biometrics 1987;43:701–705.
Overall JE, Doyle SR. Estimating sample sizes for repeated measurement designs. Control Clin Trials 1994;15:100–123.
Rochon J. Sample Size Calculations for Two-Group Repeated-Measures Experiments. Biometrics 1991;47:1383–1398.
Fitzmaurice GM, Laird NM, Ware JH. Applied longitudinal analysis, ed 2nd. John Wiley & Sons, 2011.
Cantor AB. Power estimation for rank tests using censored data: Conditional and unconditional. Control Clin Trials 1991;12:462–473.
Emrich LJ. Required Duration and Power Determinations for Historically Controlled-Studies of Survival Times. Statist Med 1989;8:153–160.
Freedman LS. Tables of the number of patients required in clinical trials using the logrank test. Statist Med 1982;1:121–129.
Gail MH. Applicability of sample size calculations based on a comparison of proportions for use with the logrank test. Control Clin Trials 1985;6:112–119.
George SL, Desu MM. Planning the size and duration of a clinical trial studying the time to some critical event. J Chronic Dis 1974;27:15–24.
Halperin M, Johnson NJ. Design and Sensitivity Evaluation of Follow-Up Studies for Risk Factor Assessment. Biometrics 1981;37:805–810.
Hsieh FY. Sample size tables for logistic regression. Statist Med 1989;8:795–802.
Lachin JM, Foulkes MA. Evaluation of sample size and power for analyses of survival with allowance for nonuniform patient entry, losses to follow-up, noncompliance, and stratification. Biometrics 1986;42:507–519.
Lachin JM. Biostatistical Methods: The Assessment of Relative Risks, ed 2nd. John Wiley & Sons, Inc., 2010.
Lakatos E. Sample Sizes Based on the Log-Rank Statistic in Complex Clinical Trials. Biometrics 1988;44:229–241.
Lui KJ. Sample size determination under an exponential model in the presence of a confounder and type I censoring. Control Clin Trials 1992;13:446–458.
Morgan TM. Nonparametric Estimation of Duration of Accrual and Total Study Length for Clinical Trials. Biometrics 1987;43:903–912.
Palta M, Amini SB. Consideration of covariates and stratification in sample size determination for survival time studies. J Chronic Dis 1985;38:801–809.
Pasternack BS, Gilbert HS. Planning the duration of long-term survival time studies designed for accrual by cohorts. J Chronic Dis 1971;24:681–700.
Rubinstein LV, Gail MH, Santner TJ. Planning the duration of a comparative clinical trial with loss to follow-up and a period of continued observation. J Chronic Dis 1981;34:469–479.
Schoenfeld DA, Richter JR. Nomograms for Calculating the Number of Patients Needed for a Clinical Trial with Survival as an Endpoint. Biometrics 1982;38:163–170.
Schoenfeld DA. Sample-Size Formula for the Proportional-Hazards Regression Model. Biometrics 1983;39:499–503.
Taulbee JD, Symons MJ. Sample Size and Duration for Cohort Studies of Survival Time with Covariables. Biometrics 1983;39:351–360.
Wu MC. Sample size for comparison of changes in the presence of right censoring caused by death, withdrawal, and staggered entry. Control Clin Trials 1988;9:32–46.
Zhen B, Murphy JR. Sample size determination for an exponential survival model with an unrestricted covariate. Statist Med 1994;13:391–397.
Pasternack BS. Sample sizes for clinical trials designed for patient accrual by cohorts. J Chronic Dis 1972;25:673–681.
Hjalmarson A, Herlitz J, Malek I, et al. Effect on Mortality of Metoprolol in Acute Myocardial Infarction: A Double-blind Randomised Trial. The Lancet 1981;318:823–827.
The Norwegian Multicenter Study Group. Timolol-Induced Reduction in Mortality and Reinfarction in Patients Surviving Acute Myocardial Infarction. N Engl J Med 1981;304:801–807.
Nocturnal Oxygen Therapy Trial Group. Continuous or Nocturnal Oxygen Therapy in Hypoxemic Chronic Obstructive Lung Disease A Clinical Trial. Ann Intern Med 1980;93:391–398.
Ingle JN, Ahmann DL, Green SJ, et al. Randomized Clinical Trial of Diethylstilbestrol versus Tamoxifen in Postmenopausal Women with Advanced Breast Cancer. N Engl J Med 1981;304:16–21.
Spriet A, Beiler D. When can ‘non significantly different’ treatments be considered as ‘equivalent’? Br J Clin Pharmacol 1979;7:623–624.
Blackwelder WC. “Proving the null hypothesis” in clinical trials. Control Clin Trials 1982;3:345–353.
Blackwelder WC, Chang MA. Sample size graphs for “proving the null hypothesis”. Control Clin Trials 1984;5:97–105.
Makuch R, Simon R. Sample size requirements for evaluating a conservative therapy. Cancer Treat Rep 1978;62:1037–1040.
Rothmann MD, Wiens BL, Chan ISF. Design and Analysis of Non-Inferiority Trials. Taylor & Francis, 2011.
Donner A, Birkett N, Buck C. Randomization by cluster. Sample size requirements and analysis. Am J Epidemiol 1981;114:906–914.
Cornfield J. Randomization by group: A formal analysis. Am J Epidemiol 1978;108:100–102.
Hsieh FY. Sample size formulae for intervention studies with the cluster as unit of randomization. Statist Med 1988;7:1195–1201.
Lee EW, Dubin N. Estimation and sample size considerations for clustered binary responses. Statist Med 1994;13:1241–1252.
Murray DM. Design and Analysis of Group-randomized Trials. Oxford University Press, 1998.
Urokinase Pulmonary Embolism Trial Study Group: Urokinase-streptokinase embolism trial: Phase 2 results. JAMA 1974;229:1606–1613.
Roberts R, Croft C, Gold HK, et al. Effect of Propranolol on Myocardial-Infarct Size in a Randomized Blinded Multicenter Trial. N Engl J Med 1984;311:218–225.
Follmann D. A Simple Multivariate Test for One-Sided Alternatives. J Am Stat Assoc 1996;91:854–861.
O’Brien PC. Procedures for Comparing Samples with Multiple Endpoints. Biometrics 1984;40:1079–1087.
Tang DI, Gnecco C, Geller NL. Design of Group Sequential Clinical Trials with Multiple Endpoints. J Am Stat Assoc 1989;84:776–779.
Tang DI, Geller NL, Pocock SJ. On The Design and Analysis of Randomized Clinical Trials with Multiple Endpoints. Biometrics 1993;49:23–30.
Hsu J. Multiple Comparisons: Theory and Methods. Taylor & Francis, 1996.
Miller RG. Simultaneous Statistical Inference, ed 2nd. Springer New York, 2011.
The Coronary Drug Project Research Group. Clofibrate and niacin in coronary heart disease. JAMA 1975;231:360–381.
Church TR, Ederer F, Mandel JS, et al. Estimating the Duration of Ongoing Prevention Trials. Am J Epidemiol 1993;137:797–810.
Ederer F, Church TR, Mandel JS. Sample Sizes for Prevention Trials Have Been Too Small. Am J Epidemiol 1993;137:787–796.
Neaton JD, Bartsch GE. Impact of measurement error and temporal variability on the estimation of event probabilities for risk factor intervention trials. Statist Med 1992;11:1719–1729.
Patterson BH. The impact of screening and eliminating preexisting cases on sample size requirements for cancer prevention trials. Control Clin Trials 1987;8:87–95.
Shih WJ. Sample size reestimation in clinical trials; in Peace KE (ed): Biopharmaceutical Sequential Statistical Applications. Taylor & Francis, 1992, pp 285–301.
Wittes J, Brittain E. The role of internal pilot studies in increasing the efficiency of clinical trials. Statist Med 1990;9:65–72.
Ambrosius WT, Polonsky TS, Greenland P, et al. Design of the Value of Imaging in Enhancing the Wellness of Your Heart (VIEW) trial and the impact of uncertainty on power. Clin Trials 2012;9:232–246.
Steering Committee of the Physicians’ Health Study. Final Report on the Aspirin Component of the Ongoing Physicians’ Health Study. N Engl J Med 1989;321:129–135.
The Diabetes Control and Complications Trial Research Group: The Effect of Intensive Treatment of Diabetes on the Development and Progression of Long-Term Complications in Insulin-Dependent Diabetes Mellitus. N Engl J Med 1993;329:977–986.
Davis BR, Wittes J, Pressel S, et al. Statistical considerations in monitoring the Systolic Hypertension in the Elderly Program (SHEP). Control Clin Trials 1993;14:350–361.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Friedman, L.M., Furberg, C.D., DeMets, D.L., Reboussin, D.M., Granger, C.B. (2015). Sample Size. In: Fundamentals of Clinical Trials. Springer, Cham. https://doi.org/10.1007/978-3-319-18539-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-18539-2_8
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18538-5
Online ISBN: 978-3-319-18539-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)