This version approved by three Editors (first, second and third) from the listed workgroup. The Health Sciences Workgroup is responsible for this citable version. While we have done conscientious work, we cannot guarantee that this version is wholly free of mistakes. See here (not History) for authorship.
"A clinical trial is defined as a prospective scientific experiment that involves human subjects in whom treatment is initiated for the evaluation of a therapeutic intervention. In a randomized controlled clinical trial, each patient is assigned to receive a specific treatment intervention by a chance mechanism."[1] The theory behind these trials is that the value of a treatment will be shown in an objective way, and, though usually unstated, there is an assumption that the results of the trial will be applicable to the care of patients who have the condition that was treated.
Medical research answers many questions about health, illness, and treatment options. Evaluating new medicines and other treatments may involve research using randomized controlled trials [(RCT)]. In such trials the participants who receive the treatment under study are assigned [to different treatments] at random (by chance, like the flip of a coin). This is necessary to ensure that the outcomes are determined only by the treatment under study and not by other factors that could otherwise influence treatment assignment. Other participants who, by the randomization process, serve as controls receive a standard treatment or placebo treatment (a pill or procedure that does not include active ingredients).[2]
Trials of potential treatments, for ethical reasons, tend to involve multiple stages, starting with small safety tests of the drug or other therapy. Once there is evidence of safety, and preliminary clinical trials, the effort moves to a larger scale: large multicentre clinical trials that are randomized, controlled, and double-blind using a control group of patients (i.e., "arm" of the trial) and an experimental arm.
Trials should be large, so that serious adverse events might be detected even when they occur rarely. Multi-centre trials minimize problems that can arise when a single geographical locus has a population that is not fully representative of the global population, and they can minimize the effect of geographical variations in environment and health care delivery. Randomization (if the study population is large enough) should mean that the study groups are unbiased. A double-blind trial is one in which neither the patient nor the deliverer of the treatment is aware of the nature of the treatment offered to any particular individual, and this avoids bias caused by the expectations of either the doctor or the patient.
Major developments in randomized controlled trials[edit]
In 1990, the steering committee was formed for the International Conference on Harmonization.[3] This led to the recommendations for Good Clinical Practices in the conduct of trials.[4] Some have considered these guidelines to be burdensome.[5]
The quality of reporting of the conduct of randomized controlled trials remains problematic.[6]
In 1996, the Consort Statement was published which improved how trials are reported.[7] The statement was revised in 2001[8] and 2010[9].
As of 2005, among high impact journals, "CONSORT was mentioned in the instructions of 36 (22%) journals (see bmj.com), more often in general and internal medicine journals (8/15; 53%) than in specialty journals (28/152; 18%)".[10] Changes in 2010 includes reporting of trial registration, availability of the original protocol, and funding. The quality of reporting of trials in psychiatry may be better since introduction of the CONSORT statement.[11]
In 2004, the International Committee of Medical Journal Editors (ICMJE) announced that all trials starting enrollment after July 1, 2005 must be registered prior to consideration for publication in one of the 12 member journals of the Committee.[12]
"Control", according to the current Declaration of Helsinki ethical guides, may or may not involve a placebo. If there is no accepted treatment, or the disease is mild and self-limiting, placebo controls may be ethical. If there is accepted treatment, the best accepted treatment becomes the control arm. Trials that are controlled, but not by a placebo, still generate arguments about information value versus ethics.
Placebo controls are important, because the placebo effect can often be strong. The more value a subject believes an unknown drug has, the more placebo effect is has.[14] The use of historical rather than concurrent controls may lead to exaggerated estimation of effect.[15]
The placebo effect can be seen in controlled trials of surgical interventions with the control group receiving a sham procedure.[16][17][18]
The Hawthorne effect is the improvements seen in control subjects simply from participating in research.[19]
Blinding, where neither participants nor experimenters know what treatment the participants are receiving, is important, especially for trials that have subjective outcomes.[20] Trials that are not blinded tend to report more favorable results.[21]
In some settings, health care providers, or healthcare institutions should be randomized rather than randomizing the research subjects.[22] This should occur when the intervention targets the provider or institutions and thus the results from each subject are not truly independent, but will cluster within the health care provider or healthcare institution. Guidelines exist for conducting cluster randomised trials.[23] Cluster-randomized trials are not always correctly designed and executed.[24]
Designing an adequately sized cluster-randomized trial is based on several factors. One factor is the intraclass (intracluster) correlation coefficient (ICC).[25][26] The ICC between clusters is analogous to the variance between subjects in a randomized controlled trial. Just as when randomized controlled trials exhibiting high variance between subjects means a larger study is needed, less correlation between clusters indicates more clusters are needed.
Uncontrolled before-after studies and controlled before-after studies probably should not be considered variations of a randomized controlled trial, yet if carefully done offer advantages to observational studies.[27] As in a true cluster-randomized trial, the intervention group can be randomly assigned; however, unlike a cluster-randomized trial, the before-after study does not have enough clusters or groups. An interrupted time series analysis can try to improve plausibility of causation; however, interrupted time series are commonly performed incorrectly.[28]
In this design, one group is randomized to receive treatment before the control group.[31] This design allows analysis for disease-modifying effects of treatments. An example of this design was a trial of rasagiline for Parkinson Disease.[32]
Designs that test doses in sequence, such as up and down studies[34] and adaptive dose-ranging trials[35], depend upon being able to measure an outcome from the medication that occurs quickly, and the drug's dose can be titrated to achieve the effect.[36][37] An example of this type of outcome is blood pressure.
Parallel designs such as multi-level factorial studies have been used.[38] Special sample size calculations exist for these designs.[38]
Factorial randomized controlled trial: number of treatment failures due to severe hallucinations or alcohol withdrawal.[39]
Chlordiazepoxide
Given
Not given
Propranolol
Given
1
4
Not given
0
4
Notes: 1. There were 15 patients in each group.
A factorial design allows two interventions to be be studied with ability to measure the treatment effect of each intervention in isolation and in combination.[40][41] Interaction between the two treatments can be displayed with "interaction ratios or odds ratios accompanied by their confidence intervals"[40] and can be measured with the method of Gail and Simon[42] or the Breslow-Day test for homogeneity.
In an "N of 1" trial, also called a "single-subject randomized" trial, a single patient randomly proceeds through multiple blinded crossover comparisons. This address the concerns that traditional randomized controlled trials may not generalize to a specific patient.[45]
Underlining the difficulty in extrapolating from large trials to individual patients, Sackett proposed the use of N of 1 randomized controlled trials. In these, the patient is both the treatment group and the placebo group, but at different times. Blinding must be done with the collaboration of the pharmacist, and treatment effects must appear and disappear quickly following introduction and cessation of the therapy. This type of trial can be performed for many chronic, stable conditions.[46] The individualized nature of the single-subject randomized trial, and the fact that it often requires the active participation of the patient (questionnaires, diaries), appeals to the patient and promotes better insight and self-management[47][48] as well as patient safety,[45] in a cost-effective manner.
Noninferiority and equivalence randomized trials[edit]
Noninferiority and equivalency randomized controlled trials.
As stated in The Declaration of Helsinki by the World Medical Association it is unethical to give any patient a placebo treatment if an existing treatment option is known to be beneficial.[49][50] Many scientists and ethicists consider that the U.S. Food and Drug Administration, by demanding placebo-controlled trials, encourages the systematic violation of the Declaration of Helsinki.[51] In addition, the use of placebo controls remains a convenient way to avoid direct comparisons with a competing drug.
The appropriate use of placebo is being revised.[52][53] When guidelines suggest a placebo is an unethical control, then an "active-control noninferiority trial" may be used.[54] To establish non-inferiority, the following three conditions should be - but frequently are not - established:[54]
"The treatment under consideration exhibits therapeutic noninferiority to the active control."
"The treatment would exhibit therapeutic efficacy in a placebo-controlled trial if such a trial were to be performed."
"The treatment offers ancillary advantages in safety, tolerability, cost, or convenience."
Noninferiority and equivalence randomized trial are difficult to execute well.[54] Guidelines exists for noninferiority and equivalence randomized trials.[55] In planning the trial, the investigators should choose "a noninferiority or equivalence criterion, and specifying the margin of equivalence with the rationale for its choice."[55] In reporting the outcomes, the authors should present the confidence intervals to show the reader whether the result was within their noninferiority or equivalence criterion.[55]
"Sometimes a new agent can be assessed by using an 'add-on' study design in which all patients
are given standard therapy and are randomly assigned to also receive either new agent or placebo."[52]
Consort has described pragmatic trials and standards for their reporting.[56] CONSORT describes a pragmatic trial as addressing "does the intervention work when used in normal practice" as opposed to an "explanatory trial" that addresses "can the intervention work." CONSORT states that this is not a dichotomy of trial designs, but that pragmatic trials reflect an attitude in the design. CONSORT offers an example of a pragmatic trial[57] and an explanatory trial.[58]
The Belmont Report was released in 1979 by the National Commission for the Protection of Human Subjects in Biomedical and Behavioral Research.[60][61] The three Belmont principles are beneficence, justice and respect for persons.
The Declaration of Helsinki requires informed consent for participation in a trial. In the United States, there is an approval procedure for clinical trials in human subjects, whether for research only or for potential approval of a commercial drug. Most industrialized countries have such procedures; some permit reciprocal approvals.
"Research means a systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge. Activities which meet this definition constitute research for purposes of this policy, whether or not they are conducted or supported under a program which is considered research for other purposes. For example, some demonstration and service programs may include research activities."
Human subject means a living individual about whom an investigator (whether professional or student) conducting research obtains:
Data through intervention or interaction with the individual, or
Identifiable private information.
In the United States, the Code of Federal Regulations defines:
Research that may be exempt from IRB approval (45 CFR 46.101(b))
Research that may be eligible for expedited IRB approval (45 CFR 46.110)
Determining the justification for experimentation can be difficult.[62]
The appropriate use of placebo is being revised.[52][53][63] One tension is the balance between using placebo to increase scientific rigor versus the unnessessary deprival of active treatment to patients. This is the conundrum faced by Martin Arrowsmith in the book by the same name.[64][65]
Comparing a new intervention to a placebo control may not be ethical when an accepted, effective treatment exists. In this case, the new intervention should be compared to the active control to establish whether the standard of care should change.[66] The observation that industry sponsored research may be more likely to conduct trials that have positive results suggest that industry is not picking the most appropriate comparison group.[67] However, it is possible that industry is better at predicting which new innovations are likely to be successful and discontinuing research for less promising interventions before the trial stage.
There are times when placebo control is appropriate even when there is accepted, effective treatment.[52][53][63]
There are ethical concerns in comparing a surgical intervention to sham surgery; however, this has been done.[68][18] Guidelines by the American Medical Association address the use of placebo surgery.[69]
Trials are increasingly stopped early[70]; however, this may induce a bias that exaggerates results[71][70]. Data safety and monitoring boards that are independent of the trial are commissioned to conduct interim analyses and make decisions about stopping trials early.[72][73]
Reasons to stop a trial early are efficacy, safety, and futility.[74][75]
Regarding efficacy, various rules exist that adjust alpha to decide when to stop a trial early.[76][77][78][79][80] A commonly recommended rules are the O'Brien-Fleming (the O'Brien-Fleming rule requires a varying p-value depending on the number of interim analyses) and the Haybittle-Peto (the Haybittle-Peto which requires p<0.001 to stop a trial early) rule.[76][77][81]
Using a more conservative stopping rule reduces the chance of a statistical alpha (Type I) error; however, these rules do not alter that the effect size may be exaggerated.[82][77] According to Bassler, "the more stringent the P-value threshold results must cross to justify stopping the trial, the more likely it is that a trial stopped early will overestimate the treatment effect."[75] A review of trials stopped early found that the earlier a trial was stopped the larger was its reported treatment effect[70], especially if the trial had less than 500 total events[83]. Accordingly, examples exist of trials whose interim analyses were significant, but the trial was continued and the final analysis was less significant or was insignificant.[84][85][86]
Methods to correct for exaggeration exists.[87][82] A Bayesian approach to interim analysis may help reduce bias and adjust the estimate of effect.[88]
As an alternative to the alpha rules, conditional power can help decide when to stop trials early.[89][90]
Some trials may be unnecessary because their hypotheses have already been established.[91] Using cumulative meta-analysis, 25 of 33 randomized controlled trials of streptokinase for the treatment of acute myocardial infarction were unnecessary.[92]
Authors of trials may fail to cite prior trials.[93]
Cumulative meta-analysis prior to a new trial may indicate trials that do not need to be executed.[94]
Seeding trials are studies sponsored by industry whose "apparent purpose is to test a hypothesis. The true purpose is to get physicians in the habit of prescribing a new drug."[95] Examples include the ADVANTAGE[95] and STEPS[96] trials.
Several approaches to handling missing data have been reviewed.[98] Regarding assigning an outcome to the patient, using a 'last observation carried forward' (LOCF) analysis may introduce biases.[99]
Regarding group assignment, a 'per protocol' analysis may introduce bias compared to an 'intention to treat' analysis. Intention to treat is not always adequately described.[100][101] This bias may be due to the observations that research subjects who adhere to therapy, whether the therapy be an active treatment or placebo, have a reduction in mortality.[102][103] Thus excluding non-compliant subjects would appear to exaggerate the effects of treatment; however the bias can go both directions.[104] Analysis options exist.[105]
The costs and efforts required to measure primary endpoints such as morbidity and mortality make using surrogate outcomes an option. An example is in the treatment of osteoporosis, the primary outcomes are fractures and mortality whereas the surrogate outcome is changes in bone mineral density.[106][107] Other examples of surrogate outcomes are tumor shrinkage or changes in cholesterol level, blood pressure, HbA1c, CD4 cell count.[108] Surrogate markers might be acceptable when "the surrogate must be a correlate of the true clinical outcome and fully capture the net effect of treatment on the clinical outcome".[108] However, surrogate outcomes and their rationale may not be adequately described in trials.[109]
In trials of mass screening, overdiagnosis is the diagnosis of non-harmful disease. [114] Overdiagnosis inflates the importance of the screening problem.
Adverse effects may be discovered only after a trial is concluded, or in the larger populations to which a drug, approved for general release based on trial data, is used. Postmarketing surveillance is intended to detect hazards that the trials are not powerful enough to find.
Subgroup analyses can be misleading due to failure to prespecify hypotheses and to account for multiple comparisons.[117][77][118]
When multiple subgroups are present, examining subgroups with a multivariate risk score may be better than examining subgroups one-variable-at-at-time which may exaggerate the role of subgroups.[119]
Statistical methods[120] and criteria[121] exist for assessing the importance of subgroups. In brief, testing the statistical significance of an interaction (e.g. statistical heterogeneity) between subgroups and a relative measure of outcome. variation in the relative measure.[121]
The following criteria have been proposed for interpreting the p-value from the test of statistical significance:[121]
P > 0.1 indicates skepticism of a subgroup effect
P is between 0.1 and 0.01 suggests to "consider the hypothesis"
P less than or equal to 0.001 "take the hypothesis seriously"
Numerous scales and checklists for assessing quality have been proposed.[122] A comparison of the Cochrane Collaboration Tool, the Jadad score, and the Schulz approach found that the Cochrane Collaboration Tool required more time to complete, contained some subjective items, and did not well correlate with the Jadad score or Schulz approach.[123]
The Cochrane Collaboration uses a six item tool.[124] Trials that have high or uncertain bias are more likely to report large effect sizes.[123]
In using the Cochrane tool, if any of the first three items are low quality (randomization, allocation concealment before and during enrollment, blinding), the trial may be considered high or uncertain bias.[125]
Publication bias refers to the tendency that trials that show a positive significant effect are more likely to be published than those that show no effect or are inconclusive.
At the same time, in September 2004, the International Committee of Medical Journal Editors (ICMJE) announced that all trials starting enrollment after July 1, 2005 must be registered prior to consideration for publication in one of the 12 member journals of the Committee.[12] This move was to reduce the risk of publication bias as negative trials that are unpublished would be more easily discoverable.
Judging external validity is more difficult than judging internal validity. "External validity refers to the question whether results are generalizable to persons other than the population in the original study."[130] A framework for assessing external validity proposes:[130]
"The study population might not be representative for the eligibility criteria that were intended. It should be addressed whether the study population differs from the intended source population with respect to characteristics that influence outcome."
"The target population will, by definition, differ from the study population with respect to geographical, temporal and ethnical conditions. Pondering external validity means asking the question whether these differences may influence study results."
"It should be assessed whether the study's conclusions can be generalized to target populations that do not meet all the eligibility criteria."
↑INTERNATIONAL CONFERENCE ON HARMONISATION OF TECHNICAL REQUIREMENTS FOR REGISTRATION OF PHARMACEUTICALS FOR HUMAN USE GUIDELINE FOR GOOD CLINICAL PRACTICE
↑Begg C, Cho M, Eastwood S, et al (August 1996). "Improving the quality of reporting of randomized controlled trials. The CONSORT statement". JAMA276 (8): 637–9. PMID 8773637. [e]
↑Sacks H, Chalmers TC, Smith H (February 1982). "Randomized versus historical controls for clinical trials". Am. J. Med.72 (2): 233–40. PMID 7058834. [e]
↑Cobb LA, Thomas GI, Dillard DH, Merendino KA, Bruce RA (May 1959). "An evaluation of internal-mammary-artery ligation by a double-blind technic". N. Engl. J. Med.260 (22): 1115–8. PMID 13657350. [e]
↑Dimond EG, Kittle CF, Crockett JE (April 1960). "Comparison of internal mammary artery ligation and sham operation for angina pectoris". Am. J. Cardiol.5: 483–6. PMID 13816818. [e]
↑Wears RL (2002). "Advanced statistics: statistical methods for analyzing cluster and cluster-randomized data". Academic emergency medicine : official journal of the Society for Academic Emergency Medicine9 (4): 330–41. PMID 11927463. [e]
↑Campbell MK, Fayers PM, Grimshaw JM (2005). "Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research". Clin Trials2 (2): 99–107. PMID 16279131. [e]
↑Campbell M, Grimshaw J, Steen N (2000). "Sample size calculations for cluster randomised trials. Changing Professional Practice in Europe Group (EU BIOMED II Concerted Action)". J Health Serv Res Policy5 (1): 12–6. PMID 10787581. [e]
↑Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE (2003). "Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies". Int J Technol Assess Health Care19 (4): 613–23. PMID 15095767. [e]
↑Zilm DH, Jacob MS, MacLeod SM, Sellers EM, Ti TY (1980). "Propranolol and chlordiazepoxide effects on cardiac arrhythmias during alcohol withdrawal". Alcohol. Clin. Exp. Res.4 (4): 400-5. PMID 7004240. [e]
↑Stampfer MJ, Buring JE, Willett W, Rosner B, Eberlein K, Hennekens CH (1985). "The 2 x 2 factorial design: its application to a randomized trial of aspirin and carotene in U.S. physicians". Stat Med4 (2): 111–6. DOI:10.1002/sim.4780040202. PMID 4023472. Research Blogging.
↑ 45.045.1Mahon J, Laupacis A, Donner A, Wood T (1996). "Randomised study of n of 1 trials versus standard practice". BMJ312 (7038): 1069–74. PMID 8616414. [e]
↑Guyatt G et al (1988). "A clinician's guide for conducting randomized trials in individual patients". CMAJ139: 497–503. PMID 3409138. [e]
↑ (1997) "World Medical Association declaration of Helsinki. Recommendations guiding physicians in biomedical research involving human subjects". JAMA277: 925–6. PMID 9062334. [e]
↑Michels KB, Rothman KJ (2003). "Update on unethical use of placebos in randomised trials". Bioethics17: 188–204. PMID 12812185. [e]
↑ (August 1991) "Beneficial effect of carotid endarterectomy in symptomatic patients with high-grade carotid stenosis. North American Symptomatic Carotid Endarterectomy Trial Collaborators". N. Engl. J. Med.325 (7): 445–53. PMID 1852179. [e]
↑ 63.063.1Emanuel EJ, Miller FG (2001). "The ethics of placebo-controlled trials--a middle ground". N. Engl. J. Med.345 (12): 915–9. PMID 11565527. [e]
↑Rothman KJ, Michels KB (1994). "The continuing unethical use of placebo controls". N. Engl. J. Med.331 (6): 394–8. PMID 8028622. [e]
↑Djulbegovic B, Lacevic M, Cantor A, et al (2000). "The uncertainty principle and industry-sponsored research". Lancet356 (9230): 635–8. PMID 10968436. [e]
↑Cobb LA, Thomas GI, Dillard DH, Merendino KA, Bruce RA: An evaluation of internal-mammary-artery ligation by a double-blind technique. N Engl J Med 1959;260:1115-1118.
↑Tenery R, Rakatansky H, Riddick FA, et al (2002). "Surgical "placebo" controls". Ann. Surg.235 (2): 303–7. PMID 11807373. [e]
↑Trotta, F., G. Apolone, S. Garattini, and G. Tafuri. 2008. Stopping a trial early in oncology: for patients or for industry? Ann Oncol mdn042. http://dx.doi.org/10.1093/annonc/mdn042
↑O'Brien PC, Fleming TR (September 1979). "A multiple testing procedure for clinical trials". Biometrics35 (3): 549–56. PMID 497341. [e]
↑Bauer P, Köhne K (December 1994). "Evaluation of experiments with adaptive interim analyses". Biometrics50 (4): 1029–41. PMID 7786985. [e]
This method was used by PMID: 18184958
↑Baum ML, Anish DS, Chalmers TC, Sacks HS, Smith H, Fagerstrom RM (1981). "A survey of clinical trials of antibiotic prophylaxis in colon surgery: evidence against further use of no-treatment controls.". N Engl J Med305 (14): 795-9. DOI:10.1056/NEJM198110013051404. PMID 7266633. Research Blogging.
↑Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC (1992). "Cumulative meta-analysis of therapeutic trials for myocardial infarction.". N Engl J Med327 (4): 248-54. DOI:10.1056/NEJM199207233270406. PMID 1614465. Research Blogging.
↑Li Z, Meredith MP (2003). "Exploring the relationship between surrogates and clinical outcomes: analysis of individual patient data vs. meta-regression on group-level summary statistics". J Biopharm Stat13 (4): 777–92. DOI:10.1081/BIP-120024209. PMID 14584722. Research Blogging.
↑Chan AW, Hróbjartsson A, Jørgensen KJ, Gøtzsche PC, Altman DG (2008). "Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols". BMJ337: a2299. PMID 19056791. [e]
↑Wang R, Lagakos SW, Ware JH, Hunter DJ, Drazen JM (2007). "Statistics in medicine--reporting of subgroup analyses in clinical trials". N. Engl. J. Med.357 (21): 2189–94. DOI:10.1056/NEJMsr077003. PMID 18032770. Research Blogging.
↑Yusuf S, Wittes J, Probstfield J, Tyroler HA (1991). "Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials". JAMA266 (1): 93–8. PMID 2046134. [e]
↑Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V (2009). "Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review.". BMJ338: b354. DOI:10.1136/bmj.b354. PMID 19213766. PMC PMC2643439. Research Blogging.