- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Clinical research and medical care: towards effective and complete integration
© Sacristán; licensee BioMed Central. 2015
Received: 9 February 2014
Accepted: 2 January 2015
Published: 9 January 2015
Despite their close relationship, clinical research and medical care have become separated by clear boundaries. The purpose of clinical research is to generate generalizable knowledge useful for future patients, whereas medical care aims to promote the well-being of individual patients. The evolution towards patient-centered medicine and patient-oriented research, and the gradual standardization of medicine are contributing to closer ties between clinical research and medical practice. But the integration of both activities requires addressing important ethical and methodological challenges.
From an ethical perspective, clinical research should evolve from a position of paternalistic beneficence to a situation in which the principle of non-maleficence and patient autonomy predominate. The progressive adoption of “patient-oriented informed consent”, “patient equipoise”, and “altruism-based research”, and the application of risk-based ethical oversight, in which the level of regulatory scrutiny is adapted to the potential risk for patients, are crucial steps to achieve the integration between research and care.
From a methodological standpoint, careful and systematic observations should have greater relevance in clinical research, and experiments should be embedded into usual clinical practice. Clinical research should focus on individuals through the development of patient-oriented research. In a complementary way, the integration of experiments into medical practice through the systematic application of “point of care research” could help to generate knowledge for the individuals and for the populations.
The integration of clinical research and medical care will require researchers, clinicians, health care managers, and patients to reevaluate the way they understand both activities. The development of an integrated learning health care system will contribute to generating and applying clinically relevant medical knowledge, producing benefits for present and future patients.
Clinical research and medical care are closely related activities and represent two sides of the same coin. Acts of patient care are analogous to experiments as each patient begins in a baseline state, receives an intervention, and has an outcome . Furthermore, the ultimate goal of research is to generate knowledge capable of improving the patient’s health outcomes in medical practice. Despite their close relationship, clinical research and medical care have grown apart and nowadays are considered independent activities, separated by clear boundaries.
There are ethical, methodological and organizational barriers that explain this separation. The purpose of clinical research is to produce generalizable knowledge useful for future patients, while medical care aims to promote the well-being of individual patients . This dichotomy creates an ethical conflict for physicians playing dual role as doctors and as researchers. As doctors, they must keep the patient’s interest foremost, but as researchers, they must subordinate the individual patient’s interests to the general interests of the community [3–7]. In addition, clinical research objectives and methods are oriented towards identifying the best intervention for the “average” patient and rarely have a patient-centric focus. Finally, clinical research has become a complex and sophisticated process, involving much dedication of researchers who are increasingly specialized. In health care systems where the main priority is the provision of care, it may be difficult for doctors to dedicate time to research .
The ongoing changes within health care systems may contribute to the progressive convergence between research and care. Clinical research is moving its focus towards the assessment of the effectiveness of health interventions under the conditions of routine clinical practice . Some examples of this evolution are the development of Comparative Effectiveness Research  and Real World Evidence movements, the creation of the Patient Centered Outcomes Research Institute (PCORI) , and the increasing interest in measuring patient-reported outcomes (PRO) such as functional status, quality of life and patient satisfaction .
Medical care is also incorporating typical elements from clinical research. For example, the implementation of clinical practice guidelines has encouraged the establishment of standards and protocols in medicine; the increasing number of litigations has led to more defensive medicine practice , where obtaining patient’s informed consent has become an usual procedure; and the development of information technologies such as electronic health records allows the systematical analysis of data from thousands of patients and facilitates the decision-making process .
Although all these changes are helping to enhance the relationship between clinical research and medical care, there are important ethical and methodological barriers that prevent their full integration. This work analyzes these challenges and proposes some solutions to overcome them.
Ethical barriers and potential solutions: from paternalistic beneficence to autonomy and non-maleficence
Reassessment of the “three solutions” and associated ethical principles in the old and new models of clinical research and medical care
“Traditional Model”: separation between clinical research and medical care
“New model”: integration of clinical research and medical care
• Researcher-oriented informed consent and high level of oversight (paternalistic beneficence)
• Patient-oriented informed consent (autonomy) and risk-based ethical oversight (no maleficence)
• Clinical equipoise (physician authority)
• Clinical equipoise + Patient equipoise (autonomy)
• Therapeutic orientation (beneficence)
• Altruism-based research (autonomy)
From researcher-oriented informed consent to patient-oriented informed consent:
The purpose of the Informed Consent Document is to ensure that individual patients can control whether or not they participate in clinical research, and that they only participate if the research is consistent with their values, interests, and preferences . One of the main factors that obstruct the integration of clinical research and medical care is the current regulation systems that require excessively detailed inform consent documents, even for trials comparing widely accepted treatments . In practice, the information contained in informed consent documents is extensive, complex, and difficult to understand . Many patients agree to participate in randomized controlled trials because of their trust in their physicians. Some authors have indicated that “although the Informed Consent Document was a major stride towards protecting the rights and dignity of patients, the process may in some instances be perverted into protecting the physician rather than the patients” .
The development of the Patient Centered Medicine movement can facilitate the transition from the principle of beneficence to the principles of non-maleficence and autonomy. Within this context, non-maleficence represents the adaptation of regulatory research requirements to the risks for patients. The degree of monitoring and the extent of oversight should be adapted to the level of risk of the studies [23, 24]. The adoption of risk-based ethical oversight implies that for specific comparative effectiveness research studies may be justifiable to proceed with a streamlined informed consent process and that under specific circumstances the consent may be eliminated [25, 26].
The question is what kind of trials are those involving “low risk” conditions? Considering the established classification into exploratory and pragmatic studies , it can be argued that, in general, suitable conditions to integrate clinical research and medical care are present in many pragmatic trials comparing standard-of-care interventions . Conversely, “low risk conditions” may not be applicable to exploratory trials, which are aimed at increasing our understanding the potential therapeutic effects of a new drug. These trials usually include a placebo arm, and are conducted according to a strict predefined protocol. The “investigational” component prevails over the “medical care” objective, and patients are considered as “investigational subjects”. Selected patients, comparators, time-frame, and outcomes, among other factors, are oriented toward regulatory approval and do not always reflect the routine clinical practice environment. Consequently, the integration between clinical research and medical care may not be feasible in such trials.
From clinical equipoise to clinical and patient equipoise:
Clinical equipoise exists when “there is no consensus within the expert clinical community about the comparative merits of the alternatives to be tested” . It is often difficult to assess whether clinical equipoise actually exists, who the experts are, or on what end points is equipoise being assessed . A situation of clinical equipoise is especially difficult to achieve in placebo-controlled clinical trials, and also when a new drug under development is compared with a commercialized drug. In addition, it is necessary to reflect on the meaning of clinical equipoise within the context of personalized research, when growing evidence is showing the heterogeneity of the responses of different type of patients to the same treatment , and in a health care system where patients’ preferences should play an key role .
A classical article describing the impact of patient preferences in clinical research stated that “…although the treatments being compared were not known to differ in terms of their efficacy, they did differ in terms of their impact on the patients’ lives, and physicians knew this. It is not enough for the physician to have no reason to prefer one treatment over the other; in addition, there must be no reason for the patient to prefer one treatment” . Therefore, to include a patient in a randomized controlled trial, in addition to the principles of clinical equipoise (from the scientific community) and physician equipoise, it should be confirmed that the patient does not prefer any of the treatments being evaluated (i.e., there should be “patient equipoise”). This will require a shift from physician’s authority to patient’s autonomy. The increasing adoption of electronic health records and electronic patient decision aids could facilitate patient-physician communication and shared decisions [32, 33] by integrating patients’ preferences not only into medical decision making but also into clinical research. Ideally, electronic patient decision aids should help doctors to assess whether patient equipoise exists.
From therapeutic orientation to altruism:
The “therapeutic orientation” of randomized controlled trials substantiates the tendency to justify patients’ participation in randomized controlled trials based on the therapeutic benefits that they may derive from participating in such studies. The therapeutic orientation gives way to “therapeutic misconception”, defined as the tendency for patients/subjects to confuse their participation in clinical trials with personalized medical care [34, 35]. Usually, the information included in Informed Consent Document overstates the potential direct benefits for the patients .
Although participation in a new randomized controlled trials is sometimes the only way for a patient to receive a new investigational drug (e.g., for diseases for which there are no alternatives, or for which current alternatives are not efficacious), it is not possible to guarantee that participation in a randomized controlled trial results in better health outcomes for the patients. Reviews of this subject have not found consistent evidence for the existence of a beneficial trial effect [37, 38]. A research model based on the principles of autonomy and non-maleficence requires that patients receive complete and understandable information about the study; and that they understand that altruism and moral obligation, and not potential clinical benefits, should guide their participation in clinical research [39, 40]. The acceptation by society that patients have a “moral duty” to participate in research is a critical step to create an integrated learning health care system, where boundaries between clinical research and medical care will progressively disappear.
Methodological challenges and potential solutions: the methods in translation
From a methodological point of view, the different objectives of clinical research and medical care represent an obvious barrier to integrate both activities. Evidence-Based Medicine (EBM) and Patient-Centered Medicine are two movements that have emerged with great force in health systems in recent years. EBM has its conceptual anchor in research, while Patient Centered Medicine has it in medical care . EBM focuses on the generalization of the results, the aggregation of data, the analyses of commonalities, and the evaluation of the efficacy in average patients. Randomized controlled trials have become the cornerstone for EBM.
PCM proposes to look back to the individual patient, understood as a person. It “tries to provide the best health care to every patient, under the conditions of clinical practice, taking into account their objectives, preferences and values as well as available economic resources”. The development of Patient Centered Medicine requires the growth of a patient-oriented research focused on the “individualization” of results, the disaggregation of data, the analysis of the differences in subgroups and individuals, the study of heterogeneity, the analyses of exceptions or anomalies, the identification of the best option for each patient , and the application of a hypothetic-deductive logic where trials are considered exploratory and observations confirmatory [44, 45]. If the randomized controlled trial is the basis for EBM, careful individual observations are the foundation for patient-oriented research .
Integration of observations into clinical research
Progress towards patient-oriented research must have a clear focus on individual patients and be sustained by the development of a research methodology that rediscovers the crucial role of careful individual observations. Although the observations of individual cases occupy the lowest place in the hierarchic classification of evidence, they provide first line evidence [46, 47]. The exceptions and unexpected findings often direct research into new fields and sometimes the “evidence” that comes from individual cases and “anecdotes” may be deemed “confirmatory” and can change clinical practice in an instant [48, 49]. The increasing use of electronic health records may help to identify these “exceptions” and anomalies (e.g., unexpected benefits or adverse effects), to analyze the factors associated with their appearance, and alert doctors on the need to specifically monitor such exceptions. Electronic health records may also help to assess how and in which types of patients’ interventions are applied in clinical practice, to identify subgroups of patients, and to classify patients according to risk factors and comorbidities .
Khun’s description on the discovery of the first antidepressant represents an excellent example of how careful observation of patients has been central to the process of clinical research: “I’ve never used ‘double-blind, controlled studies’ versus placebo, standardized rating scales, or statistical treatment of data from a large number of patients. Instead, I examined each patient individually every day, often several times, and asked them questions over and over. Many of my patients were also under the observation of my assistants and nurses, and I always took their suggestions and criticisms very seriously”. In addition, careful observations have demonstrated a high value in the context of “experimental research”. As noted by Dr Crofton, a Member of the Medical Research Council who participated in the first clinical trial , “…Randomized trials were not intellectually stimulating. Our greatest intellectual challenge with tuberculosis research was to identify the reasons why the treatment failed. The results of randomized trials, together with detailed investigation of drug resistance in individual patients and the appropriate organization of services, allowed our team to reach one hundred percent recovery from pulmonary tuberculosis, the most common form of the disease and one that not long ago killed half of the patients who suffered from it”.
Integration of experiments into routine clinical practice
Observational studies and pragmatic clinical trials conducted in the conditions of usual clinical practice are the main methods to conduct comparative effectiveness research and to generate real world evidence. Observational studies are usually conducted using databases and registries of patients. Pragmatic randomized trials include heterogeneous populations of patients and assess long term effectiveness of interventions in real life, but the required infrastructure and oversight generates extraordinarily high costs.
Today, one of the main challenges in clinical research is how to integrate experiments into routine clinical practice. The idea of conducting “Randomized Database Studies”, that was proposed fifteen years ago as a possible solution to combine the main strengths of randomized controlled trials (i.e., initial randomization) and registries (i.e., naturalistic follow-up) , may represent a new and disruptive paradigm in clinical research . There are several recent examples of pragmatic trials that exploit routinely collected data to quickly demonstrate effectiveness in real-world care delivery systems [55, 56].
Electronic health records could also be used to conduct experiments in individual patients. N-of-1 studies are crossover trials, where the patient is his/her own control. Single patient trials are the only current vehicle for resolving clinical uncertainty about whether new and existing treatments are truly effective for a particular patient .
In order to achieve the integration, several ethical and methodological challenges should be met. Ethically, clinical research and medical care should evolve from a situation of paternalistic beneficence to a situation predominated by the principles of non-maleficence and patient autonomy. “Patient-oriented informed consent ”,“ patient equipoise” and “altruism-based research” are some of the potential solutions to practice a true patient-oriented research integrated into clinical practice. The application of risk-based ethical oversight, in which the level of ethical oversight is adapted to the risk for patients will be essential to integrate research and treatment.
Methodologically, the distance between clinical research and medical care should be attenuated in the same way as the distance between observations and experiments. Clinical research should yield results applicable to individual patients and medical practice should enable the possibility to learn from daily practice. Clinical research should evolve towards a patient-oriented research, a type of research that needs to rediscover the crucial role of careful observations and its confirmatory value. In a complementary way, experiments should be systematically integrated into daily medical practice. The implementation of Randomized Database Studies and single patient trials through electronic health records and decision-aids tools may contribute to decrease the cost of comparative effectiveness research, to accelerate the generation of new knowledge and, most importantly, to the fast translation of clinical research findings to present and future patients.
The successful integration of clinical research and medical care will require important cultural and organizational challenges. The alignment of incentives, goals, and metrics focused on improving patient-centered outcomes; the evolution towards patient-centered medical education; and the generation of evidence about the health benefits that integrated learning health care systems produce, are crucial elements to facilitate the transformation. But the key cultural challenge is that researchers, clinicians, health care managers, and patients to reevaluate the way they understand research and medicine.
- Feinstein AR: “Clinical Judgment” revisited: the distraction of quantitative models.Ann Intern Med 1994, 120:799–805. 10.7326/0003-4819-120-9-199405010-00012View ArticlePubMedGoogle Scholar
- Litton P, Miller FG: A normative justification for distinguishing the ethics of clinical research from the ethics of medical care.J Law Med Ethics 2005, 33:566–74. 10.1111/j.1748-720X.2005.tb00519.xView ArticlePubMedGoogle Scholar
- Hill AB: Medical ethics and controlled trials.BMJ 1963,1(5337):1043–9. 10.1136/bmj.1.5337.1043View ArticlePubMedPubMed CentralGoogle Scholar
- Angell M: Patients’ preferences in randomized clinical trials.New Engl J Med 1984, 310:1385–7. 10.1056/NEJM198405243102111View ArticlePubMedGoogle Scholar
- Grunberg SM, Cefalu WT: The integral role of clinical research in clinical care.New Engl J Med 2003, 348:1386–8. 10.1056/NEJMsb025342View ArticlePubMedGoogle Scholar
- Hellman S, Hellman DS: Of mice but not men. problems of the randomized clinical trial.New Engl J Med 1991, 324:1585–9. 10.1056/NEJM199105303242208View ArticlePubMedGoogle Scholar
- Schafer A: The ethics of the randomized clinical trial.New Engl J Med 1982, 307:719–24. 10.1056/NEJM198209163071204View ArticlePubMedGoogle Scholar
- Gelijns AC, Gabriel SE: Looking beyond translation–integrating clinical research with medical practice.New Engl J Med 2012, 366:1659–61. 10.1056/NEJMp1201850View ArticlePubMedGoogle Scholar
- Freemantle N, Blonde L, Bolinder B, Gerber RA, Hobbs FD, Martinez L, Ross S: Real-world trials to answer real-world questions.Pharmacoeconomics 2005, 23:747–54. 10.2165/00019053-200523080-00001View ArticlePubMedGoogle Scholar
- Sox HC, Greenfield S: Comparative effectiveness research: a report from the Institute of Medicine.Ann Intern Med 2009, 151:203–5. 10.7326/0003-4819-151-3-200908040-00125View ArticlePubMedGoogle Scholar
- Selby JV, Beal AC, Frank L: The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda.JAMA 2012, 307:1583–4. 10.1001/jama.2012.500View ArticlePubMedGoogle Scholar
- Coons SJ, Kothari S, Monz BU, Burke LB: The patient-reported outcome (PRO) consortium: filling measurement gaps for PRO end points to support labeling claims.Clin Pharmacol Ther 2011, 90:743–8. 10.1038/clpt.2011.203View ArticlePubMedGoogle Scholar
- Forster HP, Schwartz J, DeRenzo E: Reducing legal risk by practicing patient-centered medicine.Arch Intern Med 2002, 162:1217–9. 10.1001/archinte.162.11.1217View ArticlePubMedGoogle Scholar
- Shea S, Hripcsak G: Accelerating the use of electronic health records in physician practices.New Engl J Med 2010, 362:192–5. 10.1056/NEJMp0910140View ArticlePubMedGoogle Scholar
- National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research: Department of Health Education, and Welfare. (DHEW) (30 September 1978). The Belmont Report. (DHEW pub. no. (OS) 78–0012). Washington, DC: United States Government Printing Office;Google Scholar
- Emanuel EJ, Wendler D, Grady C: What makes clinical research ethical?JAMA 2000, 283:2701–11. 10.1001/jama.283.20.2701View ArticlePubMedGoogle Scholar
- Freedman B: Equipoise and the ethics of clinical research.New Engl J Med 1987, 317:141–5. 10.1056/NEJM198707163170304View ArticlePubMedGoogle Scholar
- Miller FG, Rosenstein DL: The therapeutic orientation to clinical trials.New Engl J Med 2003, 348:1383–6. 10.1056/NEJMsb030228View ArticlePubMedGoogle Scholar
- Truog RD: Patients and doctors–evolution of a relationship.New Engl J Med 2012, 366:581–5. 10.1056/NEJMp1110848View ArticlePubMedGoogle Scholar
- Reith C, Landray M, Devereaux PJ, Bosch J, Granger CB, Baigent C, Califf RM, Collins R, Yusuf S: Randomized clinical trials–removing unnecessary obstacles.New Engl J Med 2013, 369:1061–5. 10.1056/NEJMsb1300760View ArticlePubMedGoogle Scholar
- Paasche-Orlow MK, Taylor HA, Brancati FL: Readability standards for informed-consent forms as compared with actual readability.New Engl J Med 2003, 348:721–6. 10.1056/NEJMsa021212View ArticlePubMedGoogle Scholar
- Dreyfuss D: Is it better to consent to an RCT or to care? muetadeltaepsilonnu alphagammaalphanu (“nothing in excess”).Intens Care Med 2005, 31:345–55. 10.1007/s00134-004-2493-0View ArticleGoogle Scholar
- Kass N, Faden R, Tunis S: Addressing low-risk comparative effectiveness research in proposed changes to US federal regulations governing research.JAMA 2012, 307:1589–90. 10.1001/jama.2012.491View ArticlePubMedGoogle Scholar
- Kass NE, Faden RR, Goodman SN, Pronovost P, Tunis S, Beauchamp TL: The research-treatment distinction: a problematic approach for determining which activities should have ethical oversight.Hastings Center Rep 2013, Spec No:S4–15.View ArticleGoogle Scholar
- Faden RR, Beauchamp TL, Kass NE: Informed consent, comparative effectiveness, and learning health care.New Engl J Med 2014, 370:766–8. 10.1056/NEJMhle1313674View ArticlePubMedGoogle Scholar
- Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL: An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics.Hastings Center Rep 2013, Spec No:S16–27.View ArticleGoogle Scholar
- Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials.J Chron Dis 1967, 20:637–48. 10.1016/0021-9681(67)90041-0View ArticlePubMedGoogle Scholar
- Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy.JAMA 2003, 290:1624–32.View ArticlePubMedGoogle Scholar
- Miller FG, Joffe S: Equipoise and the dilemma of randomized clinical trials.New Engl J Med 2011, 364:476–80. 10.1056/NEJMsb1011301View ArticlePubMedGoogle Scholar
- Davidoff F: Heterogeneity is not always noise: lessons from improvement.JAMA 2009, 302:2580–6. 10.1001/jama.2009.1845View ArticlePubMedGoogle Scholar
- Quill TE, Holloway RG: Evidence, preferences, recommendations–finding the right balance in patient care.New Engl J Med 2012, 366:1653–5. 10.1056/NEJMp1201535View ArticlePubMedGoogle Scholar
- White A, Danis M: Enhancing patient-centered communication and collaboration by using the electronic health record in the examination room.JAMA 2013, 309:2327–8. 10.1001/jama.2013.6030View ArticlePubMedPubMed CentralGoogle Scholar
- Hoffmann TC, Legare F, Simmons MB, McNamara K, McCaffery K, Trevena LJ, Hudson B, Glasziou PP, Del Mar CB: Shared decision making: what do clinicians need to know and why should they bother?Med J Aust 2014, 201:35–9. 10.5694/mja14.00002View ArticlePubMedGoogle Scholar
- Henderson GE, Churchill LR, Davis AM, Easter MM, Grady C, Joffe S, Kass N, King NM, Lidz CW, Miller FG, et al.: Clinical trials and medical care: defining the therapeutic misconception.PLoS Med 2007, 4:e324. 10.1371/journal.pmed.0040324View ArticlePubMedPubMed CentralGoogle Scholar
- Appelbaum PS, Roth LH, Lidz CW, Benson P, Winslade W: False hopes and best data: consent to research and the therapeutic misconception.Hastings Center Rep 1987, 17:20–4.View ArticleGoogle Scholar
- King NM, Henderson GE, Churchill LR, Davis AM, Hull SC, Nelson DK, Parham-Vetter PC, Rothschild BB, Easter MM, Wilfond BS: Consent forms and the therapeutic misconception: the example of gene transfer research.IRB 2005, 27:1–8.View ArticlePubMedGoogle Scholar
- Peppercorn JM, Weeks JC, Cook EF, Joffe S: Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review.Lancet 2004, 363:263–70. 10.1016/S0140-6736(03)15383-4View ArticlePubMedGoogle Scholar
- Vist GE, Bryant D, Somerville L, Birminghem T, Oxman AD: Outcomes of patients who participate in randomized controlled trials compared to similar patients receiving similar interventions who do not participate.Cochrane Database Syst Rev 2008, 3:MR000009.Google Scholar
- Schaefer GO, Emanuel EJ, Wertheimer A: The obligation to participate in biomedical research.JAMA 2009, 302:67–72. 10.1001/jama.2009.931View ArticlePubMedPubMed CentralGoogle Scholar
- Harris J: Scientific research is a moral duty.J Med Ethics 2005,31(4):242–8. 10.1136/jme.2005.011973View ArticlePubMedPubMed CentralGoogle Scholar
- Sacristan JA: Evidence based medicine and patient centered medicine: some thoughts on their integration.Rev Clin Esp 2013, 213:460–4. 10.1016/j.rce.2013.05.014View ArticlePubMedGoogle Scholar
- Sacristan JA: Patient-centered medicine and patient-oriented research: improving health outcomes for individual patients.BMC Med Inform Decis Making 2013, 13:6. 10.1186/1472-6947-13-6View ArticleGoogle Scholar
- Conway PH, Clancy C: Charting a path from comparative effectiveness funding to improved patient-centered health care.JAMA 2010, 303:985–6. 10.1001/jama.2010.259View ArticlePubMedGoogle Scholar
- Sacristan JA: Evidence from randomized controlled trials, meta-analyses, and subgroup analyses.JAMA 2010, 303:1253–4. author reply 1254–1255 10.1001/jama.2010.366View ArticlePubMedGoogle Scholar
- Sacristan JA: Exploratory trials, confirmatory observations: a new reasoning model in the era of patient-centered medicine.BMC Med Res Mmethodol 2011, 11:57. 10.1186/1471-2288-11-57View ArticleGoogle Scholar
- Vandenbroucke JP: In defense of case reports and case series.Ann Intern Med 2001, 134:330–4. 10.7326/0003-4819-134-4-200102200-00017View ArticlePubMedGoogle Scholar
- Jenicek M: Clinical case reports: sources of boredom or valuable pieces of evidence?Nat Med J India 2001, 14:193–4.Google Scholar
- Aronson JK, Hauben M: Anecdotes that provide definitive evidence.BMJ 2006, 333:1267–9. 10.1136/bmj.39036.666389.94View ArticlePubMedPubMed CentralGoogle Scholar
- Stuebe AM: Level IV evidence. adverse anecdote and clinical practice.New Engl J Med 2011, 365:8–9. 10.1056/NEJMp1102632View ArticlePubMedGoogle Scholar
- Healy D: The psichopharmacologists II. London: CRC Press; 1998.Google Scholar
- Crofton J: The MRC randomized trial of streptomycin and its legacy: a view from the clinical front line.J Royal Soc Med 2006, 99:531–4. 10.1258/jrsm.99.10.531View ArticleGoogle Scholar
- Charlton BG, Walston F: Individual case studies in clinical research.J Eval Clin Pract 1998, 4:147–55. 10.1111/j.1365-2753.1998.tb00081.xView ArticlePubMedGoogle Scholar
- Sacristan JA, Soto J, Galende I, Hylan TR: Randomized database studies: a new method to assess drugs’ effectiveness?J Clin Epidemiol 1998, 51:713–5.View ArticlePubMedGoogle Scholar
- Lauer MS, D’Agostino RB Sr: The randomized registry trial - the next disruptive technology in clinical research?New Engl J Med 2013, 369:1579–81. 10.1056/NEJMp1310102View ArticlePubMedGoogle Scholar
- van Staa TP, Dyson L, McCann G, Padmanabhan S, Belatri R, Gooldacre B, et al.: The opportunities and challenges of pragmatic point-of-care randomised trials using routinely collected electronic records: evaluations of two exemplar trials.Health Technol Assess 2014, 18:1–146.View ArticlePubMedPubMed CentralGoogle Scholar
- Staa TP, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, Delaney B, Smeeth L: Pragmatic randomised trials using routine electronic health records: putting them to the test.BMJ 2012, 344:e55. 10.1136/bmj.e55View ArticlePubMedPubMed CentralGoogle Scholar
- Jull A, Bennett D: Do n-of-1 trials really tailor treatment?Lancet 2005, 365:1992–4. 10.1016/S0140-6736(05)66678-0View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/15/4/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.