Skip to main content
Download PDF

Patient enrollment and logistical problems top the list of difficulties in clinical research: a cross-sectional survey

BMC Medical Research Methodology volume 16, Article number: 50 (2016) Cite this article

Abstract

Background

Many medical research projects encounter difficulties. The objective of this study was to assess the self-reported frequency of difficulties encountered by medical researchers while conducting research and to identify factors associated with their occurrence.

Methods

The authors conducted a cross-sectional survey in 2010 among principal investigators of 996 study protocols approved by the Research Ethics Committee in Geneva, Switzerland, between 2001 and 2005. The authors asked principal investigators to rate the level of difficulty (1: none, to 5: very great) encountered across the research process.

Results

588 questionnaires were sent back (participation rate 59.0 %). 391 (66.5 %) studies were completed at the time of the survey. Investigators reported that the most frequent difficulties were related to patient enrollment (44.3 %), data collection (26.7 %), data analysis and interpretation (21.5 %), collaboration with caregivers (21.0 %), study design (20.4 %), publication in peer-reviewed journal (20.2 %), hiring of competent study personnel (20.2 %), and getting funding (19.2 %). On average, investigators reported 2.8 difficulties per project (SD 2.8, range 0 to 12). In multivariable analysis, the number of difficulties was higher for studies initiated by public sponsors (vs. private), single center studies (vs. multicenter), and studies about treatment, diagnosis or prognosis (i.e., clinical vs. other studies).

Conclusions

Medical researchers reported substantial logistical difficulties in conducting clinical research.

Peer Review reports

Background

Evidence-based medicine [1] and clinical research are positively valued by health care professionals [2–5], many of whom engage in research [6–9] alongside their clinical activity, in many countries [7, 8] and in Switzerland [6]. Research is necessary to improve medical knowledge, and medical (or clinical) researchers pursuing an academic career have the incentive to publish their results so as to obtain credit from their peers and institutions. However, time devoted to research is generally scarce [9, 10] because clinical activity has priority. Furthermore, medical researchers report moderate levels of research skills [9, 11, 12]. As a result, the numbers of medical researchers [13, 14] and the number of applications for scientific career awards and for research funding have been decreasing over the past three decades, notably in the United States, Finland and Sweden [15–17]. This gap between the necessity of medical research and the limited ability of doctors to actually conduct medical research suggests the need to better understand the difficulties encountered by medical researchers.

Several difficulties in conducting clinical research have been already reported. Challenges include designing the study, calculating the adequate sample size, obtaining funding [18, 19], getting approval from the Research Ethics Committee (REC) [20–22], enrolling enough patients [23], performing appropriate statistical analyses [11] and writing up and publishing the findings [19, 24, 25]. Among discontinued clinical studies, four out of ten were not started because of lack of funding [26] and three out of ten were abandoned because of insufficient patient enrollment [26]. For randomized clinical trials, the ability to recruit patients during the first months after their initiation is a strong indicator for study completion and publication [25, 27]. Finally, getting the paper published in a peer-reviewed journal is also difficult: a quarter of submitted paper send up never being published [28].

While a number of aspects regarding study processes and outcomes have been investigated [25, 27–34], such as patient recruitment, completion rates, publication or number of citations, less is known about possible difficulties experienced during the course of a clinical study. Previous studies have explored the general impression of medical researchers about difficulties in research [19, 26, 35], but not the recall of actual difficulties experienced in the course of a specific study. Surveying medical researchers on a specific and completed study can provide a more accurate recall of the aspects of the research process that have actually been troublesome. We conducted therefore a survey among medical researchers of study protocols approved by a Swiss REC to assess the frequencies and types of difficulties experienced, and to examine factors associated with the occurrence of difficulties.

Methods

Setting

We defined medical researchers as principal investigators (PIs) of study protocols approved by the REC of the Geneva University Hospitals, Switzerland between January 1, 2001 and December 31, 2005. The Geneva University Hospitals is a single 1800-bed public teaching hospital, covering the entire range of medical disciplines, with eight sites across the Geneva region. About 1200 research protocols are currently signaled as ongoing by the REC.

Study design and questionnaire

We conducted a cross-sectional survey among PIs of the selected protocols. We sent them a self-administered online questionnaire between November and December 2010, followed by two reminders. We asked PIs to answer one questionnaire for each separate protocol approved by the REC, identified by its title. The questionnaire had been pre-tested previously among of 12 medical researchers who were not part of the study. We asked PIs to report if the study was completed (defined as recruitment, data collection and analysis completed, whatever the study is published or not) or not (ongoing or abandoned) and whether they had received training in quantitative methods (none, continuing education at the University level, or bachelor/master/PhD in quantitative methods) at the time of the submission to the REC. If the study was completed, we asked PIs to state if they encountered any of 14 specific difficulties in the course of research (Fig. 1) on the following scale of difficulty: none, minor, medium, great, very great, or not applicable. Based on a review of the literature, a group of experts including methodologists (AGA, GH, SC, TA, TVP) and biostatisticians (DSC and Dr. Christophe Combescure, see acknowledgements) identified these 14 difficulties in conducting clinical research. The results from the pre-test with medical researchers suggested the difficulties were clearly described. “Other difficulties” could be reported in a fifteenth item as free text. We did not invite PIs to rate their difficulties with ongoing studies, as we wanted to include only hindsight evaluations of experience. We also asked PIs whether the results of the study were published or “in press”, to provide the reference in an open field, and also whether they had papers in submission or in preparation; for the latter studies, we updated the database by identifying relevant papers published up to November 2013 (PubMed search).

Fig. 1
figure 1

Self-reported difficulties* (rated as medium or great or very great) in clinical research among principal investigators (N = 386)

Full size image

We identified characteristics of study protocols using information recorded in the archives of the REC. We abstracted data on study design (interventional, observational), first decision of the REC (positive, positive with recommendations, positive with written modifications required, positive with conditions and reassessment, negative, and not considered), public vs. private sponsorship of the study (i.e. hospital or university vs. industry or private foundation), link with the industry (none, industry with indication of support, industry without indication of support), planned sample size (later dichotomized as up to 100 vs. larger), reporting of sample size calculation (yes, no), number of centers (single versus multi center), clinical specialty (oncology, neurology, infectious disease, rheumatology, psychiatry, cardiology, general, other specialties, combination of two specialties), and presence of a statistician on study team (yes, no). The category “Other specialties” included all other specialties distributed across the medical services of the Geneva University Hospitals (65 medical services), or studies with no clear clinical specialty. We classified the type of research conducted into the following seven groups: study of health or illness (i.e., organs, tissues, cells, receptors, etc.), interventional or treatment, diagnosis, prognosis, public health or health economics or opinions or perceptions, study methods, and other. We also dichotomized this variable in study protocols informing clinical questions (i.e., interventional/treatment, diagnostic and prognostic studies) versus other types of research (i.e., studies of health/illness, public health, study methods, and other).

Dependent variables

In the survey among PIs, each of the 14 items of self-reported difficulties was dichotomized into medium, great or very great difficulty (1) versus no or minor difficulty (0). When PIs answered “not applicable”, the value “0” (no difficulty) was assigned, because we considered not applicable difficulties as an absence of difficulty. The fifteenth item for “other difficulty(ies)” was followed by an open field for description. Some free-text responses from this item were similar to the other 14 difficulties already defined. One co-author (SC) recoded the text responses into the pre-defined difficulties and another co-author (TP) checked the recoding. Eight free-text responses were re-classified and 41 remained in the “other” category.

Dichotomized self-reported difficulties were used to calculate sums of difficulties for each study and then to compare mean numbers of difficulties across study characteristics.

We defined three dependent variables. The first was a score summing all difficulties across the whole research process. We then classified the 14 difficulties into dimensions using factor analysis with varimax rotation (for a complete description, see Additional file 1: Appendix 1). The analysis suggested two dimensions of seven difficulties each: a dimension related to “scientific difficulties” (literature review, research question, study design, data management, data analysis, manuscript writing, publication in a peer-reviewed journal) and a dimension related to “logistical difficulties” (approval by the REC, getting funding, getting approval by safety agencies, patient enrollment, data collection, collaboration with caregivers for patient enrollment, recruiting competent staff). Dimension scores based on the sum of corresponding items were the second and third dependent variables. Both had adequate internal consistency, with a Cronbach alpha coefficient of 0.83 for scientific difficulties and 0.73 for logistical difficulties.

Sample size calculation

The analysis of difficulties encountered by researchers was a secondary objective of this study. The primary objective of this study was concerned with publication of clinical studies (manuscript in preparation) and sample size was determined with regard to the primary objective. However, a sample size of 400 protocols yielded the following precision (exact 95 % confidence interval) in the estimation of prevalence for a given difficulty: 5.0 % (3.1 to 7.6 %), 10.0% (7.2 to 13.4 %), 20 % (16.2 to 24.3 %), 30% (25.5 to 34.8 %), and 40 % (35.2 to 45.0 %). A comparison of means of 2 groups of 200 observations each would allow for the detection of a small effect size (0.28) with an alpha of 0.05 and a power of 80 %.

Statistical analysis

The unit of analysis was the study protocol. We treated the three dependent variables (sum of all difficulties, sum of scientific difficulties and sum of logistical difficulties) as continuous. We first compared the means across the study characteristics using one-way ANOVA. Then a linear regression model was constructed to predict the mean scores of difficulties using predictors that were statistically significant in univariable analysis (at p ≤ 0.05). We conducted all analyses with SPSS version 22.0 (IBM Corporation, Armonk, United States).

Results

Sample

Among the 996 study protocols, 588 questionnaires were returned by the PIs (participation rate 59.0 %). Among these 588 studies, 391 (66.5 %) were completed at the time of the survey, 96 (16.3 %) were still ongoing and 101 (17.2 %) had been abandoned.

More than three of four completed protocols were sponsored by a public institution, about two thirds were published, a majority was single center studies, and about half were observational studies (Table 1). The median of the sample sizes was 100 (mean 591, interquartile range 260, range 1 to 25,000) and a majority of study protocols did not report sample size calculation. Study protocols reporting a sample size calculation had more often a sample size above the median compared to study protocols that did not (60.9 % versus 30.4 %, p-value <0.001). Almost three protocols out of four did not have a statistician in the study team. Most PIs reported training in quantitative methods – courses or continuing education or a University degree –at the time of the protocol submission to the REC.

Table 1 Characteristics of the 391 completed studies with follow-up questionnaire returned
Full size table

For 408 study protocols the questionnaire was not returned by the PI. Information on these 408 studies was collected using their study protocol stored in the archives of the REC. More than seven of ten studies had no statistician in the study team, around two third had public funding, and the majority had no link with the industry, were single center studies, were unpublished and had an interventional design (Additional file 1: Appendix 2). The median sample size was 100 (mean 973, interquartile range 321, range 3 to 136,000) and a majority of study protocols did not justify sample size. Compared with included studies, studies with no questionnaire had higher proportions of interventional studies, private sponsorship, link with the industry and were more frequently unpublished.

Difficulties in clinical research and associated study characteristics

Levels of difficulties are reported in Fig. 1: patient enrollment and data collection were the most frequently reported. The mean number of difficulties was 2.8 (standard deviation (SD) 2.8, min 0, max 12); 26.4 % of PIs reported no difficulty and 18.7 % reported one difficulty only (Additional file 1: Appendix 3). The mean number of scientific difficulties was 1.1 (SD 1.7, min 0, max 7) and the mean number of logistical difficulties was 1.6 (SD 1.6, min 0, max 7).

In univariable analysis, study protocols sponsored by a public institution (hospital or University) and single center studies encountered more difficulties overall and more scientific difficulties in particular (Table 2). Compared to interventional designs, observational designs encountered more scientific difficulties, but fewer logistical difficulties. The presence of a statistician in the study team was associated with fewer scientific difficulties. Study protocols informing clinical questions (i.e., interventional, diagnostic or prognostic studies) were associated with more logistical difficulties compared to other types of research (studies of health/illness, public health, study methods, etc.). The same applied to the first REC decision: study protocols whose first REC decision either required an additional assessment or was negative (including non-consideration) reported more logistical difficulties compared to study protocols that received a positive first decision.

Table 2 Univariable associations (one-way ANOVA) with mean number of difficulties in clinical research
Full size table

In multivariable analysis, study design, first decision of the REC and the presence of a statistician on the study team were not associated with a higher number of difficulties (Additional file 1: Appendix 5) while several risk factors remained significantly associated. In a parsimonious model (Table 3), publicly sponsored and single center studies were associated with more difficulties overall and more scientific difficulties. Studies informing clinical questions were associated with higher number of difficulties overall and with more logistical difficulties.

Table 3 Multivariable linear regression of sum of difficulties in clinical research
Full size table

Specific difficulties by risk factors

The three study characteristics from the above multivariate model (private vs. public, multi vs. single center and “clinical” vs. other) were cross-tabulated with specific difficulties (Table 4). Compared to publicly sponsored studies, studies initiated by a private sponsor experienced fewer difficulties with the research question, study design, obtaining funding, data management, data analysis and interpretation, manuscript writing, and publication in a peer-reviewed journal. Similar results were observed when multi center studies were compared to single-center studies. Publicly sponsored studies and single center studies experienced fewer difficulties concerning the approval by safety agencies, however more difficulty with getting approval from the REC.

Table 4 Difficulties in clinical research by study characteristicsa
Full size table

Furthermore, studies informing clinical questions reported more difficulties with approval by safety agencies or with patient enrollment. Non-clinical studies reported more difficulties with the formulation of the research question.

Discussion

The present study describes difficulties experienced in the course of a specific study by a broad sample of medical researchers at a Swiss university hospital. The main finding is that patient enrollment posed a significant difficulty to 44 % of study protocols, and data collection posed difficulty to 27 % of them. In other words, logistical aspects of the research process seem to be the major sources of problems in medical research. In contrast, formulating the research question and performing the literature review were less likely to be an issue for medical researchers. Across the whole research process, medical researchers experienced on average three (2.8) of 14 difficulties and only one out of four reported no difficulty at all in conducting their study.

In a previous study investigating perceived barriers in general, a majority of medical researchers reported numerous obstacles in conducting research [19]. We found lower prevalence rates, probably because we assessed difficulties in a given study, and not over the career of a researcher. Furthermore, we only included completed studies, which did therefore not encounter a “fatal” problem.

The correlations between 14 types of difficulties suggested two distinct dimensions: first, problems with the logistics of a study, from funding to patient enrollment and research personnel issues; second, scientific problems. Thus, different kinds of interventions are probably needed to facilitate the conduct of clinical research. Logistical problems could be alleviated by a core facility that would provide administrative support, fund-raising assistance, and qualified research associates. Scientific problems could be solved by the provision of statistical assistance and methodological training of clinical researchers. Such interventions have been implemented with success in other settings [36]. It should be noted that such structures were set up only in 2007 at the hospital under study, most likely too late to have any major influence on the course of research protocols approved between 2001 and 2005. The provision of statistical assistance may also have various impacts on the number of patients to enroll [37]: one the one hand, statistical assistance could increase the sample size at the stage of designing the study; on the other hand, statistical assistance could help medical researchers determine the smallest necessary sample size. Thus, it is uncertain whether the provision of statistical assistance would reduce or increase logistical problems. In our results (multivariable model), a statistician in the team was not associated with logistical difficulties.

Studies initiated by a public sponsor (hospital or university) as well as single center studies were associated with more difficulties compared to those with private sponsor or those multi center: these associations were significant for the overall and the scientific scores, but not for the logistical score. When the study protocol came from a public sponsor and when it was a single center study, it is more likely that the PI was in charge of most steps, from conception to publication. In contrast, many of these tasks are typically not conducted by hospital based PIs when study protocols are initiated by the industry.

Investigators of studies addressing clinical questions also encountered more logistical difficulties, probably because they need to enroll and collect data from patients. Most often, patient recruitment is conducted in parallel to the delivery of healthcare, thus requiring complex and numerous interactions with healthcare providers. Although as many as 72 % of patients invited to take part in a clinical study in our institution accept to do so [38], a better coordination of projects enrolling similar patients in parallel might facilitate recruitment. Other challenges relate to the patients’ willingness to participate, which will depend on personal factors (such as level of education), but also on the attributes of the study. As shown in a previous work, patients are more willing to participate in studies that explicitly value safety, convenience, appropriate oversight, and open communication [39].

In contrast with other surveys [18, 19], we found that getting funding did not represent a significant barrier in conducting clinical research. Three explanations can be considered: first, we surveyed medical researchers about completed studies (which were all funded), while other surveys assessed the general opinion of medical researchers. Second, Switzerland is a relatively favorable country for conducting research: between 2000 and 2008, the funding for research and development increased from 2.5 % of the gross domestic product to 3.0 % [40]. Third, in some cases, clinical studies can be conducted without external funding when benefiting from non-financial support of the hospital.

Another result worth noting is the similarity in the average number of difficulties encountered by PI trained in quantitative methods compared to those not trained in these methods. Training in quantitative methods probably has limited impact on logistical issues; however we expected an impact on scientific issues. It is possible that trained investigators design and conduct more complex or ambitious studies, thus facing a similar absolute number of challenges, yet at a more advanced level.

More than one fourth (26.4 %) of study protocols were conducted without difficulties. More research on these study protocols, using qualitative methods, could add evidence on the facilitating factors for conducting clinical research.

Limitations

This study has several limitations. First, it was carried out at a single Swiss university hospital and we do not know to what extent the findings apply to other settings. Second, we only surveyed PIs of completed clinical studies, which may have decreased the apparent prevalence of major difficulties, because abandoned clinical studies [25, 29] may have experienced more difficulties. Third, PIs’ answers may have been affected by various recall biases [38]. Social desirability may also have influenced responses, considering that the investigators in charge of the present study belong to the same institution as the surveyed PIs. Fourth, the scale of difficulties (and the two subscales, logistic and scientific difficulties) was built for the purpose of this study, based on literature review and expert consensus. We have no evidence of their validity beyond face validity, though their reliability was acceptable (Cronbach alpha between 0.73 and 0.83). Moreover, among the 14 items composing the scale, four items (getting funding, data collection, recruitment of competent staff to conduct the study, and data management) shared variance on both subscales (see Additional file 1: Appendix 1). Fifth, the analysis of studies with no questionnaire suggested some evidence for non-response bias: undocumented studies were more frequently interventional studies, with industry sponsorship, and unpublished.

Conclusions

Patient enrollment and logistical problems topped the list of difficulties. Clinical studies and single-center studies were at higher risk of experiencing logistical difficulties. Providing both logistical and methodological support to researchers may facilitate the conduct of research projects.

Ethical approval

This study was approved by the REC of the Geneva University Hospitals.

Availability of data and materials

The data are not available online but can be requested to the corresponding author.

Abbreviations

REC:

Research Ethics Committee

PIs:

principal investigators

SD:

standard deviation

References

  1. Montori VM, Guyatt GH. Progress in evidence-based medicine. JAMA. 2008;300(15):1814–6.

    Article  CAS  PubMed  Google Scholar 

  2. Cook DJ, Blythe D, Rischbieth A, Hebert PC, Zytaruk N, Menon K, Erikson S, Fowler R, Heels-Ansdell D, Meade MO. Enrollment of intensive care unit patients into clinical studies: a trinational survey of researchers’ experiences, beliefs, and practices. Crit Care Med. 2008;36(7):2100–5.

    Article  PubMed  Google Scholar 

  3. Agustin C, Grand M, Gebski V, Turner S. Radiation therapists’ perspective on barriers to clinical trials research. J Med Imaging Radiat Oncol. 2008;52(2):178–82.

    Article  CAS  PubMed  Google Scholar 

  4. De Vito C, Nobile CG, Furnari G, Pavia M, De Giusti M, Angelillo IF, Villari P. Physicians’ knowledge, attitudes and professional use of RCTs and meta-analyses: A cross-sectional survey. Eur J Public Health. 2009;19(3):297–302.

    Article  PubMed  Google Scholar 

  5. Al Omari M, Khader Y, Jadallah K, Dauod AS, Al-shdifat AAK, Khasawneh NM. Evidence-based medicine among hospital doctors in Jordan: awareness, attitude and practice. J Eval Clin Pract. 2009;15(6):1137–41.

    Article  PubMed  Google Scholar 

  6. Businger A, Kaderli R, Sommer C, Furrer M, Villiger P. Interest in a national research network in surgery in Switzerland. Swiss Med Wkly. 2011;141:w13295.

    PubMed  Google Scholar 

  7. Stewart RD, Doyle J, Lollis S, Stone MD. Surgical resident research in new england. Arch Surg. 2000;135(4):439–44.

    Article  CAS  PubMed  Google Scholar 

  8. Dev A, Kauf T, Zekry A, Patel K, Heller K, Schulman K, McHutchison J. Factors influencing the participation of gastroenterologists and hepatologists in clinical research. BMC Health Serv Res. 2008;8(1):208.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Al-Dorzi HM, Naidu B, Khokhar S, White D, Arabi YM. Research experience, interest and perceived barriers of clinical staff working at the Intensive Care Department of a tertiary care academic hospital in Saudi Arabia. Middle East J Anesthesiol. 2013;22(3):301–7.

    PubMed  Google Scholar 

  10. Karlsson U, Törnquist K. What do Swedish occupational therapists feel about research? A survey of perceptions, attitudes, intentions, and engagement. Scand J Occup Ther. 2007;14(4):221–9.

    Article  PubMed  Google Scholar 

  11. Perneger TV, Ricou B, Boulvain M, Bovier PA, Herrmann FR, Perrier A, Burnand B. Medical researchers evaluate their methodological skills. J Clin Epidemiol. 2004;57(12):1323–9.

    Article  PubMed  Google Scholar 

  12. Estellat C, Faisy C, Colombet I, Chatellier G, Burnand B, Durieux P. French academic physicians had a poor knowledge of terms used in clinical epidemiology. J Clin Epidemiol. 2006;59(9):1009–14. e1004.

    Article  PubMed  Google Scholar 

  13. Rosenberg LE. Physician-Scientists--Endangered and Essential. Science. 1999;283(5400):331–2.

    Article  CAS  PubMed  Google Scholar 

  14. Ley TJ, Rosenberg LE. The physician-scientist career pipeline in 2005: Build it, and they will come. JAMA. 2005;294(11):1343–51.

    Article  CAS  PubMed  Google Scholar 

  15. Rangel SJ, Moss RL. Recent trends in the funding and utilization of NIH career development awards by surgical faculty. Surgery. 2004;136(2):232–9.

    Article  PubMed  Google Scholar 

  16. Garrison HH, Deschamps AM. NIH research funding and early career physician scientists: continuing challenges in the 21st century. FASEB J. 2014;28(3):1049–58.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Evaluation Panel: Clinical Research in Finland and Sweden. Evaluation report. In. Helsinki: Academy of Finland, http://www.aka.fi/globalassets/awanhat/documents/tiedostot/julkaisut/05_09-clinical-research.pdf, Accessed Nov 2015; 2009.

  18. Dickler HB, Fang D, Heinig SJ, Johnson E, Korn D. New physician-investigators receiving national institutes of health research project grants: A historical perspective on the “endangered species”. JAMA. 2007;297(22):2496–501.

    Article  CAS  PubMed  Google Scholar 

  19. Karimian Z, Sabbaghian Z, Salehi A, Sedghpour BS. Obstacles to undertaking research and their effect on research output: a survey of faculty members’ views at Shiraz University of Medical Sciences. East Mediterr Health J. 2012;18(11):1143–50.

    CAS  PubMed  Google Scholar 

  20. Green LA, Lowery JC, Kowalski CP, Wyszewianski L. Impact of Institutional Review Board Practice Variation on Observational Health Services Research. Health Serv Res. 2006;41(1):214–30.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Greene SM, Geiger AM. A review finds that multicenter studies face substantial challenges but strategies exist to achieve Institutional Review Board approval. J Clin Epidemiol. 2006;59(8):784–90.

    Article  PubMed  Google Scholar 

  22. McWilliams R, Hoover-Fong J, Hamosh A, Beck S, Beaty T, Cutting G. Problematic Variation in Local Institutional Review of a Multicenter Genetic Epidemiology Study. JAMA. 2003;290(3):360–6.

    Article  PubMed  Google Scholar 

  23. Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to Participation in Randomised Controlled Trials: A Systematic Review. J Clin Epidemiol. 1999;52(12):1143–56.

    Article  CAS  PubMed  Google Scholar 

  24. Scherer RW, Langenberg P, von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev 2007(2):MR000005.

  25. Kasenda B, von Elm E, You J, Blumle A, Tomonaga Y, Saccilotto R, Amstutz A, Bengough T, Meerpohl JJ, Stegert M, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311(10):1045–51.

    Article  CAS  PubMed  Google Scholar 

  26. Easterbrook PJ, Matthews DR. Fate of research studies. J R Soc Med. 1992;85(2):71–6.

    CAS  PubMed  PubMed Central  Google Scholar 

  27. Haidich A-B, Ioannidis JPA. Effect of Early Patient Enrollment on the Time to Completion and Publication of Randomized Controlled Trials. Am J Epidemiol. 2001;154(9):873–80.

    Article  CAS  PubMed  Google Scholar 

  28. Dirk L. From Laboratory to Scientific Literature: The Life and Death of Biomedical Research Results. Sci Commun. 1996;18(1):3–28.

    Article  Google Scholar 

  29. Rosenthal R, Kasenda B, Dell-Kuster S, von Elm E, You J, Blumle A, Tomonaga Y, Saccilotto R, Amstutz A, Bengough T et al: Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study. Ann Surg. 2015;262(1):68-73.

  30. Ioannidis JPA. Effect of the Statistical Significance of Results on the Time to Completion and Publication of Randomized Efficacy Trials. JAMA. 1998;279(4):281–6.

    Article  CAS  PubMed  Google Scholar 

  31. Blumle A, Antes G, Schumacher M, Just H, von Elm E. Clinical research projects at a German medical faculty: follow-up from ethical approval to publication and citation by others. J Med Ethics. 2008;34(9):e20.

    Article  CAS  PubMed  Google Scholar 

  32. Wise P, Drury M. Pharmaceutical trials in general practice: the first 100 protocols. An audit by the clinical research ethics committee of the Royal College of General Practitioners. BMJ. 1996;313(7067):1245–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Decullier E, Chan A-W, Chapuis F. Inadequate Dissemination of Phase I Trials: A Retrospective Cohort Study. PLoS Med. 2009;6(2):e1000034.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Haidich A-B, Ioannidis J. Determinants of patient recruitment in a multicenter clinical trials group: trends, seasonality and the effect of large studies. BMC Med Res Methodol. 2001;1(1):4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. West CP, Ficalora RD. Clinician Attitudes Toward Biostatistics. Mayo Clin Proc. 2007;82(8):939–43.

    Article  PubMed  Google Scholar 

  36. Rothberg MB, Kleppel R, Friderici JL, Hinchey K. Implementing a resident research program to overcome barriers to resident research. Acad Med. 2014;89(8):1133–9.

    Article  PubMed  Google Scholar 

  37. Adams-Huet B, Ahn C. Bridging Clinical Investigators and Statisticians: Writing the Statistical Methodology for a Research Proposal. J Investig Med. 2009;57(8):818–24.

    PubMed  PubMed Central  Google Scholar 

  38. Rothman KJ, Greenland S, Lash TL. Modern Epidemiology. Philadelphia: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2008.

    Google Scholar 

  39. Agoritsas T, Deom M, Perneger TV. Study design attributes influenced patients’ willingness to participate in clinical research: a randomized vignette-based study. J Clin Epidemiol. 2011;64(1):107–15.

    Article  PubMed  Google Scholar 

  40. Plaza Chardon S, Sollberger P: R-D suisse en 2008. Efforts soutenus des entreprises privées et des hautes écoles. In. Neuchâtel: Federal Statistical Office, http://www.bfs.admin.ch/bfs/portal/fr/index/news/publikationen.html?publicationID=3961; 2010. Accessed Sept 2014

Download references

Acknowledgements

The authors wish to thank Prof. Pierre Dayer of the Geneva University Hospitals for his support in conducting this research. The authors also thank Céline Getaz and Kristina Bagamery who collected the data in the archives of the REC, Catherine Ullmer, REC of Geneva University Hospitals, for her assistance with the REC archives. Finally, the authors express special thanks to the doctors who participated to the pre-test of the survey questionnaire.

The authors thank Christophe Combescure and Antoine Poncet, biostatisticians at the Division of Clinical Epidemiology, Geneva University Hospitals, for their help during the conduct of this project.

Funding

No.

Disclosure of funding

None.

Author information

Authors and Affiliations

  1. Division of Clinical Epidemiology, Geneva University Hospitals, University of Geneva, Rue Gabrielle Perret-Gentil 6, CH–1211, Geneva 14, Switzerland

    Stéphane Cullati, Delphine S. Courvoisier, Angèle Gayet-Ageron, Guy Haller, Thomas Agoritsas, Sandrine Rudaz & Thomas V. Perneger

  2. Division of Anesthesia, Department of Anesthesiology, Pharmacology and Intensive Care, Geneva University Hospitals, Geneva, Switzerland

    Guy Haller

  3. Department of Gynecology and Obstetrics, Geneva University Hospitals, Geneva, Switzerland

    Olivier Irion

  4. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Canada

    Thomas Agoritsas

Authors
  1. Stéphane Cullati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Delphine S. Courvoisier
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Angèle Gayet-Ageron
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guy Haller
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Olivier Irion
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Thomas Agoritsas
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sandrine Rudaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Thomas V. Perneger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stéphane Cullati.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SC planned the study, managed the data collection, analyzed the data, interpreted the results, and wrote the manuscript. DC planned the study, managed the data collection, interpreted the results, and revised the manuscript. AGA planned the study, interpreted the results, and revised the manuscript. GH planned the study, interpreted the results, and revised the manuscript. OI planned the study, revised the manuscript. TA planned the study, interpreted the results, and revised the manuscript. SR planned the study, managed the data collection, interpreted the results, and revised the manuscript. TP planned the study, managed the data collection, interpreted the results, and revised the manuscript. All authors approved the manuscript.

Additional file

Additional file 1:

Appendix 1. Components of factor analysis, with varimax rotation. Appendix 2 Characteristics1 of the 408 studies with no follow-up questionnaire returned, and differences with included studies. Appendix 3 Number of self-reported difficulties* in clinical research by study protocol. Appendix 4 Spearman correlation matrix for sum of difficulties in clinical research and study characteristics. Appendix 5 Full model of sum of difficulties in clinical research by study characteristics (Multivariable linear regression). (DOCX 26 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cullati, S., Courvoisier, D.S., Gayet-Ageron, A. et al. Patient enrollment and logistical problems top the list of difficulties in clinical research: a cross-sectional survey. BMC Med Res Methodol 16, 50 (2016). https://doi.org/10.1186/s12874-016-0151-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-016-0151-1

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us