Obtaining and managing data sets for individual participant data meta-analysis: scoping review and practical guide
BMC Medical Research Methodology volume 20, Article number: 113 (2020)
Shifts in data sharing policy have increased researchers’ access to individual participant data (IPD) from clinical studies. Simultaneously the number of IPD meta-analyses (IPDMAs) is increasing. However, rates of data retrieval have not improved. Our goal was to describe the challenges of retrieving IPD for an IPDMA and provide practical guidance on obtaining and managing datasets based on a review of the literature and practical examples and observations.
We systematically searched MEDLINE, Embase, and the Cochrane Library, until January 2019, to identify publications focused on strategies to obtain IPD. In addition, we searched pharmaceutical websites and contacted industry organizations for supplemental information pertaining to recent advances in industry policy and practice. Finally, we documented setbacks and solutions encountered while completing a comprehensive IPDMA and drew on previous experiences related to seeking and using IPD.
Our scoping review identified 16 articles directly relevant for the conduct of IPDMAs. We present short descriptions of these articles alongside overviews of IPD sharing policies and procedures of pharmaceutical companies which display certification of Principles for Responsible Clinical Trial Data Sharing via Pharmaceutical Research and Manufacturers of America or European Federation of Pharmaceutical Industries and Associations websites. Advances in data sharing policy and practice affected the way in which data is requested, obtained, stored and analyzed.
For our IPDMA it took 6.5 years to collect and analyze relevant IPD and navigate additional administrative barriers. Delays in obtaining data were largely due to challenges in communication with study sponsors, frequent changes in data sharing policies of study sponsors, and the requirement for a diverse skillset related to research, administrative, statistical and legal issues.
Knowledge of current data sharing practices and platforms as well as anticipation of necessary tasks and potential obstacles may reduce time and resources required for obtaining and managing data for an IPDMA. Sufficient project funding and timeline flexibility are pre-requisites for successful collection and analysis of IPD. IPDMA researchers must acknowledge the additional and unexpected responsibility they are placing on corresponding study authors or data sharing administrators and should offer assistance in readying data for sharing.
A meta-analysis aims to combine findings from different studies to obtain a more precise estimate of the average effect of an intervention or the size of an association, or to explore how and why results differ across studies . There are several ways of synthesizing study data [2, 3]. Generally, a meta-analysis may combine study level data or individual participant level data. Study level meta-analyses combine estimates from multiple studies to generate a summary estimate. Individual participant data (IPD) meta-analyses (MA) combine data from each specific participant from multiple studies into a single dataset for further analysis . IPDMA are considered the “gold standard” [5,6,7,8,9] and possibly preferred to study level meta-analyses because they allow researchers to use the most current and comprehensive data, verify the findings of previous investigations, apply uniform definitions and analyses across studies, and avoid potential ecological bias when investigating interactions between interventions and patient-level characteristics (effect modifications, subgroup effects) [7, 8, 10,11,12]. Similar to systematic reviews and study level meta-analyses, IPDMAs often influence practice guidelines and the design of new trials [13, 14].
Ideally, an IPDMA should be based on IPD from all studies included in a systematic review, regardless of the study designs chosen for the systematic review . An IPDMA can be conducted on data from randomized trials, observational studies, including registries, and other study designs although there are risks and challenges in combining these different study designs. However, fewer than half of systematic reviews with IPDMA, published between 1987 and 2015, retrieved data from at least 80% of relevant studies and from at least 80% of relevant participants . The number of IPDMAs increased over this period , but data retrieval rates remained unchanged [16, 18]. Inability to include eligible studies compromises the systematic review’s purpose, decreases study power, and leads to healthcare decisions based on an incomplete, potentially biased data sample (studies with available data may differ from those whose data are not available) [10, 19, 20]. However, analysis combining individual and study level data may mitigate these effects [3, 21].
Since the first IPDMA guide published in 1995 , researchers have found that the process of obtaining, managing, and organizing IPD is typically the most resource intensive and time consuming step and may require years to complete [1, 4, 7, 16, 22]. Thus, many systematic reviews rely on study level data even though sharing IPD and conducting IPDMA would be more useful [8, 20, 23,24,25,26,27,28,29,30,31].
Study participants have also understood the benefits of data sharing and are generally willing for this to happen, but may fear the loss of data confidentiality, misuse, or sharing without consent [32,33,34,35]. Governments [36, 37], research organizations [38,39,40], scientific journals [38, 41,42,43,44,45,46] and the pharmaceutical industry [47, 48] have developed data sharing policies. The Institute Of Medicine (IOM) has released four recommendations to guide responsible data sharing : (1) maximize the benefits of clinical trials while minimizing the risks of sharing clinical trial data, (2) respect individual participants whose data are shared, (3) increase public trust in clinical trials and the sharing of trial data, and (4) conduct the sharing of clinical trial data in a fair manner. In July 2013, amid some criticism [50, 51], the European Federation of Pharmaceutical Industries and Associations (EFPIA) and the Pharmaceutical Research and Manufacturers of America (PhRMA) issued a joint statement describing the principles of responsible data sharing . Several pharmaceutical companies and academic institutions are now working to handle data sharing requests in a more timely, better organized, and increasingly transparent manner by using the services of independent data sharing platforms or creating their own [52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76].
Based on a review of the literature and our own experience with conducting IPDMAs, our goal was to provide practical guidance for researchers to successfully obtain IPD of eligible studies and to reduce resources required for IPDMA. We describe the key challenges and propose solutions to navigate obstacles commonly associated with IPDMA in the light of recent changes in data sharing policy and practice [16, 47, 77].
Search strategy and inclusion criteria
After delays during data acquisition for our recent IPDMA of the use heparin in patients with cancer , we noticed changes in data sharing policy and practice [47, 78] in clinical trial data access and began to log our setbacks and solutions. We then conducted systematic searches of MEDLINE, Embase, and the Cochrane Library (from inception of each database until January 2019) to identify publications describing strategies to obtain IPD or IPDMA best practice. An experienced research librarian helped design a comprehensive search strategy using MeSH terms and text words (Additional file 1) without any language restrictions.
Eligibility criteria included (1) articles describing IPDMA best practice including topics such as planning, cost, required time, common burdensome tasks, or administrative issues; (2) systematic reviews describing trends in IPDMA including topics such as IPD retrieval rates; (3) quantitative or qualitative studies describing strategies, barriers, or facilitators to obtain IPD from industry or investigator-sponsored studies; and (4) case reports describing authors’ attempts to obtain IPD. We excluded IPDMAs reporting on a specific clinical question or statistical papers, e.g. studies describing different techniques of combining IPD with study level data.
Two methodologically trained reviewers (MV and VG) independently screened titles and abstracts. If eligibility was suspected or unclear, we obtained full texts. Three reviewers (MV, MB, VG) screened full texts independently and in duplicate. Disagreements were resolved by discussion and consensus. From included articles we extracted information providing practical guidance for researchers to successfully obtain IPD and to make the conduct of IPDMA more efficient. Our scoping review adheres to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines .
Several publications examining specific data sharing issues outside of the context of an IPDMA (e.g. data sharing models or author reimbursement in general) did not meet the inclusion criteria for the scoping review but were referenced to provide additional context. In addition, we searched websites of pharmaceutical companies which have publicly certified with PhRMA or EFPIA as having complied with the Principles for Responsible Data Sharing , data repositories [52, 76, 80], and industry organizations [81, 82] for press releases and other information about policies for sharing IPD. Finally, we drew from the authors’ experiences in providing, seeking, or using IPD - in particular, a recently conducted IPDMA investigating heparin use among cancer patients . Based on the systematically identified literature, policy websites, and our own experience we developed practical guidance for IPDMA researchers that we structured according to the course of tasks when conducting an IPDMA.
The systematic search of our scoping review yielded 3470 titles and abstracts (Fig. 1). We identified 16 eligible articles that are presented in Table 1 together with a short description. In Table 2 we summarize our main recommendations for researchers when retrieving data sets for IPDMAs and provide corresponding explanations and elaborations in the following sections.
Identifying relevant studies
A sensitive search for all eligible studies, published and unpublished, is crucial for all systematic reviews to minimize publication bias . Cochrane provides useful techniques to identify and obtain published as well as unpublished study data [15, 134]. Trial registries or regulatory bodies may be instrumental in identifying unpublished eligible studies and constitute an initial contact point (e.g. corresponding author or data sharing administrator) for data sharing requests. See Additional file 1 for detailed information about the International Clinical Trials Registry Platform and Additional file 1 on the United States Food and Drug Administration and the European Medicines Association. In principle, there are two approaches to obtain IPD: (1) direct contact with study authors, or (2) requests via a data repository .
The data collection process of our own IPDMA occurred between October 2012 and June 2016 . All data requests were placed by contacting study authors except for two of the 19 studies, which we learned by reviewing each organization’s data sharing policies, required use of the online data request portal clinicalstudydatarequest.com (CSDR). For all studies, we requested access to the clinical trial data, meta-data, study protocol, annotated case report forms, and clinical study report.
Requesting study data through personal contact
Analysis of data sharing requests submitted solely through study authors indicates that 58% of requests are successful . Qualitative research examining useful techniques to obtain unpublished data indicates that concise, friendly requests which minimize additional responsibilities (e.g. drafting a data sharing agreement, converting old datasets to digital format) for the primary study author and attempt to establish a personal connection would be more likely to receive a response . IPDMA authors typically attempt contact several times before quitting; the most persistent tried every 6 months for 2 to 3 years [130, 131, 136, 137]. From our own experience, obtaining data sets through personal contact required as little as 4 months and as much as 4 years. Every corresponding author or study sponsor responded to our request; but we made repeated contact attempts via email, fax or phone. In some cases, we reviewed the institution’s data sharing request policy to identify additional data sharing contacts (eg. organizational email address such as datasharing@Amgen.com) or alternative request procedures (eg. submitting a request through an independent data repository such as clinicalstudydatarequest.com). A description of our approach to correspondence and a sample email request are available in Table 3 and Additional file 1, respectively. Email correspondence is often fragmented and delayed. Organizing phone or in-person meetings, e.g. at conferences, was often useful when explaining the IPDMA’s purpose and anticipated tasks to study authors before any data was shared and whenever detailed discussions of complicated issues (e.g. security of data storage servers) was necessary. These conversations also led to the development of personal relationships with study authors which we felt eased correspondence throughout the data sharing and analysis process.
Primary authors may lack time, funding, or organizational resources to support essential data sharing tasks (e.g. transferring data to an electronic format, drafting data sharing agreement). Our IPDMA research team offered assistance with these tasks whenever possible. Recording contact information and roles of data sharing stakeholders (e.g. administrators, statisticians, industry liaisons, ethical and legal representatives) is essential. This eased subsequent communication which often occurred years after the first data request as the IPDMA progressed to publication.
Requesting study data via data repository or data sharing administrator
In our IPDMA, two datasets were requested and approved through CSDR, a consortium of clinical study sponsors and funders which facilitates responsible data sharing . IPDMA authors may be required to directly contact a data repository or data sharing administrator and submit a full study proposal rather than make a simple inquiry . Initially, we reviewed the list of studies with data available to be requested but neither dataset was available from the study’s sponsor. For one study, the sponsor had not yet properly curated the data. Despite this, we contacted CSDR via email, followed by a teleconference, and this process was expedited at our request. For the second, the study sponsor was in the process of establishing a presence on CSDR and shared data after doing so.
In our experience, the process of submitting data requests on CSDR takes approximately 30 to 60 min; it was intuitive, and directions were available [78, 140]. Our request package identified the specific study by the title and National Clinical Trial number and included our study protocol, timeline, funding sources, description of research team members’ experience and roles, conflicts of interest, and publication plans. Knowledge of jurisdictional laws (e.g. Personal Information Protection and Electronic Documents Act and General Data Protection Regulation) and collaboration with legal representatives was required before submitting data sharing requests and while negotiating data sharing agreements. Approximately 4 months were needed to process each data sharing request and finalize the data sharing agreement, consistent with CSDR estimates [120, 141]. After finalizing the data sharing agreement, our questions pertaining to data sharing processes or system technical difficulties were typically responded to within 1 day.
As of December 31, 2019, 1429 requests were made for data on CSDR which were not listed by the study’s sponsors; 559 submissions were approved and 843 denied, while 51 are still under consideration . Of companies which have received at least 40 requests for non-listed studies, the reported lowest percentage of approval is 9%, (Eisai), and the highest 74% (GlaxoSmithKline) . Geifman et al. reported the data request process via CSDR to be unnecessarily lengthy, while requests submitted through Project Data Sphere, an alternative data sharing platform devoted to cancer related clinical trials , required only days before data access was provided .
The joint PhRMA and EFPIA statement represents the minimum clinical transparency standard, but participation is voluntary [47, 144, 145]. Industry sponsors which are members of PhRMA or EFPIA are more likely to publicize a data sharing policy and make trial data eligible for sharing [146, 147]. For pharmaceutical companies publicly certifying compliance with the Principles for Responsible Clinical Trial Data Sharing through the PhRMA or EFPIA websites [83, 84], the data access points, summary of data made available, and date from which the pharmaceutical company’s IPD sharing policy applies is exhibited in Table 1 and Table 2. Certified pharmaceutical companies with data procedures that could not be confirmed through additional internet searching are not included. Each sponsor’s specific policy should be referred to for a complete review of available data. A sponsor’s exclusion from Table 4 or Table 5 is not meant to indicate they are not wholly committed to data sharing, but that as of March 5, 2019, certification of their compliance with the Principles for Responsible Clinical Trial Data Sharing was not confirmed through PhRMA or EFPIA websites [83, 84]. Repositories may also provide access to study data which is sponsored, generated or stored by governments, universities, charities and research organizations [52, 80].
Examining the data sharing procedures of certified pharmaceutical companies, 26 use at least one internal or external online portal to manage data sharing requests, including clinicalstudydatarequest.com (12), vivli.org (11), yoda.yale.edu (1), fasttrack-bms.force.com (1), https://biogen-dt-external.pharmacm.com/DT/Home (1) and https://www.purduepharma.com/healthcare-professionals/clinical-trials/#request-trial-data (1). Data requests for the remainder of certified pharmaceutical companies are solicited via email. In Table 3 we describe the data request review processes from each pharmaceutical company certified through PhRMA or EFPIA. As of January, 31, 2020, 3123 studies were available on request through CSDR . Vivli, an independent non-profit data-sharing and analytics platform, lists over 4900 studies . Pharmaceutical companies with data procedures that could not be confirmed through internet searching are not included in Table 6.
Incentives for data contributors
Study authors and data curators who generated, managed and shared data, and provided commentary on findings make considerable efforts that should be recognized. Given the role in data collection and interpretation of data, we offered authorship or acknowledgement on relevant publications to corresponding authors and individuals the corresponding author deemed worthy of authorship or acknowledgement. Researchers generally agree that trialists who share data deserve recognition and propose several methods including, direct financial payments, publication incentives, and consideration of previous data sharing practices by funding agencies, and consideration by academic institutions in decisions regarding career promotions, or the possibility of penalties to large organizations, such as fines or suspension of a product’s market authorization, for those refusing data sharing [27, 136, 149,150,151,152,153,154,155,156]. Authorship also enables primary researchers to contribute to the manuscript before publication and reduces anxiety about a lack of control over data and fellow researchers’ ability to understand shared data or IPDMA results [153, 154].
There are several administrative, standardization, human resources and opportunity costs to properly preserve a data repository, manage requests and prepare data for additional analysis which IPDMA authors may be asked to contribute to [157,158,159,160,161]. Academic researchers are expected to pay between $30,000 and $50,000 annually to list up to 20 studies on CSDR . Vivli asks researchers and pharmaceutical companies to pay between $2000 and $4500 per listed study . We obtained funding to offer reimbursement of minor expenses associated with data sharing (e.g. shipping fees for datasets which corresponding authors preferred not to send electronically) but did not offer direct payment for time required to prepare study data, negotiate data sharing agreements, or respond to analytical questions. Funding for these tasks was also not requested by any of the collaborating parties. Offering a small financial incentive, 100 Canadian Dollars, to primary study authors has not improved IPD retrieval rates .
Setting up a data sharing agreement
Data sharing agreements describe the conditions which the IPDMA research team should respect in exchange for permission to analyze specified data from a trialist or study sponsor, and are recommended when sharing data [49, 164, 165]. Data sharing agreements describe the study rationale, analysis plan, contents being exchanged, participant confidentiality, timing of data sharing, data storage and security measures, third party data sharing, intellectual property rights, publication plans and authorship, among others. We adapted previous data sharing agreements to suit the institutional policies of respective study sponsors. Eight of the 14 eligible studies utilized data sharing data sharing agreements while the remaining six did not feel it was necessary. However, we do recommend their use. We sought feedback from our institution’s industry liaison department regarding legal phrasing and implications of the data sharing agreement. Additional file 1 presents an example data sharing agreement with further details. We had to negotiate amendments to ratified agreements if institutional policies changed, if there were data sharing issues affecting agreements with others, or when we conducted additional analyses.
Time to data retrieval and reasons for refused requests
Two of our data sharing requests were not granted (one because of ongoing analyses and the other because it could not be transferred to a shareable electronic format) and three could not be pursued because of timeline and resource restrictions. This meant that we were unable to obtain data for 18% of participants (n = 1763) . Contacting trial authors, negotiating data sharing agreements and awaiting publication of study results are common reasons for delays. Approximately 43% of IPDMAs obtain at least 80% of IPD . The IOM recommends that sponsors make available the “full data package” to external researchers no later than 18 months after trial completion and the “post-publication data package” no more than 6 months after trial completion . In practice, the time until IPD become available after trial completion varies greatly. This availability is influenced by when primary results are published and when a drug’s development program is terminated or approved by regulators, among other factors .
Data which are commonly unavailable include commercially confidential information (information not in the public domain which may undermine the legitimate economic interests of the company ), and study data which were not submitted as part of a marketing authorization package . Sponsors may require that secondary analysis investigate the same indication as the primary analysis because study participants have not provided consent for other investigations. Many sponsors have recognized this impediment and changed their participant consent forms accordingly . Systematic reviews have identified several other technical, motivational, economic, political, legal and ethical barriers to data sharing such as inclusion of data from grey literature, increased costs due to use of commercial data sharing platforms, and advancing data anonymization standards [16, 160, 167, 168].
Authors’ motivations for accepting or rejecting data sharing requests include advancing science, improving healthcare, complying with employer, funding, or sponsor policies, participant privacy, perceived effort and personal recognition [20, 25, 49, 153, 154, 167,168,169,170,171,172,173]. Some argued that older trials require excessive time and resources to properly anonymize IPD, update databases to current standard or transfer data to an electronic format, assuming they have not been lost [16, 137]. Sharing of databases may be refused because datasets are too large to properly anonymize and transfer to other researchers [52, 174]. In such cases, IPDMA researchers may request only relevant variables rather than entire raw datasets which will be smaller and obstruct the ability to use multiple variables to identify a study participant.
If a request is denied, IPDMA researchers may combine IPD with study level data to examine the potential impact of studies without IPD on results and to understand the totality of the evidence [3, 19, 175,176,177].
Managing retrieved IPD
Reviewing supplemental material and readying datasets is a time consuming and resource intensive task . Older datasets generally require additional maintenance as they are not digitally recorded or coded to current standards. For our IPDMA, we reviewed the study protocol, publications, clinical study reports, annotated case report forms and other shared files, before and alongside data extraction to understand the dataset and ensure accuracy. Annotated case report forms are particularly helpful in understanding shared data as they connect each specific variable in a dataset to when, why, where, or how the data was collected. We logged inconsistencies and typically resolved them through discussion with study stakeholders (e.g. trial coordinators). Important inconsistencies should be described in publications following the Preferred Reporting Items for Systematic Review and Meta-Analyses of Individual Participant Data (PRISMA-IPD) statement .
We created a unified database that was verified by two researchers. Our data sharing agreements require that shared data will be deleted within 6 months of results publication which requires careful planning of all analyses.
In our own IPDMA, access to one study required use of the SAS Clinical Trial Data Transparency (CTDT) portal and approval from the institutional review board and trial sponsors [179, 180]. A manual is provided to assist researchers using the CTDT portal, but training is needed if researchers are unfamiliar with statistical analysis programs [180,181,182,183]. A dedicated support team is available to resolve technical issues. Analysis of data accessed through the SAS CTDT portal may require IPDMA researchers to temporarily upload remaining data to this platform. The consent of clinical trial study sponsors not using the SAS CTDT system may be required before doing so. Conversely, IPDMA researchers may also try to negotiate the download of data typically securely accessed through the CTDT system. For further review of methodology and statistical issues for IPDMA see Debray et al. 2015 .
Confidentiality and data storage
In our IPDMA, we deleted information from databases that identified study participants (e.g. names or phone numbers) because storing personal information is not in the interest of study participants. Indeed, the general public and study participants worry about storing or sharing of personally identifying information, obtaining appropriate consent to use data, and relationships with the study investigators [26, 34, 184]. IPDMA researchers must be aware of local laws and sponsor policies about the storage of personally identifying information . Concerns about lack of anonymity are also common when requesting data from case-studies or case-series involving fewer than 50 participants, trials of rare diseases or trials assessing genomic data . Thus, all data requires storage on secure password protected servers where access is provided only to those directly involved in data analysis according to available standards [52, 185,186,187].
We conducted a scoping review of challenges and solutions to obtaining and using IPD and supplemented this with descriptions of our own experiences to guide and facilitate future IPDMA. Many of the practical issues we identified are new compared to the Cochrane IPDMA working group’s guide published by Stewart and Clarke in 1995 . Technological and cultural changes have modified the ways in which researchers communicate and collaborate and the ways data are shared, managed and analyzed. Recent guidance on the use and appraisal of IPDMAs [188, 189], reporting standards , data sharing , and statistical techniques  have influenced these policies.
Our IPDMA identified 19 eligible studies and 10,032 eligible participants which is above the median of typical IPDMAs (i.e. 14 eligible studies and 2369 participants) . Unexpected delays throughout the data gathering process resulted from challenges in communication and the need to adapt to modifications in the various sponsors’ data sharing practices, which were evolving alongside industry and government policy. Some of these changes included the joint PhRMA/EFPIA statement on the principles of responsible clinical trial data sharing , launch of the AllTrials campaign , GlaxoSmithKline introducing the first online data request platform before transitioning to CSDR in 2014 , and influential publications highlighting the importance of data sharing and open science [192,193,194].
Limitations and strengths
This manuscript was not planned before starting the IPDMA which we use as a primary example in this work but because of the many challenges, we were encouraged to provide guidance. Thus, our solutions are based on firsthand experiences but have not been formally compared to alternatives and may not be applicable to all IPDMA. Our perspective is that of IPDMA researchers and not of trialists, sponsors, or data sharing administrators who may disagree with our proposals. Other IPDMA or study stakeholders may identify additional obstacles or solutions not described here but we have conducted a scoping review to overcome that limitation.
Relation to other studies
We identified several publications which aimed to provide a firsthand description of specific data sharing experiences [16, 23, 143, 195,196,197]. For example, Savage and Vickers obtained only one of 10 requested studies and established contact with only five of 10 corresponding authors . Data from the remaining four studies were not shared because preparation was too laborious, data were forbidden from being shared, or required an extensive proposal submission . Jaspers and Degraeuwe described their attempt to conduct an IPDMA, which was eventually abandoned because they were able to obtain only 40% of IPD. Barriers to accessing data were similar to those we describe here and included difficulties establishing contact with study authors, denial of requests for raw datasets because of ongoing analysis or because of a lack of time and personnel to properly prepare data. Geifman et al. and Filippon et al. reported costly and repeated data sharing requests [143, 197]. Nevitt et al. performed a systematic review of IPDMAs published between 1987 and 2015, and reported that only 25% of published IPDMAs had access to all identified IPD and no improvement in data retrieval rate over time . IPDMAs were associated with retrieving at least 80% of IPD if they included only randomized trials, had an authorship policy which provided an incentive to share data (e.g. co-authorship), included fewer eligible participants, and were not Cochrane Reviews.
As shifts in data sharing policy and practice continue, and the number of IPDMA pursued increases, IPDMA researchers must be prepared to mitigate the effects of project delays. Knowledge of how to establish and maintain contact with study stakeholders, negotiate data sharing agreements, and manage clinical study data is required. Broader issues including designing trials for secondary analysis, participant confidentiality, data sharing models, data sharing platforms, data request review panels and recognition of primary study investigators must also be understood to ensure an IPDMA is conducted to appropriate scientific, ethical, and legal standard [128, 198,199,200,201,202,203,204,205,206]. We hope that a shift away from peer-to-peer requesting procedures towards data repository requests will help . The discussion of specific data sharing issues such as the effectiveness of data sharing policies , output of data sharing endeavours , confidentiality of commercial information, whom data is shared with, timelines for data requests, and appropriately compensating data sharing parties must continue [26, 27, 49, 200, 210,211,212]. Additional research investigating the effectiveness of data acquisition techniques , platform features which aid the sharing of clinical trial data [213,214,215], incentives for data sharing [171, 208], participant broad consent for data sharing  and the decision to pursue an IPDMA versus study level MA is needed.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Clinical trial data transparency
European Federation of Pharmaceutical Industries and Associations
Excerpta Medica dataBASE
Institutes of Medicine
Individual participant data meta-analysis
Medline Literature Analysis and Retrieval System Online
Pharmaceutical Research and Manufacturers of America
Preferred Reporting Items for a Systematic Review and Meta-Analysis of Individual Participant Data
Statistical Analysis System
Clarke MJ. Individual patient data meta-analyses. Best Pract Res Clin Obstet Gynaecol. 2005;19(1):47–55.
Cooper HM, Hedges LV, Valentine JC. The handbook of research synthesis and meta-analysis. 2nd ed. New York: Russell Sage Foundation xvi; 2009. p. 615.
Riley RD, Simmonds MC, Look MP. Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. J Clin Epidemiol. 2007;60(5):431–9.
Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ. 2010;340:c221.
Simmonds MC, et al. Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials. 2005;2(3):209–17.
Tudur Smith C, et al. Individual participant data meta-analyses compared with meta-analyses based on aggregate data [abstract]. Trials. 2011;12:21–2.
Stewart LA, Clarke MJ. Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group. Stat Med. 1995;14(19):2057–79.
Stewart LA, Tierney JF. To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof. 2002;25(1):76–97.
Tudur Smith C, et al. Individual participant data meta-analyses compared with meta-analyses based on aggregate data. Cochrane Database Syst Rev. 2016;9:MR000007.
Lyman GH, Kuderer NM. The strengths and limitations of meta-analyses based on aggregate data. BMC Med Res Methodol. 2005;5:14.
Mello MM, et al. Preparing for responsible sharing of clinical trial data. N Engl J Med. 2013;369(17):1651–8.
Stewart LA, T.J., Clarke M. Chapter 18: Reviews of individual patient data. In: Higgins JPT, Green S (editors), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011; Available from: www.handbook.cochrane.org.
Vale CL, et al. Uptake of systematic reviews and meta-analyses based on individual participant data in clinical practice guidelines: descriptive study. BMJ. 2015;350:h1088.
Tierney JF, et al. How individual participant data meta-analyses have influenced trial design, conduct, and analysis. J Clin Epidemiol. 2015;68(11):1325–35.
Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane, 2019. Available from www.training.cochrane.org/handbook.
Nevitt SJ, et al. Exploring changes over time and characteristics associated with data retrieval across individual participant data meta-analyses: systematic review. BMJ. 2017;357:j1390.
Coady SA, et al. Use of the National Heart, Lung, and Blood Institute data repository. N Engl J Med. 2017;376(19):1849–58.
Huang Y, et al. Distribution and epidemiological characteristics of published individual patient data meta-analyses. PLoS One. 2014;9(6):e100151.
Ahmed I, Sutton AJ, Riley RD. Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: a database survey. BMJ. 2012;344:d7762.
Rathi V, et al. Sharing of clinical trial data among trialists: a cross sectional survey. BMJ. 2012;345:e7570.
Sutton AJ, Kendrick D, Coupland CA. Meta-analysis of individual- and aggregate-level data. Stat Med. 2008;27(5):651–69.
Abo-Zaid G, Sauerbrei W, Riley RD. Individual participant data meta-analysis of prognostic factor studies: state of the art? BMC Med Res Methodol. 2012;12:56.
Jaspers GJ, Degraeuwe PL. A failed attempt to conduct an individual patient data meta-analysis. Syst Rev. 2014;3:97.
Tenopir C, et al. Changes in data sharing and data reuse practices and perceptions among scientists worldwide. PLoS One. 2015;10(8):e0134826.
Rathi VK, et al. Predictors of clinical trial data sharing: exploratory analysis of a cross-sectional survey. Trials. 2014;15:384.
Ross JS. Clinical research data sharing: what an open science world means for researchers involved in evidence synthesis. Syst Rev. 2016;5(1):159.
Ohmann C, et al. Sharing and reuse of individual participant data from clinical trials: principles and recommendations. BMJ Open. 2017;7(12):e018647.
Barnhart KT, Legro RS, Scott RT Jr. Data sharing requirements: perspectives from three authors. Fertil Steril. 2018;109(1):44–7.
Sardanelli F, et al. To share or not to share? Expected pros and cons of data sharing in radiological research. Eur Radiol. 2018;28(6):2328–35.
Wu T, et al. Transparency and sharing individual participant data of clinical trials: a philosophical proposition about the medical study ethics and implications for clinical trials. [Chinese]. Chin J Evid Based Med. 2018;18(6):538–42.
Vickers AJ. Sharing raw data from clinical trials: what progress since we first asked “Whose data set is it anyway?”. Trials. 2016;17(1):227.
Bell EA, Ohno-Machado L, Grando MA. Sharing my health data: a survey of data sharing preferences of healthy individuals. AMIA Annu Symp Proc. 2014;2014:1699–708.
Cheah PY, et al. Perceived benefits, harms, and views about how to share data responsibly: a qualitative study of experiences with and attitudes toward data sharing among Research staff and community representatives in Thailand. J Empir Res Hum Res Ethics. 2015;10(3):278–89.
Howe N, et al. Systematic review of participants’ attitudes towards data sharing: a thematic synthesis. J Health Serv Res Policy. 2018;23(2):123–33.
Mello MM, Lieou V, Goodman SN. Clinical trial participants’ views of the risks and benefits of data sharing. N Engl J Med. 2018;378(23):2202–11.
European Medicines Agency. European Medicines Agency policy on publication of clinical data for medicinal products for human use. 2014; Available from: http://www.ema.europa.eu/docs/en_GB/document_library/Other/2014/10/WC500174796.pdf. [cited 2014 October 3].
Food and Drug Administration (FDA). Availability of Masked and De-identified Non-Summary Safety and Efficacy Data; Request for Comments. 2013; Available from: https://federalregister.gov/a/2013-13083. [cited 2014 June 20].
Taichman DB, et al. Data sharing statements for clinical trials: a requirement of the International Committee of Medical Journal Editors. PLoS Med. 2017;14(6):e1002315.
Cancer Research UK. Submission of a data sharing and preservation strategy. 2009 June 1, 2015; Available from: http://www.cancerresearchuk.org/prod_consump/groups/cr_common/@fre/@gen/documents/generalcontent/cr_016308.pdf. Accessed 15 Apr 2020.
Kiley R, et al. Data sharing from clinical trials - a Research Funder's perspective. N Engl J Med. 2017;377(20):1990–2.
International Committee of Medical Journal Editors. Clinical Trials. 2018; Available from: http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html. [cited 2018 July 1].
Godlee F, Groves T. The new BMJ policy on sharing data from drug and device trials. BMJ. 2012;345:e7888.
PLOS Medicine. PLOS editorial and publishing policies; Available from: http://www.plosmedicine.org/static/policies.action;jsessionid=0CD27C4DE9841485620ED21B9E815D54#sharing. [cited 2014 July 1].
Scientific Data. Welcome to Scientific Data; Available from: http://www.nature.com/sdata/about. [cited 2014 July 1].
Loder E, Groves T. The BMJ requires data sharing on request for all trials. BMJ. 2015;350:h2373.
Fletcher J. New CMAJ policy on sharing data from clinical research. CMAJ. 2014;186(3):163.
European Federation of Pharmaceutical Industries and Associations (EFPIA) and Pharmaceutical Research and Manufacturers of America (PhRMA). Principles for resposible clinical trial data sharing: Our commitment to patients and researchers. 2013; Available from: http://phrma-docs.phrma.org/sites/default/files/pdf/PhRMAPrinciplesForResponsibleClinicalTrialDataSharing.pdf. [cited 2018 July 30].
Atzor S, et al. Clinical trial data sharing: from principles to practical implementation - an industry model. Regul Rapporteur. 2014;11(4):4–7.
Lo B. Sharing clinical trial data: maximizing benefits, minimizing risk. JAMA. 2015;313(8):793–4.
O'Dowd A. Drug industry pledge on access to trial data is met with scepticism. BMJ. 2013;347:f4829.
Doshi P. EFPIA-PhRMA's principles for clinical trial data sharing have been misunderstood. BMJ. 2013;347:f5164.
Clinical Study Data Request. Study sponsors; Available from: https://www.clinicalstudydatarequest.com/Study-Sponsors.aspx. [cited 2014 July 4].
Abbvie. Clinical trials data and information sharing. 2014; Available from: https://www.abbvie.com/our-science/clinical-trials/clinical-trials-data-and-information-sharing/data-and-information-sharing-with-qualified-researchers.html. [cited 2019 March 21].
Amgen. Clinical Trial Transparency, Data Sharing and Disclosure Practices 2019; Available from: https://www.amgen.com/about/how-we-operate/policies-practices-and-disclosures/ethical-research/clinical-data-transparency-practices/. [cited 2019 March 14].
Astellas. About Astellas Clinical Study Results. 2018; Available from: https://astellasclinicalstudyresults.com/HCP.aspx. [cited 2019 March 1].
Bayer. Clinical trial transparency policy; Available from: http://pharma.bayer.com/en/innovation-partnering/clinical-trials/transparency-policy/. [cited 2019 March 12].
Biogen. Biogen clinical trial transparency and data sharing policy. 2018; Available from: http://clinicalresearch.biogen.com/. [cited 2018 July 30].
Boehringer-Ingelheim. Policy on transparency and publication of clinical study data: Registration of clinical studies, disclosure of results in publications and results databases and access to study data and documents; Available from: https://trials.boehringer-ingelheim.com/content/dam/internet/opu/clinicaltrial/com_EN/documents/Policy.pdf. [cited 2019 March 12].
Bristol-Myers Squibb. Disclosure Commitment. 2018; Available from: https://www.bms.com/researchers-and-partners/clinical-trials-and-research/disclosure-commitment.html. [cited 2018 July 30].
Celgene. Clinical trials data sharing. 2019; Available from: https://www.celgene.com/research-development/clinical-trials/clinical-trials-data-sharing/. [cited 2019 March 14].
Eisai Co. Ltd. Clinical trial disclosure; Available from: https://www.eisai.com/company/business/research/clinical/index.html. [cited 2019 March 12].
Eli Lilly and Company. Lilly announces increased access to clinical trials data for qualified researchers. 2014; Available from: http://lilly.mediaroom.com/index.php?s=9042&item=137313. [cited 2019 March 12].
EMD Serono. Our Commitment to Responsible Clinical Trial Data Sharing. 2018; Available from: https://www.emdgroup.com/en/research/our-approach-to-research-and-development/healthcare/clinical-trials/commitment-responsible-data-sharing.html. [cited 2018 July 30].
GlaxoSmithKline. GSK gives update on plans to share detailed clinical trial data as part of its commitment to transparency. 2013; Available from: https://www.gsk.com/en-gb/media/press-releases/gsk-gives-update-on-plans-to-share-detailed-clinical-trial-data-as-part-of-its-commitment-to-transparency/. [cited 2019 March 12].
Viiv Healthcare. We are committed to data transparency. 2019; Available from: https://www.viivhealthcare.com/en-gb/advancing-hiv-science-and-rd/we-are-committed-to-data-transparency/. [cited 2019 March 13].
Pfizer. Data access requests. 2019; Available from: https://www.pfizer.com/science/clinical_trials/trial_data_and_results/data_requests. [cited 2019 March 1].
Sanofi. Clinical trials and results: Our data sharing commitments. 2019; Available from: https://www.sanofi.com/en/science-and-innovation/clinical-trials-and-results/our-data-sharing-commitments/. [cited 2019 March 13].
Shire. Our commitment to transparency. 2017; Available from: http://www.shiretrials.com/en/our-commitment-to-transparency/data-sharing-with-researchers. [cited 2019 March 14].
Takeda. A Tradition of Serving Patients With Integrity. 2015; Available from: https://takedaclinicaltrials.com/approach. [cited 2019 March 13].
UCB. UCB position statement on clinical study data transparency. 2014; Available from: https://www.ucb.com/our-science/magazine/detail/article/Transparency-supporting-responsible-data-sharing. [cited 2014 July 1].
The Yale University Open Data Access Project. Johnson & Johnson - Available Data. 2018; Available from: http://yoda.yale.edu/jj-available-data. [cited 2018 July 30].
Janssen Global Services, L Clinical trial data transparency. 2018; Available from: https://www.janssen.com/clinical-trials/transparency. [cited 2018 July 30].
Merck. Procedure on access to clinical trial data. 2018; Available from: https://www.merck.com/clinical-trials/pdf/ProcedureAccessClinicalTrialData.pdf. [cited 2019 March 22].
Purdue Pharma. Review process for data sharing. 2018; Available from: http://purduepharma.com/healthcare-professionals/clinical-trials/data-sharing/. [cited 2019 March 21].
Roche. Roche global policy on sharing of clincal study information; Available from: https://www.roche.com/dam/jcr:1c46aa73-cea0-4b9b-8eaa-e9a788ed021b/en/roche_global_policy_on_sharing_of_clinical_study_information.pdf. [cited 2019 March 13].
Project Data Sphere LLC. Project Data Sphere. 2020; Available from: https://projectdatasphere.org/projectdatasphere/html/home. [cited 2020 March 17].
Schunemann HJ, et al. Use of heparins in patients with cancer: individual participant data meta-analysis of randomised trials study protocol. BMJ Open. 2016;6(4):e010569.
Clinical Study Data Request. How to request data. 2018; Available from: https://www.clinicalstudydatarequest.com/Help/Help-How-to-Request-Data.aspx. [cited 2018 July 30].
Tricco AC, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.
Vivli. Our members. 2019; Available from: https://vivli.org/members/ourmembers/. [cited 2019 March 1].
European Federation of Pharmaceutical Industries and Associations (EFPIA). Home. 2020; Available from: https://www.efpia.eu/. [cited 2020 March 17].
Pharmaceutical Research and Manufacturers of America (PhRMA). PhRMA. 2020; Available from: https://www.phrma.org/en. [cited 2020 March 17].
European Federation of Pharmaceutical Industries and Associations (EFPIA). Sharing clinical trial information. 2018; Available from: https://www.efpia.eu/about-medicines/development-of-medicines/clinical-trials/sharing-clinical-trial-information/. [cited 2018 July 30].
Pharmaceutical Research and Manufacturers of America (PhRMA). PhRMA Principles for Responsible Clinical Trial Data Sharing – Certifications. 2017; Available from: https://www.phrma.org/codes-and-guidelines/phrma-principles-for-responsible-clinical-trial-data-sharing-certifications. [cited 2018 July 28].
Clinical Study Data Request. Sponsor Specific Details: Astellas. 2019; Available from: https://www.clinicalstudydatarequest.com/Study-Sponsors/Study-Sponsors-Astellas.aspx. [cited 2019 March 1].
Chugai Pharmaceutical Co. Ltd. Clinical trial data sharing. 2018; Available from: https://www.chugai-pharm.co.jp/english/profile/rd/guideline/ctds_request.html. [cited 2019 March 12].
Nisen P, Rockhold F. Access to patient-level data from GlaxoSmithKline clinical trials. N Engl J Med. 2013;369(5):475–8.
GlaxoSmithKline. Data transparency. 2014; Available from: https://www.gsk.com/en-gb/research/our-approach/trials-in-people/data-transparency/. [cited 2019 March 12].
Novartis. Novartis Position on Clinical Study Transparency – Clinical Study Registration, Results Reporting and Data Sharing. 2016; Available from: https://www.novartis.com/sites/www.novartis.com/files/clinical-trial-data-transparency.pdf. [cited 20189 March 12].
Sumitomo Dainippon Pharma. Disclosure of Clinical Study Data. 2018; Available from: https://www.ds-pharma.com/rd/clinical/clinical_study_data.html. [cited 2019 March 13].
Yale University Open Data Access (YODA) Project. How to request data; Available from: https://yoda.yale.edu/how-request-data. [cited 2019 March 13].
Johnson & Johnson. Johnson & Johnson Announces Clinical Trial Data Sharing Agreement with Yale School of Medicine. 2014; Available from: http://www.jnj.com/news/all/johnson-and-johnson-announces-clinical-trial-data-sharing-agreement-with-yale-school-of-medicine. [cited 2014 July 1].
Harlan M. Krumholz. Give the data to the people. 2014; Available from: http://www.nytimes.com/2014/02/03/opinion/give-the-data-to-the-people.html?_r=0. [cited 2014 July 4].
Biogen. Biogen clinical trial transparency and data sharing policy. 2019; Available from: http://clinicalresearch.biogen.com/. [cited 2019 March 5].
Celgene. Clinical trial data sharing policy. 2017; Available from: https://media.celgene.com/content/uploads/clinical-trial-data-sharing-policy.pdf. [cited 2019 March 14].
Daiichi-Sankyo. Clinical Trial Information Disclosure. 2018; Available from: https://www.daiichisankyo.com/rd/our_approach/clinical_studies/index.html. [cited 2018 July 20].
Pfizer. Clinical Trials Data Access - Independent Review Panel Charter. 2014; Available from: https://www.pfizer.com/files/research/research_clinical_trials/Independent_Review_Panel_Charter_01312014.pdf. [cited 2019 March 21].
AstraZeneca. AstraZeneca Group of Companies – Data Request Portal. 2018; Available from: https://astrazenecagroup-dt.pharmacm.com/DT/Home. [cited 2018 July 20].
Natalie Andrews. AstraZeneca Clinical Trial Transparency and External Sharing of Individual Patient-Level Data. 2015; Available from: https://www.phusewiki.org/docs/Conference%202015%20PP%20Papers/PP17.pdf. [cited 2018 July 20].
AstraZeneca. Disclosure Commitment. 2019; Available from: https://astrazenecagrouptrials.pharmacm.com/ST/Submission/Disclosure. [cited 2019 March 21].
Pencina MJ, et al. Supporting open access to clinical trial data for researchers: the Duke Clinical Research Institute-Bristol-Myers Squibb supporting open access to researchers initiative. Am Heart J. 2016;172:64–9.
Chiesi Group. Clinical trial transparency statement. 2018; Available from: https://www.chiesi.com/en/research-and-development/clinical-trial-transparency-and-data-sharing/. [cited 2019 March 21].
EMD Serono. Responsible data sharing instruction document; Available from: https://www.emdgroup.com/content/dam/web/corporate/non-images/business-specifics/healthcare/US/Responsible_Data_Sharing_Instruction_Document_US.pdf. [cited 2019 April 18].
The Menarini Group. User Registration. 2018; Available from: https://clinicaltrials.menarini.com/en-US/Home/Datasharing. [cited 2018 July 30].
The Menarini Group. Datasharing. 2018; Available from: https://clinicaltrials.menarini.com/en-US/Home/Datasharing. [cited 2019 March 21].
Regeneron. Clinical Trial Disclosure & Data Transparency Policy Statements; Available from: https://errs.regeneron.com/external/DefaultBU1.aspx. [cited 2020 March 18].
Servier. Data request portal. 2018; Available from: https://clinicaltrials.servier.com/data-request-portal/. [cited 2019 March 21].
Almirall. Clinical trials. 2019; Available from: https://www.almirall.com/en/about-almirall/research-and-development/clinical-trials. [cited 2019 March 14].
Amgen. Clinical Trial Data Sharing Request 2019; Available from: https://www.amgen.com/about/how-we-operate/policies-practices-and-disclosures/ethical-research/clinical-data-transparency-practices/clinical-trial-data-sharing-request/. [cited 2019 March 14].
Bial. Transparency. 2014; Available from: https://www.bial.com/en/r_d.2/transparency.208/transparency.a484.html. [cited 2019 March 14].
Grunenthal. Clinical data sharing with researchers. 2018; Available from: https://www.grunenthal.com/r-d-vision-mission/clinical-trials/data-sharing-clinical-trials. [cited 2019 March 21].
Leo Pharma. LEO Pharma's Position on Public Access to Clinical Trials Information. Available from: http://www.leo-pharma.com/Home/Research-and-Development/Clinical-trial-disclosure/LEO-Pharmas-position-on-transparency.aspx. [cited 2019 March 14].
Leo Pharma. How to get access to anonymised patient-level data. Available from: http://www.leo-pharma.com/Home/Research-and-Development/Clinical-trial-disclosure/Access-to-patient-level-data.aspx#Step_1:__Fasibility_assessment_by_LEO_Pharma. [cited 2019 March 14].
Lundbeck. Policy for scientific publications and responsible clinical trial data sharing. 2018; Available from: https://www.lundbeck.com/global/brain-disorders/research-and-development/policy-for-scientific-publications-and-responsible-clinical-trial-data-sharing/clinical-data-sharing. [cited 2019 March 14].
Novo Nordisk. How to access clinical trial datasets. Available from: https://www.novonordisk-trials.com/how-access-clinical-trial-datasets. [cited 2019 March 14].
Novo Nordisk. Independent review board charter. Available from: https://www.novonordisk-trials.com/sites/novonordisk/themes/novo/img/document/Independent%20Review%20Board%20Charter.pdf. [cited 2019 March 14].
Orion Corporation. Ethics in the Clinical Research Phase. Available from: https://www.orion.fi/en/Orion-group/Sustainability/policies/pharmaceutical-rd-ethics-policy/ethics-in-clinical-research/. [cited 2019 March 14].
Otsuka Pharmaceutical Co. Ltd. For researchers: Overview of researcher access to patient-level data 2019; Available from: https://clinical-trials.otsuka.com/For-Researchers.aspx. [cited 2019 March 14].
Vifor Pharma. Responsibility highlights report 2017 2018. Available from: http://www.viforpharma.com/~/media/Files/V/Vifor-Pharma/documents/en/responsibility/Vifor_Pharma_CSR_Report_2017.pdf. [cited 2019 March 14].
Clinical Study Data Request. Review of requests. 2018; Available from: https://www.clinicalstudydatarequest.com/Help/Help-Review-of-Requests.aspx. [cited 2018 July 30].
Clinical Study Data Request. Independent review panel charter. Available from: https://clinicalstudydatarequest.com/Documents/Independent_Review_Panel_Charter.pdf. [cited 2018 August 1].
Vivli. Biogen. 2019. Available from: https://vivli.org/ourmember/biogen/. [cited 2019 March 21].
Duke Clinical Research Institute. Bristol-Myers Squibb data sharing independent review committee (IRC) charter. 2017. Available from: https://dcri.org/wp-content/uploads/2017/10/BMS_Charter_FINAL-approved-by-IRC-10.13.17-1.pdf. [cited 2019 March 21].
EMD Serono. Summary of EMD Serono's responsible data sharing policy. [cited 2019 March 22].
Grunenthal. Requesting access to clinical data. 2018. Available from: https://www.grunenthal.com/-/media/projects/corporatewebsite/com/pdf/content_clincialtrial-portal/2018-11-02_sdn-pubdiscl-access_requesting-access-to-clinical-data.pdf?la=en&hash=2D683A66BEA23C98044D2833D732713B581E2929. [cited 2019 March 21].
Yale University Open Data Access (YODA) Project. Procedures to Guide External Investigator Access to Clinical Trial Data. 2016. Available from: http://yoda.yale.edu/sites/default/files/files/YODA%20Project%20Data%20Release%20Procedures%20June%202016.pdf. [cited 2018 August 1].
Regeneron. Regeneron Mission Statement & Purpose of Investigator-Initiated Study Program. 2020; Available from: https://errs.regeneron.com/external/DefaultBU1.aspx. [cited 2020 March 17].
Berlin JA, et al. Bumps and bridges on the road to responsible sharing of clinical trial data. Clin Trials. 2014;11(1):7–12.
Polanin JR. Efforts to retrieve individual participant data sets for use in a meta-analysis result in moderate data sharing but many data sets remain missing. J Clin Epidemiol. 2018;98:157–9.
Polanin JR, Terzian M. A data-sharing agreement helps to increase researchers’ willingness to share primary data: results from a randomized controlled trial. J Clin Epidemiol. 2019;106:60–9.
Polanin JR, Williams RT. Overcoming obstacles in obtaining individual participant data for meta-analysis. Res Synth Methods. 2016;7(3):333–41.
Tierney JF, Vale C, Riley R, Smith CT, Stewart L, Clarke M, et al. Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use. PLoS Med. 2015;12(7):e1001855. https://doi.org/10.1371/journal.pmed.1001855. Accessed 15 Apr 2020.
Veroniki AA, et al. Contacting authors to retrieve individual patient data: study protocol for a randomized controlled trial. Trials. 2016;17(1):138.
Young T, Hopewell S. Methods for obtaining unpublished data. Cochrane Database Syst Rev. 2011;11:MR000027.
Lefebvre C, M.E., Glanville J. Chapter 6: Searching for studies In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011; Available from: www.handbook.cochrane.org.
Wolfe N, Gotzsche PC, Bero L. Strategies for obtaining unpublished drug trial data: a qualitative interview study. Syst Rev. 2013;2:31.
Veroniki AA, et al. Retrieval of individual patient data depended on study characteristics: a randomized controlled trial. J Clin Epidemiol. 2019;113:176–88.
Clinical Study Data Request. Our mission. 2019; Available from: https://clinicalstudydatarequest.com/Default.aspx. [cited 2019 April 1].
Murugiah K, et al. Availability of clinical trial data from industry-sponsored cardiovascular trials. J Am Heart Assoc. 2016;5(4):e003307.
NHS Digital. DARS guidance. 2019; Available from: https://digital.nhs.uk/services/data-access-request-service-dars/dars-guidance. [cited 2019 February 22].
NHS Digital. Data Access Request Service (DARS): process. 2019; Available from: https://digital.nhs.uk/services/data-access-request-service-dars/data-access-request-service-dars-process. [cited 2019 February 22].
Clinical Study Data Request. Metrics. 2019; Available from: https://clinicalstudydatarequest.com/Metrics.aspx. [cited 2019 April 1].
Geifman N, et al. Opening clinical trial data: Are the voluntary data-sharing portals enough? BMC Med. 2015;13(1):280.
Pharmaceutical Research and Manufacturers of America (PhRMA). Members. 2019; Available from: https://www.phrma.org/about/members. [cited 2019 March 4].
European Federation of Pharmaceutical Industries and Associations (EFPIA). Membership. 2019; Available from: https://www.efpia.eu/about-us/membership/. [cited 2019 March 4].
Hopkins AM, Rowland A, Sorich MJ. Data sharing from pharmaceutical industry sponsored clinical studies: Audit of data availability. BMC Med. 2018;16(1):1154.
Pharmaceutical Research and Manufacturers of America (PhRMA). EFPIA-PHRMA Princples for responsible clinical trial data sharing report on the 2016 member company survey. 2017; Available from: https://www.efpia.eu/media/288603/efpia-phrma-report-on-the-2016-member-company-survey-on-the-joint-principles-for-responsible-clinical-trial-data-sharing.pdf. [cited 2019 March 4].
Vivli Center for Global Clinical Research Data. 2018 Progress Report. 2019; Available from: https://s3.amazonaws.com/pageturnpro2.com/Publications/201812/4485/87942/PDF/131889563346378000_Vivli_AR_2018.pdf. [cited 2019 April 1].
Chan AW, et al. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383(9913):257–66.
Doshi P, Goodman SN, Ioannidis JP. Raw data from clinical trials: within reach? Trends Pharmacol Sci. 2013;34(12):645–7.
Gotzsche PC. Why we need easy access to all data from all clinical trials and how to accomplish it. Trials. 2011;12:249.
Ross JS, Krumholz HM. Ushering in a new era of open science through data sharing: the wall must come down. JAMA. 2013;309(13):1355–6.
Fecher B, Friesike S, Hebing M. What drives academic data sharing? PLoS One. 2015;10(2):e0118053.
Nimh Collaborative Data Synthesis for Adolescent Depression Trials Study Team including, et al. Advancing Science Through Collaborative Data Sharing and Synthesis. Perspect Psychol Sci. 2013;8(4):433–44.
Sydes MR, Ashby D. Data authorship as an incentive to data sharing. N Engl J Med. 2017;377(4):402.
Bierer BE, Crosas M, Pierce HH. Data authorship as an incentive to data sharing. N Engl J Med. 2017;377(4):402.
Berman F, Cerf V. Science priorities. Who will pay for public access to research data? Science. 2013;341(6146):616–7.
Wilhelm EE, Oster E, Shoulson I. Approaches and costs for sharing clinical research data. JAMA. 2014;311(12):1201–2.
Zhu CS, et al. Data sharing in clinical trials: an experience with two large cancer screening trials. PLoS Med. 2017;14(5):e1002304.
Naudet F, et al. Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: Survey of studies published in the BMJ and PLOS Medicine. BMJ. 2018;360:k400.
Martin Bobrow, et al. Establishing incentives and changing cultures to support data access. 2014; Available from: https://wellcome.ac.uk/sites/default/files/establishing-incentives-and-changing-cultures-to-support-data-access-eagda-may14.pdf. [cited 2019 March 20].
Rockhold F, Nisen P, Freeman A. Data sharing at a crossroads. N Engl J Med. 2016;375(12):1115–7.
Kaiser J. A new portal for patient data. Science. 2018;361(6399):212.
Tucker K, et al. Protecting patient privacy when sharing patient-level data from clinical trials. BMC Med Res Methodol. 2016;16(Suppl 1):77.
Tudur Smith C, et al. How should individual participant data (IPD) from publicly funded clinical trials be shared? BMC Med. 2015;13:298.
European Medicines Agency. External guidance on the implementation of the European Medicines Agency policy on the publication of clinical data for medicinal products for human use. 2018; Available from: https://www.ema.europa.eu/en/documents/regulatory-procedural-guideline/external-guidance-implementation-european-medicines-agency-policy-publication-clinical-data_en-3.pdf. [cited 2020 March 18].
Mazor KM, et al. Stakeholders’ views on data sharing in multicenter studies. J Comp Eff Res. 2017;6(6):537–47.
van Panhuis WG, et al. A systematic review of barriers to data sharing in public health. BMC Public Health. 2014;14:1144.
Bobrow, M., et al. Establishing incentives and changing cultures to support data access. 2014; Available from: https://wellcome.ac.uk/sites/default/files/establishing-incentives-and-changing-cultures-to-support-data-access-eagda-may14.pdf. [cited 2019 January 4].
Bull S, Roberts N, Parker M. Views of ethical best practices in sharing individual-level data from medical and public Health Research: a systematic scoping review. J Empir Res Hum Res Ethics. 2015;10(3):225–38.
Rowhani-Farid A, Allen M, Barnett AG. What incentives increase data sharing in health and medical research? A systematic review. Res Integr Peer Rev. 2017;2:4.
Kim Y. Fostering scientists’ data sharing behaviors via data repositories, journal supplements, and personal communication methods. Inf Process Manag. 2017;53(4):871–85.
Hopkins C, et al. UK publicly funded clinical trials units supported a controlled access approach to share individual participant data but highlighted concerns. J Clin Epidemiol. 2016;70:17–25.
Learned K, Durbin A, Currie R, Beale H, Lam DL, Goldstein T, Salama SR, Haussler D, Morozova O, Bjork I. A critical evaluation of genomic data sharing: Barriers to accessing pediatric cancer genomic datasets: a Treehouse Childhood Cancer Initiative experience [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2017. Washington, DC. Philadelphia (PA): AACR; Cancer Res. 2017;77(13 Suppl):Abstract nr LB-338. https://doi.org/10.1158/1538-7445.AM2017-LB-338.
Simmonds M, Stewart G, Stewart L. A decade of individual participant data meta-analyses: A review of current practice. Contemp Clin Trials. 2015;45(Pt A):76–83.
Debray TP, et al. Get real in individual participant data (IPD) meta-analysis: a review of the methodology. Res Synth Methods. 2015;6(4):293–309.
Rogozinska E, et al. Meta-analysis using individual participant data from randomised trials: opportunities and limitations created by access to raw data. Evidence-Based Med. 2017;22(5):157–62.
Stewart LA, et al. Preferred reporting items for systematic review and meta-analyses of individual participant data: the PRISMA-IPD statement. JAMA. 2015;313(16):1657–65.
SAS Institute. SAS Clinical Trial Data Transparency. 2014; Available from: http://support.sas.com/documentation/onlinedoc/clinicaltrial/index.html. [cited 2014 July 20].
SAS Institute, Multi-Sponsor Environment - SAS® Clinical Trial Data Transparency Version 2.3 User Guide. 2018.
Clinical Study Data Request. Access to Data 2018; Available from: https://clinicalstudydatarequest.com/Help/Help-Access-to-Data.aspx. [cited 2018 August 1].
Mospan GA, Wargo KA. Researchers’ experience with clinical data sharing. J Am Board Fam Med. 2016;29(6):805–7.
Mbuagbaw L, et al. Challenges to complete and useful data sharing. Trials. 2017;18(1):71.
Aitken M, et al. Public responses to the sharing and linkage of health data for research purposes: a systematic review and thematic synthesis of qualitative studies. BMC Med Ethics. 2016;17(1):73.
Hughes S, et al. Preparing individual patient data from clinical trials for sharing: the GlaxoSmithKline approach. Pharm Stat. 2014;13(3):179–83.
Committee on Strategies for Responsible Sharing of Clinical Trial Data, Board on Health Sciences Policy, and Institute of Medicine. Sharing clinical trial data: maximizing benefits, minimizing risk. Washington (DC): National Academies Press (US); 2015 Appendix B, Concepts and Methods for De-identifying Clinical Trial Data]. Available from: https://www.ncbi.nlm.nih.gov/books/NBK285994/.
Emam KE, Rodgers S, Malin B. Anonymising and sharing individual patient data. BMJ. 2015;350:h1139.
Tierney JF, et al. Individual participant data (IPD) meta-analyses of randomised controlled trials: guidance on their use. PLoS Med. 2015;12(7):e1001855.
Hollis S, et al. Best practice for analysis of shared clinical trial data. BMC Med Res Methodol. 2016;16(Supplement 1):76.
AllTrials. About AllTrials. 2014; Available from: http://www.alltrials.net/find-out-more/about-alltrials/. [cited 2018 August 1].
GlaxoSmithKline. Data transparency. 2014; Available from: https://www.gsk.com/en-gb/behind-the-science/innovation/data-transparency/. [cited 2018 August 1].
Simmonds MC, et al. Safety and effectiveness of recombinant human bone morphogenetic protein-2 for spinal fusion: a meta-analysis of individual-participant data. Ann Intern Med. 2013;158(12):877–89.
Fu R, et al. Effectiveness and harms of recombinant human bone morphogenetic protein-2 in spine fusion: a systematic review and meta-analysis. Ann Intern Med. 2013;158(12):890–902.
Krumholz HM, et al. A historic moment for open science: the Yale University open data access project and medtronic. Ann Intern Med. 2013;158(12):910–1.
Hrobjartsson A. Why did it take 19 months to retrieve clinical trial data from a non-profit organisation? BMJ. 2013;347:f6927.
Savage CJ, Vickers AJ. Empirical study of data sharing by authors publishing in PLoS journals. PLoS One. 2009;4(9):e7078.
Filippon J. Slow and costly access to anonymised patient data impedes academic research. BMJ. 2015;351:h5087.
Tudur Smith C, et al. Sharing individual participant data from clinical trials: an opinion survey regarding the establishment of a central repository. PLoS One. 2014;9(5):e97886.
Huser V, Shmueli-Blumberg D. Data sharing platforms for de-identified data from human clinical trials. Clinical Trials. 2018;15(4):413–23.
So D, Knoppers BM. Ethics approval in applications for open-access clinical trial data: An analysis of researcher statements to clinicalstudydatarequest.com. PLoS One. 2017;12(9):e0184491.
Sydes MR, et al. Sharing data from clinical trials: The rationale for a controlled access approach. Trials. 2015;16(1):104.
Green AK, et al. The project data sphere initiative: accelerating cancer research by sharing data. Oncologist. 2015;20(5):464–72.
Eichler HG, Sweeney F. The evolution of clinical trials: Can we address the challenges of the future? Clin Trials. 2018;15(1_suppl):27–32.
Khusro A, Aarti C. TB-PACTS: a fresh emphatic data sharing approach. Asian Pac J Trop Dis. 2017;7(2):97–8.
Bertagnolli MM, et al. Advantages of a truly open-access data-sharing model. N Engl J Med. 2017;376(12):1178–81.
Asare AL, et al. Clinical trial data access: opening doors with TrialShare. J Allergy Clin Immunol. 2016;138(3):724–6.
Zinner DE, Pham-Kanter G, Campbell EG. The changing nature of scientific sharing and withholding in academic life sciences Research: trends from National Surveys in 2000 and 2013. Acad Med. 2016;91(3):433–40.
Rowhani-Farid A, Barnett AG. Has open data arrived at the British medical journal (BMJ)? An observational study. BMJ Open. 2016;6(10):e011784.
Strom BL, et al. Data sharing - is the juice worth the squeeze? N Engl J Med. 2016;375(17):1608–9.
Bonini S, et al. Transparency and the European medicines agency--sharing of clinical trial data. N Engl J Med. 2014;371(26):2452–5.
Drazen JM. Sharing individual patient data from clinical trials. N Engl J Med. 2015;372(3):201–2.
International Consortium of Investigators for Fairness in Trial Data, S, et al. Toward Fairness in Data Sharing. N Engl J Med. 2016;375(5):405–7.
Navar AM, Pencina MJ, Peterson ED. Open access platforms for sharing clinical trial data--reply. JAMA. 2016;316(6):666–7.
Ross JS, Krumholz HM. Open access platforms for sharing clinical trial data. JAMA. 2016;316(6):666.
Navar AM, et al. Use of open access platforms for clinical trial data. JAMA. 2016;315(12):1283–4.
Garrison NA, et al. A systematic literature review of individuals’ perspectives on broad consent and data sharing in the United States. Genet Med. 2016;18(7):663–71.
Vivli. Aegerion Pharmaceuticals. 2019; Available from: https://vivli.org/ourmember/aegerion-pharmaceuticals/. [cited 2019 March 1].
Esteve. Commitment letter. 2014; Available from: https://www.efpia.eu/media/25446/esteve.pdf. [cited 2019 March 14].
Ipsen. Transparency and trust. 2019; Available from: https://www.ipsen.com/commitments/transparency-and-trust/clinical-trials/. [cited 2019 March 14].
Vivli.org. Vivli Platform Process at a Glance 2020. Available from: https://vivli.org/about/data-request-review-process/. [cited 2020 March 17].
We thank Neera Bhatnagar (Health Sciences Library, McMaster University) for her help with designing the search strategy for our scoping review.
Funding for this project was supplied through a grant from the Canadian Institutes of Health Research (CIHR), KRS 126594. The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Ethics approval and consent to participate
Consent for publication
Dr. Clarke reports being co-convenor of the Cochrane Individual Participant Data Meta-analysis Methods Group and involved in several IPDMAs funded by a variety of research funders. Dr. Garcia reports grants and personal fees from Incyte, grants from Bayer, grants, personal fees and non-financial support from Janssen, personal fees and non-financial support from Seattle Genetics, grants from Daiichi Sankyo, outside the submitted work. Dr. Di Nisio reports personal fees from Bayer, personal fees from BMS-Pfizer, personal fees from Leo Pharma, personal fees from Aspen, personal fees from Daiichi Sankyo, outside the submitted work. Dr. Noble reports grants from Leo Pharma, personal fees from Bayer, personal fees from Daiichi Sankyo, outside the submitted work. The remaining authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ventresca, M., Schünemann, H.J., Macbeth, F. et al. Obtaining and managing data sets for individual participant data meta-analysis: scoping review and practical guide. BMC Med Res Methodol 20, 113 (2020). https://doi.org/10.1186/s12874-020-00964-6
- Individual participant data meta-analysis
- Data collection
- Data sharing
- Systematic review
- Practical guide