Skip to main content
Download PDF

Negative pressure wound therapy: Potential publication bias caused by lack of access to unpublished study results data

BMC Medical Research Methodology volume 8, Article number: 4 (2008) Cite this article

Abstract

Background

Negative pressure wound therapy (NPWT) is widely applied, although the evidence base is weak. Previous reviews on medical interventions have shown that conclusions based on published data alone may no longer hold after consideration of unpublished data. The main objective of this study was to identify unpublished randomised controlled trials (RCTs) on NPWT within the framework of a systematic review.

Methods

RCTs comparing NPWT with conventional wound therapy were identified using MEDLINE, EMBASE, CINAHL and The Cochrane Library. Every database was searched from inception to May 2005. The search was updated in December 2006. Reference lists of original articles and systematic reviews, as well as congress proceedings and online trial registers, were screened for clues to unpublished RCTs. Manufacturers of NPWT devices and authors of conference abstracts were contacted and asked to provide study information. Trials were considered nonrandomised if concealment of allocation to treatment groups was classified as "inadequate". The study status was classified as "completed", "discontinued", "ongoing" or "unclear". The publication status of completed or discontinued RCTs was classified as "published" if a full-text paper on final study results (completed trials) or interim results (discontinued trials) was available, and "unpublished" if this was not the case. The type of sponsorship was also noted for all trials.

Results

A total of 28 RCTs referring to at least 2755 planned or analysed patients met the inclusion criteria: 13 RCTs had been completed, 6 had been discontinued, 6 were ongoing, and the status of 3 RCTs was unclear. Full-text papers were available on 30% of patients in the 19 completed or discontinued RCTs (495 analysed patients in 10 published RCTs vs. 1154 planned patients in 9 unpublished RCTs). Most information about conference abstracts and unpublished study information referring to trials that were unpublished at the time these documents were generated was obtained from the manufacturer Kinetic Concepts Inc. (KCI) (19 RCTs), followed by The Cochrane Library (18) and a systematic review (15). We were able to obtain some information on the methods of unpublished RCTs, but results data were either not available or requests for results data were not answered; the results of unpublished RCTs could therefore not be considered in the review. One manufacturer, KCI, sponsored the majority of RCTs (19/28; 68%). The sponsorship of the remaining trials was unclear.

Conclusion

Multi-source comprehensive searches identify unpublished RCTs. However, lack of access to unpublished study results data raises doubts about the completeness of the evidence base on NPWT.

Peer Review reports

Background

Conservative estimates report that about 1% of the population in Western countries is affected by chronic wounds [1], with a much higher prevalence rate in inpatient and nursing facilities [2]. Besides presenting a significant risk factor for complications such as infection and amputation, chronic wounds also lead to marked impairment of patients' quality of life [3, 4].

Negative pressure wound therapy (NPWT) consists of an open-cell foam dressing covered with an adhesive drape. The dressing is connected to a vacuum pump that creates and maintains a subatmospheric pressure [5]. The most commonly used NPWT device is the Vacuum Assisted Closure (V.A.C.®) device.

The Federal Joint Committee (Gemeinsame Bundesausschuss), the decision-making body of the self-administration of the German health care service, commissioned the Institute for Quality and Efficiency in Health Care (Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen, IQWiG) to conduct a systematic review on the efficacy and safety of NPWT versus conventional wound therapy in patients with acute or chronic wounds. The full review was published in German in March 2006, and an English-language article has recently been published [6, 7]. An update of the systematic review, a rapid report, was published in German in January 2007 [8].

Although NPWT is widely applied, particularly for chronic wounds, at the time of the review only a few relevant randomised controlled trials (RCTs) were available; these were, moreover, of poor quality [9]. Previous reviews on NPWT have not provided clear evidence of the superiority of NPWT over conventional wound therapy. For example, a review published by the Canadian Medical Advisory Secretariat in 2006 concluded that "Based on the evidence to date, the clinical effectiveness of NPWT to heal wounds is unclear" [10].

Previous reviews on medical interventions have shown that conclusions on efficacy and safety based on published data alone may no longer hold after consideration of unpublished data, which may reverse favourable risk-benefit profiles and attenuate treatment effects of an apparently superior intervention [11–13]. Within the framework of the systematic review on NPWT, our main objective was therefore not only to identify published, but also unpublished completed or discontinued RCTs in order to gain as complete an overview as possible of the evidence on NPWT. Further aims were to locate ongoing RCTs for potential consideration in future updates, and to determine the type of sponsorship of all eligible trials.

Methods

The literature search comprised a total of 7 steps. Table 1 shows an overview of the sources used.

Table 1 Literature sources and search steps*
Full size table

We searched 4 bibliographic databases (MEDLINE, EMBASE, CINAHL, and The Cochrane Library) for RCTs on NPWT versus conventional wound therapy in patients with acute or chronic wounds. All databases were searched from inception to May 2005. The search was updated in December 2006 within the framework of the preparation of the rapid report on NPWT [8]. The search strategy in MEDLINE (Table 2) was applied according to the Cochrane Highly Sensitive Search Strategy described in the Cochrane Handbook for Systematic Reviews of Interventions [14], and tailored to the requirements of each database. Other search strategies are available upon request.

Table 2 Search strategy applied in MEDLINE
Full size table

We then screened online trial registers (Table 1) and the US Food and Drug Administration website, and contacted German authorities, requesting information on all available RCTs on NPWT. Prior to the start of the review, the Federal Joint Committee had asked experts to provide relevant literature; these citations were also obtained by IQWiG as part of the commission. Moreover, the reference lists of retrieved original articles and systematic reviews, as well as congress proceedings, were handsearched.

Two manufacturers of NPWT devices were identified: Kinetic Concepts Inc. (KCI, San Antonio, Texas, USA) markets the V.A.C.® device, and BlueSky Medical Group Inc. (BSM, Carlsbad, California, USA) markets the Versatile 1 Wound Vacuum System®. Both were asked to provide information on the study status and publication status of sponsored trials, as well as on methods and results. Finally, we contacted the authors of conference abstracts by e-mail and by post. All contact details of the relevant institutions were checked beforehand on the corresponding websites. Manufacturers and authors were informed that IQWiG does not accept "commercial in confidence" data and publishes all data contributing to a systematic review [15].

All languages were included, as long as a title was available in English. If the title indicated a potential relevance of the study, the corresponding article was obtained and translated. Only RCTs comparing NPWT versus conventional therapy were eligible. Trials were considered nonrandomised if concealment of allocation to treatment groups was classified as "inadequate" [16]. The intervention was classified as NPWT if a medical device system identical or comparable to the V.A.C.® Therapy System was used.

Results of trials that were not available as full-text publications were only considered in the review if detailed data were available (e.g. from a clinical study report or a manuscript in press). Results data from conference abstracts were not considered.

All steps of the literature screening were performed by two reviewers independently of one another. Any disagreements were resolved by discussion. The titles and abstracts of the retrieved documents were screened to exclude citations that were clearly irrelevant. The full texts of the remaining potentially relevant articles were then screened to identify RCTs that fulfilled the inclusion criteria stated above.

With the help of the information obtained, the study status of the RCTs identified was classified as "completed", "discontinued", "ongoing" or "unclear". The terminology used in the literature to classify unpublished data or so-called "grey literature" is inconsistent [12]. We classified the publication status of completed or discontinued trials as "published" if a full-text paper on final study results (completed trials) or interim results (discontinued trials) was identified in the literature search, and "unpublished" if this was not the case. In addition, for ongoing trials it was indicated whether interim results were available or not. The type of sponsorship was also noted for all trials.

Only a summary of results on the quality assessment and outcomes of the RCTs included in the IQWiG systematic review and rapid report is presented here, as the main focus of this paper was to identify unpublished RCTs.

Results

An overview of the search results is presented in Table 3. Detailed information on identified published and unpublished RCTs, as well as on the RCTs included in the systematic review and rapid report, is presented in Table 4.

Table 3 Overview of study status, publication status, and sponsorship (Status: December 2006)
Full size table
Table 4 Search results for randomised controlled trials on negative pressure wound therapy* (Status: December 2006)
Full size table

Search results

Of 2675 potentially relevant publications, 317 full-text papers were obtained for further assessment. Of these, 289 were excluded as not relevant (Figure 1).

Figure 1
figure 1

Flow chart of the literature search for RCTs.

Full size image

A total of 28 RCTs on NPWT referring to at least 2755 planned or analysed patients were identified: 13 RCTs (801 patients; 29%) had been completed [17–29], 6 RCTs (848 patients; 31%) had been discontinued [30–35], 6 RCTs (1106 patients; 40%) were ongoing [36–41], and the status of 3 RCTs was unclear [42–44] (Table 3). According to KCI, the main reasons for discontinuation were slow enrolment, high attrition rates, changes in clinical practice, or design flaws [6].

Full-text publications were available on 30% of the 1649 patients in the 19 completed or discontinued RCTs (495 analysed patients in 10 published RCTs vs. 1154 planned patients in 9 unpublished RCTs). Of the 14 conference abstracts on these 19 trials, 6 abstracts (43%) were later published as full-text articles.

Response behaviour of manufacturers and authors

A total of 17 authors and 2 manufacturers were contacted, of whom 10 (59%) and 2 (100%) responded respectively. KCI readily provided information on study and publication status and on methodological issues. BSM did not sponsor relevant RCTs and provided information only on case reports.

One author provided information on an RCT that had been classified as "ongoing", and stated that this trial had recently been completed and the manuscript submitted to The Lancet [22]. As this trial included 162 analysed patients and was the largest RCT on NPWT conducted so far, IQWiG postponed the publication of its review by 2 months until the final results of this RCT were available, in order to include the results in the body of evidence.

Literature sources

The sources of the conference abstracts and unpublished study information referring to 28 RCTs on NPWT are shown in Tables 5, 6: most information was obtained from KCI (19), followed by Cochrane (18), a systematic review (15) [9], and congress proceedings (14) [45].

Table 5 Sources of conference abstracts and unpublished study information on 28 RCTs: databases, trial registers, and systematic reviews
Full size table
Table 6 Sources of conference abstracts and unpublished study information on 28 RCTs: manufacturers, authors, congress proceedings, and authorities
Full size table

The sources of all 11 published full-text articles (referring to 12 completed, discontinued or ongoing RCTs) are shown in Tables 7, 8, 9. All 11 articles were obtained from the Cochrane Library followed by KCI (10), MEDLINE (10), and EMBASE (9).

Table 7 Sources of 11 published full-text articles on 12 RCTs: databases and trial registers
Full size table
Table 8 Sources of 11 published full-text articles on 12 RCTs: systematic reviews
Full size table
Table 9 Sources of 11 published full-text articles on 12 RCTs: manufacturers, authors, congress proceedings, and authorities
Full size table

Summary of quality assessment and outcomes

Published trials

The overall methodological quality of the 12 published RCTs included in the IQWiG systematic review and rapid report was poor. Methodological flaws included the lack of blinding, the lack of intention-to-treat analyses, inadequate allocation concealment, the unclear definition of primary outcomes, and high drop-out rates. Significant differences in favour of NPWT for wound healing parameters, such as time to wound closure or the incidence of wound closure, were shown in 3 of 7 RCTs analysing these outcomes. Data on other patient-relevant outcomes, such as reoperation rates or pain scores, were scarce or not interpretable.

Unpublished trials

Because of insufficient available information on the 9 completed or discontinued unpublished RCTs, an assessment of their quality could not be conducted. Regarding the 5 discontinued industry-sponsored trials, as stated, the reasons for discontinuation were provided by KCI, which also reported the number of enrolled patients for one trial [33]. However, there was no response to a further request from IQWIG asking for more detailed information on all discontinued trials, such as the number of enrolled patients and other results data. Regarding the 4 completed RCTs with unclear sponsorship, the authors of publications did not respond to IQWiG's request to provide results data (Table 4). Consequently, the results of unpublished RCTs could not be considered in the review.

Industrial sponsorship

The manufacturer KCI sponsored the majority (19/28) of RCTs (68% of trials referring to 85% of patients planned or analysed). The sponsorship of the remaining trials was unclear.

Discussion

The main objective of this paper was to identify unpublished RCTs on NPWT within the framework of a systematic review. An RCT was classified as "unpublished" if no full-text paper on final study results (completed trials) or interim results (discontinued trials) was available.

An extensive search strategy was employed that included handsearching of retrievals, as well as contacting manufacturers and authors of publications. The sensitivity of bibliographic database searching for RCTs is reported to be unsatisfactory [46], and multi-source searching has been recommended to retrieve all available RCTs [47]. In this context, the usefulness of handsearching and contacting experts has been demonstrated [48, 49]. The extensive search strategy was also useful to detect ongoing RCTs, of which one [22] was subsequently added to the evidence base.

A total of 28 RCTs referring to at least 2755 patients were identified. The publications on completed or discontinued RCTs reported data on less than a third of patients planned or analysed. Less than half of the conference abstracts on these trials were later published as full-text publications; similar results were found in a review by Scherer et al, who found a full-text publication rate for abstracts describing RCTs or controlled clinical trials of about 60% [50].

On the basis of results of published data alone, the IQWiG review and rapid report concluded that although there was some indication that NPWT may improve wound healing, the body of evidence available was insufficient to clearly prove an additional clinical benefit of NPWT. This finding is in line with findings from previous reviews.

Regarding the discontinued unpublished trials, according to the manufacturer the main reason for discontinuation was insufficient patient numbers. No results data for these trials were available. Regarding the completed unpublished trials, the authors of conference abstracts did not respond to IQWiG's request for information. Therefore, unpublished results data could not be considered in the IQWiG review and consequently the impact of unpublished data on the conclusions of reviews based on published data could not be assessed.

Publication bias caused by unpublished data

Previous research has shown that inclusion of unpublished data in systematic reviews may affect the review's prior conclusions [12, 13]. The most prominent example in recent years has been the evidence on serotonin reuptake inhibitors (SSRIs) in paediatric depression: a systematic review of published versus unpublished data showed that whereas published trials indicated a favourable risk-benefit profile, the addition of unpublished data reversed this profile for some SSRIs [11].

Klassen 2002 assessed the proportion of RCTs presented at a major paediatric meeting that were subsequently published as full publications; about 60% of abstracts were subsequently published, and RCTs were more likely to be published if they favoured the new therapy. The author concluded that "publication bias is a serious threat to assessing the effectiveness of interventions in child health" and called for a registry of RCTs in children so that the totality of evidence could be assessed [51].

As unpublished results data on NPWT were not available, no statement can be made on the impact of unpublished data on the validity of published evidence. However, if one assumes a "worst case scenario" (all unpublished trials show results in favour of conventional therapy), the current conclusion would no longer hold that there is some indication of a potential advantage of NPWT over conventional therapy.

Besides possible problems of statistical evaluation due to insufficient sample sizes, the reasons for the existence of unpublished RCTs on NPWT remain unclear and one can only speculate. For example, it may be possible that some of these RCTs remained unpublished because they were of poor quality or produced negative results. Previous research has shown that studies with statistically significant or positive results are more likely to be published than those with non-significant or negative results, and are also published earlier [52–54]. These studies also lead to a greater number of publications, and are more likely to be published in high impact factor journals [55]. As for discontinued trials, even if small sample sizes make statistical evaluation difficult, in our opinion the full datasets of such trials should be publicly accessible to ensure that the evidence base is complete.

The inclusion of unpublished data in systematic reviews is controversial. Although less than a third of meta-analyses include unpublished data, nearly 80% of meta-analysts and methodologists believe that unpublished data should definitely or probably be included in systematic reviews; in contrast, less than half of journal editors agree [56]. The identification of unpublished data has been recommended to minimise the risk of bias in systematic reviews [12], but there are variations in policy regarding their inclusion [57]. This may be explained by incomplete or inaccurate reporting and the subsequent difficulties in assessing the methodological quality of trials [57, 58].

In general, the quality of reporting of systematic reviews on both drug and non-drug interventions is inconsistent [59]. Moreover, systematic reviews on non-drug interventions (e.g. surgical techniques) face specific problems, such as the limited quality and quantity of RCTs [60]. Searching for unpublished data and conducting sensitivity analyses to assess their impact is recommended for topics with little evidence and new or evolving interventions [58]. In their commentary on the problem of conducting systematic reviews of new health technologies, Moher and Schachter concluded that the inclusion of unpublished data was of "paramount importance" in assessing the usefulness of an intervention [61].

The role of industrial sponsorship

Approximately two thirds of the RCTs on NPWT were sponsored by one manufacturer (KCI). Industrial sponsorship of clinical trials is common. The percentage of industry-sponsored clinical trials has increased to over 60% in recent years and the number of industry employees named as co-authors of clinical trial publications is rising [62]. However, the role of industrial sponsorship in clinical research is controversial. Industry sponsorship is discussed as being associated with the following factors: selection of inappropriate comparators, selective reporting of more favourable per protocol analyses, pro-industry conclusions, as well as restrictions on publication and data sharing [63–65]. A comparison of Cochrane reviews versus industry-supported meta-analyses showed that the latter came to more favourable conclusions on the same drugs [66]. The available data on NPWT are insufficient to make definite conclusions about the impact of industrial sponsorship in this field.

Differences in primary study selection

Five systematic reviews on NPWT (including the IQWiG review) published in December 2004 or later showed considerable differences in the selection of primary studies published between 1994 and 2004 [6, 9, 10, 67, 68]. There was agreement between reviews regarding the selection of 4 RCTs [19, 20, 24, 30]. One further study [17] classified by IQWiG as an eligible RCT was not classified accordingly (or identified) by 2 other reviews [10, 67]. A study [69] classified as an eligible RCT by 2 reviews [9, 68] was classified as non-randomised by IQWiG, and one study [70] classified as an eligible RCT by one other review [68] was also classified as non-randomised by IQWiG. These findings indicate that in systematic reviews on NPWT, search strategies, inclusion criteria, and classification of primary studies are not applied in a standardised manner.

Conclusion

Multi-source comprehensive searches identify unpublished clinical trial data. However, lack of access to unpublished study results data raises doubts about the completeness of the evidence base on NPWT. The implementation of regulations such as prospective mandatory trial registration and the obligation to publish all results is needed to ensure that independent researchers have access to all outcomes of completed or discontinued clinical trials.

References

  1. Graham ID, Harrison MB, Nelson EA, Lorimer K, Fisher A: Prevalence of lower-limb ulceration: a systematic review of prevalence studies. Adv Skin Wound Care. 2003, 16: 305-316. 10.1097/00129334-200311000-00013.

    Article  PubMed  Google Scholar 

  2. Kaltenthaler E, Whitfield MD, Walters SJ, Akehurst RL, Paisley S: UK, USA and Canada: how do their pressure ulcer prevalence and incidence data compare?. J Wound Care. 2001, 10: 530-535.

    Article  CAS  PubMed  Google Scholar 

  3. Wu S, Armstrong DG: Risk assessment of the diabetic foot and wound. Int Wound J. 2005, 2: 17-24. 10.1111/j.1742-4801.2005.00085.x.

    Article  PubMed  Google Scholar 

  4. Persoon A, Heinen MM, van , de Rooij MJ, van de Kerkhof PC, van AT: Leg ulcers: a review of their impact on daily life. J Clin Nurs. 2004, 13: 341-354. 10.1046/j.1365-2702.2003.00859.x.

    Article  PubMed  Google Scholar 

  5. Argenta LC, Morykwas MJ: Vacuum-assisted closure: a new method for wound control and treatment: clinical experience. Ann Plast Surg. 1997, 38: 563-577. 10.1097/00000637-199706000-00002.

    Article  CAS  PubMed  Google Scholar 

  6. Negative pressure wound therapy. Final report (German version). 2006, Cologne, Germany, Institute for Quality and Efficiency in Health Care (IQWiG), [http://www.iqwig.de/download/N04-03_Abschlussbericht_Vakuumversiegelungstherapie_zur_Behandlung_von_Wunden..pdf]

  7. Gregor S, Maegele M, Sauerland S, Krahn J, Peinemann F, Lange S: Negative pressure wound therapy: A vacuum of evidence?. Arch Surg. 2008, 143: 189-196. 10.1001/archsurg.2007.54.

    Article  PubMed  Google Scholar 

  8. Negative pressure wound therapy. Rapid report (German version). 2007, Cologne, Germany, Institute for Quality and Efficiency in Health Care (IQWiG), [http://www.iqwig.de/download/N06-02_Rapid_Report_Vakuumversiegelungstherapie_von_Wunden..pdf]

  9. Samson DJ, Lefevre F, Aronson N: Wound healing technologies: Low-level laser and vacuum-assisted closure. 2004, Rockville, MD, USA, Agency for Healthcare Research and Quality (AHRQ), [http://www.ahrq.gov/clinic/epcsums/woundsum.htm]

    Google Scholar 

  10. Ontario Health Technology Advisory Committee (OHTAC): Negative pressure wound therapy: Update. 2006, Toronto, Ontario, Canada, Ministry of Health and Long-Term Care (MOHLTC) Medical Advisory Secretariat (MAS), 1-38. [http://www.health.gov.on.ca/english/providers/program/ohtac/tech/reviews/pdf/rev_npwt_070106.pdf]

    Google Scholar 

  11. Whittington CJ, Kendall T, Fonagy P, Cottrell D, Cotgrove A, Boddington E: Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet. 2004, 363: 1341-1345. 10.1016/S0140-6736(04)16043-1.

    Article  CAS  PubMed  Google Scholar 

  12. Hopewell S, McDonald S, Clarke M, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database of Methodology Reviews 2006, Issue 2. Art. Edited by: Library TC. 2006, West Sussex, United Kingdom, John Wiley & Sons, Ltd, [http://www.mrw.interscience.wiley.com/cochrane/clsysrev/articles/MR000010/pdf_fs.html]

    Google Scholar 

  13. McAuley L, Pham B, Tugwell P, Moher D: Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. Lancet. 2000, 356: 1228-1231. 10.1016/S0140-6736(00)02786-0.

    Article  CAS  PubMed  Google Scholar 

  14. Appendix 5b: Highly sensitive search strategies for identifying reports of randomized controlled trials in MEDLINE. Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 [updated September 2006]. The Cochrane Library, Issue 4, 2006. Edited by: Higgins JPT and Green S. 2006, Chichester, UK, John Wiley & Sons, Ltd, 182-186. [http://www.cochrane.org/resources/handbook/Handbook4.2.6Sep2006.pdf]

  15. Methods Version 2.0. 2007, Cologne, Germany, Institute for Quality and Efficiency in Health Care (IQWiG), [http://www.iqwig.de/download/Methods_a_second_Version_Produced_by_the_Institutes_Steering_Committee.pdf]

  16. Jüni P, Altman DG, Egger M: Assessing the quality of randomised controlled trials. Systematic reviews in health care - meta-analysis in context. Edited by: Egger M, Davey Smith G and Altman DG. 2001, London, UK, BMJ Publishing Group, 87-108.

    Chapter  Google Scholar 

  17. Eginton MT, Brown KR, Seabrook GR, Towne JB, Cambria RA: A prospective randomized evaluation of negative-pressure wound dressings for diabetic foot wounds. Ann Vasc Surg. 2003, 17: 645-649. 10.1007/s10016-003-0065-3.

    Article  PubMed  Google Scholar 

  18. Moisidis E, Heath T, Boorer C, Ho K, Deva AK: A prospective, blinded, randomized, controlled clinical trial of topical negative pressure use in skin grafting. Plast Reconstr Surg. 2004, United States, 114: 917-922. 10.1097/01.PRS.0000133168.57199.E1.

    Google Scholar 

  19. Joseph E, Hamori CA, Bergman S, Roaf E, Swann NF, Anastasi GW: A prospective randomized trial of vacuum-assisted closure versus standard therapy of chronic nonhealing wounds. Wounds A Compendium of Clinical Research and Practice. 2000, 12: 60-67.

    Google Scholar 

  20. Moues CM, Vos MC, van den Bemd GJ, Stijnen T, Hovius SE: Bacterial load in relation to vacuum-assisted closure wound therapy: a prospective randomized trial. Wound Repair Regen. 2004, United States, 12: 11-17. 10.1111/j.1067-1927.2004.12105.x.

    Google Scholar 

  21. Braakenburg A, Obdeijn MC, Feitz R, van Rooij IALM, van Griethuysen AJ, Klinkenbijl JHG: The clinical efficacy and cost effectiveness of the vacuum-assisted closure technique in the management of acute and chronic wounds: a randomized controlled trial. Plast Reconstr Surg. 2006, United States, 118: 390-397. 10.1097/01.prs.0000227675.63744.af.

    Google Scholar 

  22. Armstrong DG, Lavery LA: Negative pressure wound therapy after partial diabetic foot amputation: a multicentre, randomised controlled trial. Lancet. 2005, 366: 1704-1710. 10.1016/S0140-6736(05)67695-7.

    Article  PubMed  Google Scholar 

  23. Vuerstaek JD, Vainas T, Wuite J, Nelemans P, Neumann MH, Veraart JC: State-of-the-art treatment of chronic leg ulcers: A randomized controlled trial comparing vacuum-assisted closure (V.A.C.) with modern wound dressings. J Vasc Surg. 2006, 44: 1029-1037. 10.1016/j.jvs.2006.07.030.

    Article  PubMed  Google Scholar 

  24. Wanner MB, Schwarzl F, Strub B, Zaech GA, Pierer G: Vacuum-assisted wound closure for cheaper and more comfortable healing of pressure sores: a prospective study. Scand J Plast Reconstr Surg Hand Surg. 2003, 37: 28-33. 10.1080/713796078.

    Article  PubMed  Google Scholar 

  25. Llanos S, Danilla S, Barraza C, Armijo E, Pineros JL, Quintas M, Searle S, Calderon W: Effectiveness of negative pressure closure in the integration of split thickness skin grafts: a randomized, double-masked, controlled trial. Ann Surg. 2006, 244: 700-705. 10.1097/01.sla.0000217745.56657.e5.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Adams TST: The effect of topical negative pressure on donor site wound healing P003. 1999, London, UK, National Research Register, Department of Health, [https://portal.nihr.ac.uk/Profiles/NRR.aspx?Publication_ID=N0245095365]

    Google Scholar 

  27. Fryer J: Investigation of Subatmospheric Pressure Dressing on Pressure Ulcer Healing. 2001, Bethesda, Maryland, USA, ClinicalTrials.gov, National Institutes of Health (NIH), [http://clinicaltrials.gov/ct/show/NCT00011531?order=1]

    Google Scholar 

  28. McCarthy M: Vacuum Assisted Closure for the Management of Ischaemic Wounds in the Lower Limb: A Randomised Controlled Trial and In Vitro Studies. 2005, London, UK, National Research Register, Department of Health, [https://portal.nihr.ac.uk/Profiles/NRR.aspx?Publication_ID=N0123138623]

    Google Scholar 

  29. Walker P: A Randomised, Prospective Trial of Standard Wound Drainage Medinorm VS Constant Vacuum Drainage to Determine Whether There is any Effect on the Amount of Wound Exudate, Haemoglobin & Wound Bruising. 1998, London, UK, National Research Register, Department of Health, [https://portal.nihr.ac.uk/Profiles/NRR.aspx?Publication_ID=N0084029434]

    Google Scholar 

  30. Ford CN, Reinhard ER, Yeh D, Syrek D, De Las MA, Bergman SB, Williams S, Hamori CA: Interim analysis of a prospective, randomized trial of vacuum-assisted closure versus the healthpoint system in the management of pressure ulcers. Ann Plast Surg. 2002, 49: 55-61. 10.1097/00000637-200207000-00009.

    Article  PubMed  Google Scholar 

  31. Bayer L, Orgill DP: Has the wound VAC become the standard of care for the sternal wounds? Abstract DD004. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  32. KCI ID: VAC 2001-02. Venous stasis ulcer. Personal communication from KCI to IQWiG. 2005

  33. Greer SE, Longaker MT, Margiotta M: Preliminary results from a multicenter, randomized, controlled study of the use of subatmospheric pressure dressing for pressure ulcer healing. Wound Repair Regen. 1999, 7: Abstract A255.-

    Google Scholar 

  34. Orgill DP, Bayer L: Preliminary results indicate VAC therapy facilitates faster closure of open abdominal wounds. Abstract DD010. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  35. Stannard JP, Volgas DA, Robinson J, Anglen JO, De Los Santos A: Topical negative pressure therapy for soft tissue management of open fractures: Preliminary results. Abstract E010. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  36. Armstrong DG, Lavery LA, Frykberg RG, Andros G, Attinger CE, Boulten AJM: VAC therapy appears to heal complex DFU. Abstract H013. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  37. McCarthy J: Study to Determine the Utility of Wound Vacuum Assisted Closure (VAC) Compared to Conventional Saline Dressing Changes. 2005, Bethesda, Maryland, USA, ClinicalTrials.gov, National Institutes of Health (NIH), [http://clinicaltrials.gov/ct/show/NCT00121537?order=1]

    Google Scholar 

  38. Molnar JA, Heimbach DM, Tredgett EE, Mozingo DW: Prospective, randomized, controlled, multicenter trial applying subatmospheric pressure to acute hand burns: An interim report. Abstract D008. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  39. Niezgoda JA: A Comparison of Vacuum Assisted Closure Therapy to Moist Wound Care in the Treatment of Pressure Ulcers: Preliminary Results of a Multicenter Trial. Abstract X001. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  40. Stannard JP, Volgas DA, Robinson J, Anglen JO, De Los Santos A: Topical negative pressure therapy as a treatment for draining hematomas following surgical stabilization of skeletal trauma: preliminary results. Abstract E008. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  41. Stannard JP, Volgas DA, Robinson J, Anglen JO, De Los Santos A: Topical negative pressure therapy as an adjunct to soft tissue healing following open reduction and internal fixation of high risk fractures: preliminary results. Abstract E009. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  42. Foo LSS, Chua BSY, Chia GT, Tan SB, Howe TS: Vacuum assisted closure vs moist gauze dressing in post-operative diabetic foot wounds: Early results from a randomised controlled trial. Abstract. Presented at the 2nd World Union of Wound Healing Societies Meeting (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  43. Gupta SC: Sterilizing chronic wounds with negative pressure therapy: the role of antibiotic irrigation. Abstract 127. 2001, Albuquerque, New Mexico, USA., 11th Annual Meeting and Educational Symposuim, Wound Healing Society (16-18 May)

    Google Scholar 

  44. Lantis JC, Gendics C: VAC therapy appears to facilitate STSG take when applied to venous leg ulcers. Abstract P036. Presented at the 2nd World Union of Wound Healing Societies Meeting (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  45. Abstracts of the 2nd World Union of Wound Healing Societies, Paris, France, July 8-13, 2004. Wound Repair Regen. 2005, 13: A49-A87. 10.1111/j.1067-1927.2004.130321.x.

  46. Dickersin K, Scherer R, Lefebvre C: Identifying relevant studies for systematic reviews. BMJ. 1994, 309: 1286-1291. [http://www.bmj.com/cgi/content/full/309/6964/1286]

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Crumley ET, Wiebe N, Cramer K, Klassen TP, Hartling L: Which resources should be used to identify RCT/CCTs for systematic reviews: a systematic review. BMC Med Res Methodol. 2005, 5: 24.-10.1186/1471-2288-5-24. [http://www.biomedcentral.com/1471-2288/5/24]

    Article  PubMed  PubMed Central  Google Scholar 

  48. Hopewell S, Clarke M, Lefebvre C, Scherer R: Handsearching versus electronic searching to identify reports of randomized trials. Cochrane Database of Methodology Reviews 2002, Issue 4. Edited by: Library TC. 2002, West Sussex, United Kingdom, John Wiley & Sons, Ltd, [http://www.mrw.interscience.wiley.com/cochrane/clsysrev/articles/MR000001/pdf_fs.html]

    Google Scholar 

  49. McManus RJ, Wilson S, Delaney BC, Fitzmaurice DA, Hyde CJ, Tobias RS, Jowett S, Hobbs FD: Review of the usefulness of contacting other experts when conducting a literature search for systematic reviews. BMJ. 1998, 317: 1562-1563.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Scherer RW, Langenberg P, von Elm E: Full publication of results initially presented in abstracts. Cochrane Database of Methodology Reviews 2005, Issue 2. Art. No.: MR000005. Edited by: Library TC. 2005, West Sussex, United Kingdom, John Wiley & Sons Ltd, [http://www.mrw.interscience.wiley.com/cochrane/clsysrev/articles/MR000005/pdf_fs.html]

    Google Scholar 

  51. Klassen TP, Wiebe N, Russell K, Stevens K, Hartling L, Craig WR, Moher D: Abstracts of randomized controlled trials presented at the society for pediatric research meeting: an example of publication bias. Arch Pediatr Adolesc Med. 2002, 156: 474-479.

    Article  PubMed  Google Scholar 

  52. Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ: Publication and related biases. Health Technol Assess. 2000, 4: 1-115. [http://www.ncchta.org/execsumm/summ410.htm]

    Google Scholar 

  53. Stern JM, Simes RJ: Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997, 315: 640-645. [http://bmj.bmjjournals.com/cgi/content/full/315/7109/640]

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Ioannidis JP: Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998, 279: 281-286. 10.1001/jama.279.4.281.

    Article  CAS  PubMed  Google Scholar 

  55. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR: Publication bias in clinical research. Lancet. 1991, 337: 867-872. 10.1016/0140-6736(91)90201-Y.

    Article  CAS  PubMed  Google Scholar 

  56. Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, McIlroy W, Oxman AD: Should unpublished data be included in meta-analyses? Current convictions and controversies. JAMA. 1993, 269: 2749-2753. 10.1001/jama.269.21.2749.

    Article  CAS  PubMed  Google Scholar 

  57. Dundar Y, Dodd S, Dickson R, Walley T, Haycox A, Williamson PR: Comparison of conference abstracts and presentations with full-text articles in the health technology assessments of rapidly evolving technologies. Health Technol Assess. 2006, 10: iii-145.

    Article  CAS  PubMed  Google Scholar 

  58. Hartling L, McAlister FA, Rowe BH, Ezekowitz J, Friesen C, Klassen TP: Challenges in systematic reviews of therapeutic devices and procedures. Ann Intern Med. 2005, 142: 1100-1111.

    Article  PubMed  Google Scholar 

  59. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and Reporting Characteristics of Systematic Reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.

    Article  PubMed  PubMed Central  Google Scholar 

  60. McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D: Randomised trials in surgery: problems and possible solutions. BMJ. 2002, 324: 1448-1451. 10.1136/bmj.324.7351.1448. [http://bmj.bmjjournals.com/cgi/reprint/324/7351/1448]

    Article  PubMed  PubMed Central  Google Scholar 

  61. Moher D, Schachter HM: Potential solutions to the problem of conducting systematic reviews of new health technologies. CMAJ. 2002, 166: 1674-1675.

    PubMed  PubMed Central  Google Scholar 

  62. Buchkowsky SS, Jewesson PJ: Industry sponsorship and authorship of clinical trials over 20 years. Ann Pharmacother. 2004, 38: 579-585. 10.1345/aph.1D267.

    Article  PubMed  Google Scholar 

  63. Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B: Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. BMJ. 2003, 326: 1171-1173. 10.1136/bmj.326.7400.1171.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003, 289: 454-465. 10.1001/jama.289.4.454.

    Article  PubMed  Google Scholar 

  66. Jorgensen AW, Hilden J, Gotzsche PC: Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ. 2006, 333: 782-10.1136/bmj.38973.444699.0B.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Costa V, Brophy J, McGregor M: Vacuum-assisted wound closure therapy (V.A.C (R)). 2005, Montreal, Quebec, Canada, McGill University Health Centre (MUHC) Technology Assessment Unit (TAU), 1-24. [http://upload.mcgill.ca/tau/VAC_REPORT_FINAL.pdf]

    Google Scholar 

  68. Pham CT, Middleton PF, Maddern GJ: The safety and efficacy of topical negative pressure in non-healing wounds: a systematic review. J Wound Care. 2006, England, 15: 240-250.

    Google Scholar 

  69. McCallon SK, Knight CA, Valiulus JP, Cunningham MW, McCulloch JM, Farinas LP: Vacuum-assisted closure versus saline-moistened gauze in the healing of postoperative diabetic foot wounds. Ostomy Wound Manage. 2000, 46: 28-34.

    CAS  PubMed  Google Scholar 

  70. Genecov DG, Schneider AM, Morykwas MJ, Parker D, White WL, Argenta LC: A controlled subatmospheric pressure dressing increases the rate of skin graft donor site reepithelialization. Ann Plast Surg. 1998, 40: 219-225. 10.1097/00000637-199803000-00004.

    Article  CAS  PubMed  Google Scholar 

  71. Negative pressure wound therapy for wound healing. 2003, Lansdale, Pennsylvania, USA, Hayes, Inc

  72. Ontario Health Technology Advisory Committee (OHTAC): Vacuum assisted closure therapy for wound care. 2004, Toronto, Ontario, Canada, Ministry of Health and Long-Term Care (MOHLTC) Medical Advisory Secretariat (MAS), 1-59.

    Google Scholar 

  73. Pham C, Middleton P, Maddern G: Vacuum-assisted closure for the management of wounds: an accelerated systematic review. 2003, Adelaide, Australia, Australian safety and efficacy register of new interventional procedures - surgical (ASERNIP-S), [http://www.surgeons.org/asernip-s/publications_vacuum.htm]

    Google Scholar 

  74. Vuerstaek JDD, Wuite J, Neuman H, Steijlen P, Veraart JCJM: The management of recalcitrant leg ulcers. Abstract P029. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  75. Obdeijn MC, Braakenburg A, Feit R, Klinkenbul: Vac therapy versus hydrocolloids in acute and chronic wounds. Abstract E012. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  76. Payne W: VAC therapy vs. moist wound therapy in the treatment of diabetic foot amputation wounds: preliminary results of a multicenter trial. Abstract E011. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  77. Moues CM, Van Den Bemd GJCM, Heule F, Hovius SER: A prospective randomized trial comparing vacuun therapy to conventional moist gauze therapy. Abstract A001. Presented at the 2nd World Union of Wound Healing Societies Meeting 2004 (July 8-13), Paris, France. 2004, Paris, France, Second World Union of Wound Healing Societies Meeting (08-13 July)

    Google Scholar 

  78. Heath T, Moisidis E, Deva A: A prospective controlled trial of vacuum assisted closure (VAC) in the treatment of acute surgical wounds requiring split skin grafting. Abstract. . 2002, Adelaide, Australia, Fourth Australian Wound Management Association Conference (March)

    Google Scholar 

  79. Joseph E, Hamori CA, Bergman S, Roaf C, Swan N: A prospective randomized trial of vacuum-assisted closure versus standard therapy of chronic nonhealing wounds. Abstract. 1999, Denver, Colorado, USA, 14th Annual Clinical Symposium on Wound Care (30 September - 04 October)

    Google Scholar 

  80. Stannard JP, Robinson JT, Anderson ER, McGwin GJ, Volgas DA, Alonso JE: Negative pressure wound therapy to treat hematomas and surgical incisions following high-energy trauma. J Trauma. 2006, United States, 60: 1301-1306.

    Google Scholar 

  81. Buttenschön K, Fleischmann W, Haupt U, Kinzl L, Buttenschön DC: The influence of vacuum-assisted closure on inflammatory tissue reactions in the postoperative course of ankle fractions. Foot Ankle Surg. 2001, 7: 165-173. 10.1046/j.1460-9584.2001.00258.x.

    Article  Google Scholar 

  82. Jeschke MG, Rose C, Angele P, Fuchtmeier B, Nerlich MN, Bolder U: Development of new reconstructive techniques: use of Integra in combination with fibrin glue and negative-pressure therapy for reconstruction of acute and chronic wounds. Plast Reconstr Surg. 2004, United States, 113: 525-530. 10.1097/01.PRS.0000100813.39746.5A.

    Google Scholar 

  83. Evans D, Land L: Topical negative pressure for treating chronic wounds. The Cochrane Database of Systematic Reviews. Art. No.: CD001898. DOI: 10.1002/14651858. Edited by: Library TC. 2001, West Sussex, United Kingdom, John Wiley & Sons Ltd, [http://www.mrw.interscience.wiley.com/cochrane/clsysrev/articles/CD001898/pdf_fs.html]

    Google Scholar 

  84. Fisher A, Brady B: Vacuum assisted wound closure therapy. 2003, Ottawa, Ontario, Canada, The Canadian Coordinating Office for Health Technology Assessment (CCOHTA), [http://cadth.ca/media/pdf/221_vac_cetap_e.pdf]

    Google Scholar 

  85. Higgins S: The effectiveness of vacuum assisted closure (VAC) in wound healing. 2003, Clayton, Australia, Centre for Clinical Effectiveness (CCE), [http://www.mihsr.monash.org/cce/res/pdf/c/991fr.pdf]

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

IQWiG is an independent non-profit and non-government institute that evaluates the quality and efficiency of health care services in Germany. All work on this study was supported by IQWiG within the framework of a systematic review on NPWT performed by IQWiG. Three authors (FP, NM, StL) are IQWiG full-time employees; one author (StS) works as an external expert for IQWiG.

Author information

Authors and Affiliations

  1. Institute for Quality and Efficiency in Health Care (IQWiG), Dillenburger Str. 27, 51105, Cologne, Germany

    Frank Peinemann, Natalie McGauran & Stefan Lange

  2. Institute for Research in Operative Medicine, University of Witten/Herdecke, Ostmerheimer Str. 200, 51109, Cologne, Germany

    Stefan Sauerland

Authors
  1. Frank Peinemann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Natalie McGauran
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stefan Sauerland
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stefan Lange
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frank Peinemann.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

StL initiated the study. FP coordinated the study and conducted the literature search. StL, FP, and StS screened and analysed the retrievals. NM and FP drafted the manuscript. All authors interpreted the data and made an intellectual contribution to the manuscript. All authors reviewed and approved the final version.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Peinemann, F., McGauran, N., Sauerland, S. et al. Negative pressure wound therapy: Potential publication bias caused by lack of access to unpublished study results data. BMC Med Res Methodol 8, 4 (2008). https://doi.org/10.1186/1471-2288-8-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2288-8-4

Keywords

  • Chronic Wound
  • Conference Abstract
  • Negative Pressure Wound Therapy
  • Unpublished Trial
  • Discontinue Trial

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us