- Research
- Open access
- Published:
The quality of reporting in case reports of permanent neonatal diabetes mellitus: a cross-sectional study
BMC Medical Research Methodology volume 24, Article number: 117 (2024)
Abstract
Background
Although randomized trials and systematic reviews provide the best evidence to guide medical practice, many permanent neonatal diabetes mellitus (PNDM) studies have been published as case reports. However, the quality of these studies has not been assessed. The purpose of this study was to assess the extent to which the current case reports for PNDM comply with the Case Report (CARE) guidelines and to explore variables associated with the reporting.
Method
Six English and four Chinese databases were searched from their inception to December 2022 for PNDM case reports. The 23 items CARE checklist was used to measure reporting quality. Primary outcome was the adherence rate of each CARE item and second outcome was total reporting score for each included PNDM case report. Linear and logistic regression analyses were used to examine the connection between five pre-specified predictor variables and the reporting quality. The predictor variables were impact factor of the published journal (<3.4 vs. ≥3.4, categorized according to the median), funding (yes vs. no), language (English vs. other language), published journal type (general vs. special) and year of publication (>2013 vs. ≤ 2013).
Result
In total, 105 PNDM case reports were included in this study. None of the 105 PNDM case reports fulfilled all 23 items of the CARE checklist. The response rate of 11 items were under 50%, including prognostic characteristics presentation (0%), patient perspective interpretation (0%), diagnostic challenges statement (2.9%), clinical course summary (21.0%), diagnostic reasoning statement (22.9%), title identification (24.8%), case presentation (33.3%), disease history description (34.3%), strengths and limitations explanation (41.0%), informed consent statement (45.7%), and lesson elucidation (47.6%). This study identified that the PNDM case reports published in higher impact factor journals were statistically associated with a higher reporting quality.
Conclusion
The reporting of case reports for PNDM is generally poor. As a result, this information may be misleading to providers, and the clinical applications may be detrimental to patient care. To improve reporting quality, journals should encourage strict adherence to the CARE guidelines.
Background
Neonatal diabetes mellitus (NDM) is a rare metabolic disease with an incidence of 90,000-160,000 neonates [1]. The permanent form of neonatal diabetes mellitus (PNDM) accounts for approximately half of all cases, with an incidence of one in 260,000 live births [2]. PNDM is a lifelong disease without remission that requires treatment throughout life [3]. The main clinical manifestations are hyperglycemia, intrauterine growth retardation, ketoacidosis, weight loss and reduced quality of life [4]. Given the severe condition and substantial medical need of PNDM, there is an urgent need for high-quality clinical research to guide PNDM clinical practice [5].
However, traditional clinical research methods for PNDM are often impeded by the scarcity and geographical dispersion of patients and the involvement of children, which can result in deficiencies in the development of clinical research evidence [6]. For example, Tudur found that compared to non-rare disease clinical trials, rare disease clinical trials are single-arm, non-randomized, non-blind, open-label, and too fragile to be terminated early [7]. Given the problems with recruitment in PNDM research, innovative strategies for rare disease clinical research are urgently required for high-quality diagnosis and treatment evidence [5].
Case reports have been used to recognize the genetic cause, main symptoms, medical, family, or psychosocial history, and clinical diagnostic, therapeutic, and prognostic information of PNDM [8,9,10,11]. However, there is a continuing debate about the validity of PNDM case reports and their value to practicing clinicians [12]. These case reports are generally regarded as having poor evidential quality because of their prose and spontaneous reporting [13]. Written without the benefit of reporting guidelines, case reports are often insufficiently rigorous to be aggregated for data analysis, to inform research design, or to guide clinical practice [13].
Surprisingly, general international reporting guidelines for case reports did not exist until the CARE (CAse REport) Guidelines were published [13]. Although PNDM case reports are overrepresented in the literature, little is known about reporting quality. A lack of adequate reporting of details would make the effective use of such case reports evidence less likely. Under certain circumstances, this can lead misinformed healthcare decisions. Therefore, this study conducted a cross-sectional study to specifically assess the extent to which the current case reports for PNDM complied with the CARE guidelines and explore factors associated with reporting.
Methods
Inclusion criteria
All case reports enrolled patient diagnosed with PNDM will be included. PNDM was defined as a diagnosis of diabetes within 4 or 6 weeks of birth [3]. An included case report should report useful clinical information on PNDM, such as clinical findings, patient characteristics, diagnosis or therapeutic information. There was no limitation on the publication language.
Literature search and screening
This study searched PubMed, EMBASE, Scopus, Web of Science, CINAHL, Medrxiv, and four Chinese Databases, SinoMed, National Knowledge Infrastructure (CNKI), Wanfang, and VIP, from inception to 1st of December 2022. A combination of keywords and Medical Subject Headings related to PNDM and case report was used ("pediatric”, “PNDM”, “NDM”, "permanent neonatal diabetes mellitus”, "case report”, "WRS” and "Wolcott-Rallison syndrome"). The reference lists of eligible papers were also manually screened for articles that were not identified by the computerized search. Further details are provided in Appendix 1.
Pairs of well-trained authors, independently and in duplicate, scanned titles and abstracts to exclude obviously irrelevant studies, and potentially eligible articles were investigated in full text. Disagreements were resolved by discussion between the two reviewers; if no consensus was achieved, a third reviewer was involved.
Data collection
Data extraction was performed by two authors using a predefined data sheet that included general publication information: name of the first author, year of publication, published language, region of the first author, funding information, journal where the care report was published, and the journal’s impact factor.
The CARE guidelines checklist was used to assess the reporting quality of case reports [15]. We slightly modified the checklist by merging some sub-items into one item: 1) the four sub-item “the main symptoms of the patient, main clinical findings, the main diagnoses and interventions and the main outcomes” were merged as item 3b “Case Presentation”; 2) types of intervention (eg, pharmacologic, surgical, preventive, self-care), administration of intervention (eg, dosage, strength, duration) and changes in intervention (with rationale) were merged as item 9 “therapeutic intervention”; 3) clinician and patient-assessed outcomes, important follow-up test results (positive or negative), intervention adherence and tolerability (and how this was assessed) and adverse and unanticipated events were merged as item 10 “clinical course of all follow-up visits”; The merging resulting in 23 items of the finally CARE guideline checklist, see details in the Appendix 2.
Outcome
For each included PNDM case report, quality of reporting against the 23 items was determined as “Yes”, “Partially yes”, or “No”. The primary outcome was Adherence Rate. The Adherence rate (AR=n/N) and 95% confidence interval (CI) were used to reflect the degree of compliance of each case report to each item of CARE checklist, where n is the number of PNMD case reports adhering to the requirement of a certain item, and N is the total number of PNMD case reports. The present study summarized the AR of each item at three levels: met by 80% or above was well complied, 50 to 79% was moderately complied, and less than 50% was poorly complied.
The second outcome was the total score of reporting. The item rated as “Yes” “Partially yes” or “No” was given a point of 2, 1 or 0 respectively. Possible scores ranged from 0 to 46. Higher scores indicated better quality. The purpose of the score was to explore the connections between some pre-specified factor and reporting quality.
Data analysis
Baseline characteristics which included multinomial (language, region of first author, impact factor of the published journal) and dichotomous variables (year of publication, published journal type, sources of funding) were described as number and percentages.
This study pre-specified five variables to explore their connection to reporting quality. These were impact factor of the published journal (<3.4 vs. ≥3.4, categorized according to the median), funding (yes vs. no), language (English vs. other language), journal type (general vs. special) and year of publication (≤ 2013 vs. >2013). The year was categorized based on the year CARE was published. Reporting scores of the five pre-specified group were calculated as median and interquartile ranges (IQR). Standardized β coefficient with 95% confidence intervals (CI) were calculated using univariate and multivariate linear regression analyses to examine the association between reporting score and the pre-specified variables.
In order to avoid the bias of the score system on the results, we conducted a logistic regression in which the adherence to each 23 items CARE checklist was categorized as two group (Yes or No), the predictor factor was “published journal (<3.4 vs. ≥3.4, categorized according to the median), funding (yes vs. no), language (English vs. other language), published journal type (general vs. special) and year of publication (≤ 2013 vs. >2013). Standardized Odds Ratio (OR) with 95% CI was estimated by the logistic regression to examine the association between response quality and the five variables.
All the analyses were conducted using Stata14.0/SE software (STATA, College Station, TX, Serial number: 10699393), and alpha = 0.05 was the criterion for statistical significance.
Results
The initial search yielded 1664 reports, of which 1316 were eliminated due to duplication or title and abstract screening. After full-text reading, 105 case reports on PNDM were included. No additional case reports were identified through the reference list screening (Fig. 1).
Characteristics of included studies
A total of 105 PNDM case reports were published between 1971 and December 2022. The majority were published in English (93.33%). Research groups from Asian contributed most (40.00%), followed by European (38.09%), and North American (17.14%) groups. Majority of case reports were published in specialized journals (86.67%), such as pediatrics and endocrinology. The median impact factor for the published journals was 3.40 (IQR: 1.48, 4.50). Almost half of the included cases reported funding resources (57/105), all of which were provided by nonprofit funding agencies (Table 1).
Adherence rate of each reporting item
The overall CARE scores resulted in a median score of 28 (IQR: 23, 30). None of the 105 PNDM case reports fulfilled all 23 items of the CARE checklist: five out of 23 items were well complied, seven were moderately complied, and 11 were poorly complied. The adherence rates for the items reported in the CARE checklist are listed in Table 2.
The title section item, which was identified as “elucidated the study as ‘case report’ along with phenomenon of greatest interest”, was poorly complied (AR=24.8%, 95% CI: 16.4, 33.2%). The keyword element describing the key information of the case as 2-5 words was moderately complied with 61.9% (95% CI: 52.5, 71.3%) of the PNDM case reports adhering this item.
Of the three items in the abstract section, the item of introduction narration was moderately complied (AR=60.0%, 95% CI:50.5, 69.5%), while the other two items were poorly complied: case presentation (AR=33.3%, 95% CI:24.2, 42.5%) and lesson elucidation (AR=47.6%, 95% CI:37.9, 57.3%). The background summary was complied by 79.0% (95% CI: 71.1, 87.0%) of the PNDM case repots.
In terms of the patient information (three items), 59 (AR=56.2%, 95 CI:46.5, 65.8%) provided details of demographic information, and a large proportion (AR=96.2%, 95% CI: 92.5, 99.9%) specified the main symptoms of the patient, while only a small proportion (AR=34.3%, 95% CI:25.1, 43.5%) specified details regarding the medical, family, and psychosocial history.
Within the diagnostic assessment element, there were 4 items identified, including clarifying the diagnostic methods (AR=94.3%, 95% CI: 89.8, 98.8%), diagnostic reasoning (AR=22.9%, 95% CI: 14.7, 31.0%.), diagnostic challenges (AR=2.9%, 95% CI: -0.4, 6.1%) and prognostic characteristics (AR=0%).
Of the four items in the discussion section, relevant medical literature, rationale for conclusion and main take-away’ lessons were evaluated completely in 90 (AR=85.7%, 95% CI: 78.9, 92.5%), 89 (AR=84.8%, 95% CI: 77.8, 91.8%) and 69 (AR=65.7%, 95% CI: 56.5, 74.9%) PNDM case reports, respectively. Total compliance was less than 50% in the strengths and limitations item (41.0%, 95%CI: 31.4, 50.5%).
With regard to the four separately specified items, description of physical examination (AR=89.5%, 95%CI:83.6, 95.5%) was highly adhered, types of intervention (AR=75.2%, 95%CI:66.8, 83.6%) and important dates and times (AR=56.2%, 95%CI:46.5, 65.8%) were moderately adhered. The remaining item summarized the clinical course of all follow-up visits (AR=21.0%, 95%CI:13.0, 28.9%) was poorly addressed.
For the two alternative items, informed consent was poorly complied (AR=45.7%, 95CI: 36.0, 55.4), while the reporting of patient perspective was seriously limited (AR=0%).
Factors associated with the reporting quality
The median and IQR of reporting score in the case reports published with funding, in English language and after year 2013 were 27.0 (23.5 to 30.5), 27.5 (23.7, 30.0) and 28.0 (24.0, 31.0). For those case reports that in general and impact factor ≥3.4 journals, the median and IQR of reporting score were 25.0 (21.2, 29.0) and 27.0 (22.0, 29.0).
Multivariable linear regression analyses showed that PNDM case reports published in higher impact factor journals were statistically associated with a higher total score (standardized β coefficient 0.27, 95% CI: -4.98 to 0.59), while those published in recent years (standardized β coefficient 0.12, 95% CI: -0.89 to 3.46), in English (standardized β coefficient -0.14, 95% CI: -7.08 to 1.48), in a general journal (standardized β coefficient -0.17, 95% CI: -5.79 to 0.50), and with funding supporting (standardized β coefficient -0.90, 95% CI: -3.09 to 1.29) were not associated with the reporting (Table 3).
The multiple logistic regression showed that PNDM case reports published in English (OR 15.94, 95% CI 1.59, 160.16) and higher impact factor journals (impact factor ≥3.4) (OR 2.77, 95% CI 1.03, 7.40) were associated with a higher likelihood of case presentation. Similarly, PNDM case reports published in the higher impact factor journals were more likely to achieve reporting the conclusion (OR 3.21, 95% CI 1.29, 8.00) and brief background summary (OR 6.23, 95% CI 1.50, 25.71). PNDM case reports published in general journals (OR 7.53, 95% CI 1.43, 39.76) and with funding support (OR 3.78, 95% CI 1.45, 9.85) were associated with a higher likelihood of achieving informed consent (Table 4).
Discussion
The present study collected case reports on PNDM over the past half century. To the best of our knowledge, this is the first epidemiological study to systematically assess the extent to which case reports comply with reporting guidelines in this specific field. A total of 105 case reports for PNDM were identified. Across these case reports, this study found that the critical details regarding prognostic characteristics, patient perspectives, diagnostic challenges, follow-up visits, diagnostic reasoning, title and case presentation were often omitted. The apparent low adherence rate was primarily due to poor reporting; however, the non-mandatory requirement (patient perspective or prognostic characteristics) of the items may also affect the assessment [14]. The failure to report diagnostic information was probably due to the lack and disarray of diagnostic criteria in the area of rare diseases [5]. The under-reporting of follow-up visits could be partly because this information was not available, as the patient did not revisit the physician or died because of progressive disease [16].
Conversely, this study found that the items related to therapeutic intervention were better reported (more than 70% of case studies complied completely), such as the type, administration and changes in intervention. This finding was consistent with studies addressing the reporting quality using CARE guidelines in high-impact journals (AR=79.9%) [17], coronavirus disease (AR=84.0%) [18] and dental trauma field (AR=98.0%) [19]. A study conducted in emergency medicine used self-made 11 items scale by referring to clinical epidemiology textbooks, guidelines for critical appraisal studies, and the Users’ Guides to Evidence-Based Medicine also found similar result (AR=79.9%) [12]. Although the evaluation tools are different, these studies reflected the attentions of clinical intervention by authors, editors, and peer reviewers.
The inconsistent and suboptimal reporting across items implies that certain items may have been treated differently, as to their importance [20]. Retaining more clinically significant content and removing details about the methodology was often suggested by the editor, as journals usually pay more attention to the clinical value of research [21]. Given that some PNDM case reports were published as letters that may have strict word limitations, the deletion of “non-sense” information is even more common [12]. We would argue that while journal space is valuable, editors must balance the need to be concise with the importance of adequate case descriptions.
Both our linear and logistic regression analyses identified that the PNDM case reports published in higher impact factor journals were statistically associated with a higher reporting quality. This was consistent with the research published in 2018 and 2020 [17, 22]. Even though the use of journal impact factor as surrogate metric to measure journal quality is controversial [23], but it’s worth to mention that the overall completeness in reporting was high for CARE endorsing journals, such as the BMJ Case Reports and JAMA [17].
Strengths and limitations
This study has several strengths. We innovatively assessed the quality of the PNDM case reports using the widely accepted CARE checklist. Second, a comprehensive search, explicit eligibility criteria, rigorous methods for screening studies and data collection ensured transparency and reproducibility of judgments. Third, the use of two independent reviewers for the preselection of case reports, assessment quality and data extraction was of great help in avoiding errors and subjective judgments.
This study has some limitations. First, the results were confined to PNDM case reports, which constituted a small fraction of case reports. Second, we scored reporting quality and added a category “Partially yes” to each item that may skew the results. Third, we did not include any grey literature and the reporting quality of these case reports was unknown. We expect such a report to be rare. Fourth, the non-mandatory requirement of some items may underestimate the results of the reporting quality.
Conclusion
Reporting of PNDM case reports is generally suboptimal. Substantial effort is needed to improve reporting, especially the reporting of case presentation, diagnostic assessment, follow-up, and outcomes. A larger word count may be beneficial for better reporting. To improve reporting quality, journals should encourage strict adherence to the CARE guidelines.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Abbreviations
- AR:
-
Adherence rate
- CI:
-
Confidence interval
- CARE:
-
CAse REport
- IQR:
-
Interquartile range
- NDM:
-
Neonatal diabetes mellitus
- OR:
-
Odds rate
- PNDM:
-
Permanent neonatal diabetes mellitus
Reference
Lemelman MB, Letourneau L, Greeley SAW. Neonatal diabetes mellitus: an update on diagnosis and management. Clin Perinatol. 2018;45(1):41–59.
Habeb AM, Al-Magamsi MS, Eid IM, Ali MI, Hattersley AT, Hussain K, et al. Incidence, genetics, and clinical phenotype of permanent neonatal diabetes mellitus in northwest Saudi Arabia. Pediatr Diabetes. 2012;13(6):499–505.
Slingerland AS, Shields BM, Flanagan SE, Bruining GJ, Noordam K, Gach A, et al. Referral rates for diagnostic testing support an incidence of permanent neonatal diabetes in three European countries of at least 1 in 260,000 live births. Diabetologia. 2009;52(8):1683–5.
Beltrand J, Elie C, Busiah K, Fournier E, Boddaert N, Bahi-Buisson N, et al. Sulfonylurea therapy benefits neurological and psychomotor functions in patients with neonatal diabetes owing to potassium channel mutations. Diabetes Care. 2015;38(11):2033–41.
Dunoyer M. Accelerating access to treatments for rare diseases. Nat Rev Drug Discovery. 2011;10(7):475–6.
van der Lee JH, Wesseling J, Tanck MW, Offringa M. Efficient ways exist to obtain the optimal sample size in clinical trials in rare diseases. J Clin Epidemiol. 2008;61(4):324–30.
Bell SA, Tudur Smith C. A comparison of interventional clinical trials in rare versus non-rare diseases: an analysis of ClinicalTrials.gov. Orphanet J Rare Dis. 2014;9:170.
Ille J, Putarek NR, Radica A, Hattersley A, Ellard S, Dumić M. Low doses of sulphonyluria as a successful replacement for insulin therapy in a patient with neonatal diabetes due to a mutation of KCNJ11 gene encoding Kir6.2. Lijecnicki Vjesnik. 2010;132(3–4):90–3.
Kim MS, Kim SY, Kim GH, Yoo HW, Lee DW, Lee DY. Sulfonylurea therapy in two Korean patients with insulin-treated neonatal diabetes due to heterozygous mutations of the KCNJ11 gene encoding Kir6.2. J Korean Med Sci. 2007;22(4):616–20.
Mirza A, Dhillon RA, Irfan O, Amin A, Salat M. Neonatal diabetes mellitus - is trisomy 21 associated with refractory hyperglycaemia? J Ayub Med Coll Abbottabad. 2022;34(Suppl 1)(3):S717–s19.
Razzaghy-Azar M, Nourbakhsh M, Talea A, Mohammad Amoli M, Nourbakhsh M, Larijani B. Meglitinide (repaglinide) therapy in permanent neonatal diabetes mellitus: two case reports. J Med Case Rep. 2021;15(1):535.
Richason TP, Paulson SM, Lowenstein SR, Heard KJ. Case reports describing treatments in the emergency medicine literature: missing and misleading information. BMC Emerg Med. 2009;9:10.
Gagnier JJ, Kienle G, Altman DG, Moher D, Sox H, Riley D. The CARE guidelines: consensus-based clinical case reporting guideline development. Glob Adv Health Med. 2013;2(5):38–43.
Rison RA, Kidd MR, Koch CA. The CARE (CAse REport) guidelines and the standardization of case reports. J Med Case Reports. 2013;7:261.
Gagnier JJ, Kienle G, Altman DG, Moher D, Sox H, Riley D. The CARE guidelines: consensus-based clinical case reporting guideline development. BMJ Case Rep. 2013:bcr2013201554.
Kaszkin-Bettag M, Hildebrandt W. Case reports on cancer therapies: the urgent need to improve the reporting quality. Glob Adv Health Med. 2012;1(2):8–10.
Calvache JA, Vera-Montoya M, Ordoñez D, Hernandez AV, Altman D, Moher D. Completeness of reporting of case reports in high-impact medical journals. Eur J Clin Invest. 2020;50(4):e13215.
Scaffidi MA, Gimpaya N, Li J, Bansal R, Verma Y, Elsolh K, et al. Completeness of reporting for COVID-19 case reports, January to April 2020: a meta-epidemiologic study. CMAJ Open. 2021;9(1):E295–e301.
Seguel-Moraga P, Onetto JE, Uribe SE. Reporting quality of case reports about dental trauma published in international journals 2008–2018 assessed by CARE guidelines. Dent Traumatol. 2021;37(2):345–53.
Jia P, Tang L, Yu J, Liu J, Kang D, Sun X. The quality of reporting in randomized controlled trials of acupuncture for knee osteoarthritis: a cross-sectional survey. PLoS One. 2018;13(4):e0195652.
Kim KH, Kang JW, Lee MS, Lee JD. Assessment of the quality of reporting for treatment components in cochrane reviews of acupuncture. BMJ Open. 2014;4(1):e004136.
Ravi R, Mulkalwar A, Thatte UM, Gogtay NJ. Medical case reports published in PubMed-indexed Indian journals in 2015: adherence to 2013 CARE guidelines. Indian J Med Ethics. 2018;3(3):192–5.
Bornmann L, Marx W. The journal impact factor and alternative metrics: a variety of bibliometric measures has been developed to supplant the impact factor to better assess the impact of individual research papers. EMBO Rep. 2016;17(8):1094–7.
Acknowledgements
Not applicable.
Funding
This project was supported by the Fundamental Research Program of Shanxi Province No. 202303021222159.
Author information
Authors and Affiliations
Contributions
PLJ conceived and designed the study, analyzed the data, and drafted the manuscript; LW, XY and WTF collected the data, assessed the quality; CX and JLF screened the literature; YH and PLJ provided methodological comments and revised the manuscript. All authors revised the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable. This study did not report on or involve any animal or human participants, human material, or human data.
Consent for publication
Not applicable. This study did not report on or involve any animal or human participants, human material, or human data.
Competing interests
The authors declare no competing interests.
Additional information
Publishers’ Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Jia, P., Wang, L., Yang, X. et al. The quality of reporting in case reports of permanent neonatal diabetes mellitus: a cross-sectional study. BMC Med Res Methodol 24, 117 (2024). https://doi.org/10.1186/s12874-024-02226-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12874-024-02226-1