Skip to main content
Download PDF

How methodological frameworks are being developed: evidence from a scoping review

BMC Medical Research Methodology volume 20, Article number: 173 (2020) Cite this article

Abstract

Background

Although the benefits of using methodological frameworks are increasingly recognised, to date, there is no formal definition of what constitutes a ‘methodological framework’, nor is there any published guidance on how to develop one. For the purposes of this study we have defined a methodological framework as a structured guide to completing a process or procedure. This study’s aims are to: (a) map the existing landscape on the use of methodological frameworks; (b) identify approaches used for the development of methodological frameworks and terminology used; and (c) provide suggestions for developing future methodological frameworks. We took a broad view and did not limit our study to methodological frameworks in research and academia.

Methods

A scoping review was conducted, drawing on Arksey and O’Malley’s methods and more recent guidance. We systematically searched two major electronic databases (MEDLINE and Web of Science), as well as grey literature sources and the reference lists and citations of all relevant papers. Study characteristics and approaches used for development of methodological frameworks were extracted from included studies. Descriptive analysis was conducted.

Results

We included a total of 30 studies, representing a wide range of subject areas. The most commonly reported approach for developing a methodological framework was ‘Based on existing methods and guidelines’ (66.7%), followed by ‘Refined and validated’ (33.3%), ‘Experience and expertise’ (30.0%), ‘Literature review’ (26.7%), ‘Data synthesis and amalgamation’ (23.3%), ‘Data extraction’ (10.0%), ‘Iteratively developed’ (6.7%) and ‘Lab work results’ (3.3%). There was no consistent use of terminology; diverse terms for methodological framework were used across and, interchangeably, within studies.

Conclusions

Although no formal guidance exists on how to develop a methodological framework, this scoping review found an overall consensus in approaches used, which can be broadly divided into three phases: (a) identifying data to inform the methodological framework; (b) developing the methodological framework; and (c) validating, testing and refining the methodological framework. Based on these phases, we provide suggestions to facilitate the development of future methodological frameworks.

Peer Review reports

Background

There is no formal definition of a methodological framework amongst the academic community. There is, however, unspoken agreement that a methodological framework provides structured practical guidance or a tool to guide the user through a process, using stages or a step-by-step approach [1,2,3,4,5]. Specific descriptions of a methodological framework include: ‘a body of methods, rules and postulates employed by a particular procedure or set of procedures’ [6], a ‘set of structured principles’, an approach for ‘structuring how a given task is performed’ [7], and a ‘sequence of methods’.

The benefits of using methodological frameworks are manifold: they can improve the consistency, robustness and reporting of the activity [8], enhance the quality of the research, standardise approaches [5], and maximise trustworthiness of findings [2].

In 2017, Rivera et al. published the results of a literature review which identified existing methodological frameworks used to measure healthcare research impact and summarised the common themes and metrics used to measure this impact [6]. The authors found that the identified methodological frameworks had been developed using a variety of approaches, with no guidelines or consensus on the best pathway that should be used to develop a robust methodological framework. The authors concluded that this lack of guidance needs to be addressed to ensure that best practice methods can be used in the future. We sought to address this gap, by 1) systematically scoping the literature on methodological frameworks, charting and summarising approaches employed, and using these summarised approaches to make suggestions for developing future methodological frameworks, 2) identify terminology used in the literature in order to inform future research. Rather than limiting our search to methodological frameworks related to academic research as Rivera et al. did, we opted to be more inclusive so we could understand the rationale and approaches for the development of methodological frameworks in the wider arena.

Methods

We carried out a scoping review as a way of mapping the existing landscape on the use of methodological frameworks, identifying approaches used to develop them, and summarising these approaches thematically to inform suggestions for developing methodological frameworks. Scoping reviews have been shown to be particularly useful for when a research area has not yet been widely reviewed, such as areas with emerging evidence [9], to examine the extent, range and nature of a research area [10], where there is a lack of consistency in methodology and terminology to clarify key concepts and definitions [11] and for informing a systematic review [12]. Our scoping review methodology followed Arksey and O’Malley’s recommendations [10], as well as more recent guidance by Levac [9] and Colquhoun et al., [11]. Our study consisted of the following stages: 1) identifying the research question; 2) identifying relevant studies; 3) study selection; 4) charting the data; and 5) collating, summarising and reporting the results. No publicly-available protocol is available for the research; however, interested readers can contact the corresponding author for further details on methods.

Identifying the research question

There is no formal definition of a methodological framework, nor is there guidance on the approaches to use when developing a methodological framework. In this review the working definition of a methodological framework is a tool to guide the developer through a sequence of steps to complete a procedure. Methodology is defined as the group of methods used in a specified field, and framework is defined as a structure of rules or ideas. The primary research question posed in this review is ‘what approaches are used in developing a methodological framework and is there consistency in those approaches to enable making suggestions for developing methodological frameworks?’ The secondary research question is ‘what terminology is used for naming methodological frameworks?’

Identifying relevant studies

Identifying relevant studies followed an iterative approach, guided by an experienced subject librarian. An initial search was conducted in August 2018 in Web of Science. The results of the initial search helped to inform the scoping review search. There were no standardised MESH terms for methodological frameworks, because of this index terms were also scrutinised.

The main scoping review search took place in September 2018. We searched MEDLINE and Web of Science for published literature and also conducted a search for grey literature. The search terms used were necessarily narrow to avoid an impractically large amount of potential studies. Only titles rather than abstracts were searched to ensure that the search terms were the main focus of the article or paper. Details of search terms used are included in Additional file 1.

The grey literature search used methods previously published by Godin’s et al. [13] who used systematic methods for grey literature searching. The search was conducted in Google and results were restricted to the first 10 pages (100 hits). A single search term was used; ‘Methodological framework development’. Drawing on the approach used by Rivera et al. [6], we also searched Google Images; methodological frameworks are often presented as a diagram and therefore could be easily identified using this approach. Based on Rivera et al’s published methods the first 50 items were screened [6]. The electronic search was supplemented by a manual search of the reference lists and citations of all the relevant studies.

Study selection

Studies were eligible for inclusion if: (a) they included a methodological framework and reported the approach used for developing that framework; (b) were written in English; and (c) were published in the last decade (2008 onwards). Screening criteria were established a priori. Duplicates were removed, and titles and abstracts of identified papers were screened for potential eligibility by the first author (NM) after downloading the search results into Excel. The full texts of potentially eligible articles were retrieved and read to assess eligibility for final inclusion, also by the first author (NM). Any uncertainty over eligibility for inclusion was discussed by the authors.

Charting the data

The lead author (NM) developed a data charting form on Microsoft Excel and extracted from each individual paper the following information: (a) basic study characteristics (i.e. authors, title, journal, type of study, year of study and country of origin); (b) subject area; (c) approaches taken in developing the methodological framework; and (d)terminology used for methodological frameworks .

Collating, summarising and reporting the results

The extracted data were analysed in line with the aims of the scoping review. Approaches were examined in detail, then synthesised and grouped together into similar methods. The approaches are reported descriptively with frequencies and percentages. These approaches were then categorised into phases and interpreted to make the suggestions. The results were reported in line with the PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation [14]. The completed PRISMA-ScR is provided in Additional file 2.

Results

Literature search

The combined search strategies yielded a total of 320 records (266 after removing duplicates). 179 potentially relevant full-text papers were screened and 30 were included in the review [1,2,3,4,5, 8, 15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38]. The flow chart of study selection is presented in Fig. 1.

Fig. 1
figure 1

PRISMA flow chart of study selection

Full size image

Study characteristics

A majority of included papers (26/30) were journal articles, followed by conference proceedings (3/30) and a book chapter (1/30). The studies represented a wide range of subject areas; 20 different subject areas were identified, the most common being ecology (6/30), followed by education (4/30), then manufacturing and regional (3/30), and healthcare, architecture and health economics (2/30). The papers originated from 14 countries; the most common was UK (8/30), followed by Greece, Germany, US and the Netherlands (3/30) and finally Italy (2/30). Basic study characteristics are presented in Additional File 3.

We found a variety of terms used to describe the methodological frameworks. This use of different terms was seen in both the title and the body of the study. Six studies did not include ‘methodological framework’ in the title (20.0%). Of these one included the words ‘methodological’ and ‘framework’ separately [2], four included only ‘framework’ in title and one used the term ‘conceptual framework’. Of these six studies two were identified from references [4, 5], two from citations [37, 38] and one from Google images [34].

Alternative terms for methodological frameworks were used interchangeably within the studies (Fig. 2).

Fig. 2
figure 2

Terminology used in studies

Full size image

Most studies included a combination of ‘methodological framework’ and ‘framework’ to describe the methodological framework (63.3%). One used a combination of methodological framework and conceptual framework. Three used ‘framework’ only and one used ‘methodological framework’ only. One study used three terms and a further two studies used a combination of four terms.

Keywords used in the studies that related to methodological frameworks are summarised in Table 1. Half of the studies (15/30) did not have any keywords related to methodological frameworks. Of those that used keywords related to methodological frameworks most used ‘methodology’ (4/30), followed by ‘methodological framework’ (3/30), ‘design methodology’ (2/30), ‘simulation methodology’ (1/30), ‘methods’ (1/30) and ‘guidance’ (1/30). One study contained two relevant keywords [5]. 4/30 studies had no keywords at all

Table 1 Keywords relevant to methodological frameworks extracted from studies
Full size table

Approaches used for the development of methodological frameworks

We identified eight different approaches used for developing methodological frameworks (Table 2), these are also summarised by study in Additional File 4.

Table 2 Approaches used for the development of methodological frameworks
Full size table

The most frequently reported approach was ‘Based on existing methods and guidelines’, which comprise previous methodological frameworks or guidance and published methodology. Whilst some studies did not explain how the existing methods formed the foundations of the framework being developed, most did expand this further: adapting the methods [19, 24], integrating methods, building on the existing methods [4, 37], based on the framework [20,21,22, 27, 30, 33], combined well established guidelines which comprised the same stages [16], and the framework was basic inspiration [28]. Only one study specified how the frameworks or guidance was identified; Squires and colleagues used a literature review [5].

Ten studies reported ‘Refined and validated’ as a method. Approaches taken to refining and validating comprised; piloting the framework [35], trialling identified stages and using the results of the trial to further develop the framework [25], using a case study or Delphi panel to evaluate and refine the framework [5, 8, 33], using a case study to validate the framework [17, 29] and testing the framework [20]. Two studies did not report details of the case study [18, 24].

Nine studies reported using ‘Experience and expertise’ to develop the methodological framework, and reported using experience from different levels: personal [15], school/university [25] and country level [28]. One study restricted ‘experience’ to the authors’ experience [15], the rest included the experience of experts in the field of the methodological framework. In all but one study the experts were recruited specifically to develop the methodological framework, the remaining study used experience already reported [28]. Methods used to extract experience and expertise comprise: during meetings [18], consultations [39] and collaboration [33]. Two frameworks did not specifically mention experience but used surveys and interviews [34] and focus groups for extracting expertise [5]. Whilst these studies did not explicitly mention experience the methods reported would have extracted experience or views on experience.

Eight studies reported conducting a ‘Literature Review’. Specifically; purposeful sampling [2, 26], sources for searches included databases, dissertation [23], library catalogue, key author, databases websites and citations [8]. Other studies reported conducting a literature review but did not report specific methods used [5, 8, 23, 29, 33, 35].

Seven studies reported using ‘Data synthesis and amalgamation’. Specific methods included: identifying phases [2], themes [2, 34] and dimensions [23], analysing and grouping or categorising themes, or thematic analysis [2, 3, 8, 23, 26].

‘Data extraction’ was reported in three studies and includes extracting data from interviews and focus groups using transcribing methods [5, 34], and extracting key information from published literature [2].

‘Iteratively developed’ was a method reported in two studies, one framework had no details on this [20], the other explained that the framework evolved and developed as items were extracted, synthesised and revised [8].

The least frequently mentioned method was ‘Lab work results’, the study that reported using this method was from the field of explosives, where the results of lab tests were used to inform the framework [1].

A pattern emerged whilst reviewing the methods and in applying meaning to these results, they were split into three categories. The first category relates to identifying evidence or data to inform and shape the framework. This evidence comes from: existing methods, literature reviews, lab results and experience/expertise. The second category relates to developing the framework using the identified data, comprising: extracting data, and synthesising and amalgamating this data iteratively. The third and final category is refining and validating the framework: trialling the framework with pilot or case studies and or Delphi panels.

The scoping review results were used as a basis for the following outline of suggestions that may be considered for developing a methodological framework on. The three phases underpinned the structure and specific approaches were included within those phases. These are summarised in Figure and explained in greater detail below.

(Uploaded as ‘Fig. 3 Summary of suggestions for developing methodological frameworks.pptx’)

Fig. 3
figure 3

Summary of suggestions for developing methodological frameworks

Full size image

Phase 1 – identifying evidence to inform the methodological framework

This phase is split into two; the first is identifying previous frameworks or guidance which are used for the foundations of the new methodological framework, the second is identifying new data to help develop the methodological framework. This new data can be identified in numerous ways: purposeful literature searches, qualitative research (focus groups, interviews, surveys), collaboration between interested parties and the experience and expertise of the developers. If qualitative research is included, if possible it should be conducted with experts in the field of the methodological framework and not restricted to author experiences if possible.

Phase 2 – developing the methodological framework

In this phase the frameworks or guidance identified in Phase 1 are adapted, combined with other guidance and built upon to create the foundations of the new methodological framework. Key information in the new data identified in Phase 1 should be extracted using appropriate methods. Appropriate methods include; transcribing qualitative data, entering themes into predesigned tables, and entering quantitative information into piloted data extraction forms. Once the information is extracted it should be analysed, synthesised, and grouped or amalgamated into categories to inform the new framework. This should be an iterative process; after grouping or amalgamation of the new data, it should be brought back to key experts and the study team for refinement. This iterative approach should be followed until consensus is reached on the proposed methodological framework.

Phase 3 – evaluate and refine

In this final stage the proposed methodological framework should be evaluated and refined. Evaluation techniques include using case studies to pilot the methodological framework and Delphi panels. The results from this evaluation should be used to refine the methodological framework if appropriate. Refining will include updating the methodological framework with any changes identified from the evaluation stage and presenting these changes to key experts and the study team for verification.

These suggestions are not intended to be prescriptive, and the developer should adapt them to their specific situation. Finally, the developer should include the term ‘methodological framework’ at least in the title of the study, preferably in the body of the text too and as a keyword if possible.

Discussion

Summary of evidence

The purpose of this scoping review was to identify approaches taken in developing methodological frameworks and terminology used in describing them. We were able to locate 30 studies that were published in the last decade and reported these approaches. Studies covered 20 subject areas and came from 14 different countries. After synthesis and amalgamation, we identified eight approaches used for developing methodological frameworks. Not all studies with methodological frameworks reported the approaches used to develop them; out of 179 potentially eligible frameworks scrutinised in full, 37 (20.7%) were rejected because the authors did not report approaches, Studies which did report approaches were often not clear about the methods used. However, whilst the approaches used to develop methodological frameworks were not always reported or reported clearly, there were a sufficient number of common approaches to allow the amalgamation and categorisation of the approaches that were reported to form an evidence base on which suggestions for developing methodological frameworks could be made.

In the included studies extracted terms used to describe methodological frameworks highlighted the lack of clarity in terminology, as different terms were used to describe methodological frameworks within the studies. The majority of studies used a combination of ‘methodological framework’ and ‘framework’, which is understandable bearing in mind journal word limits and flow of discussions. Two studies used a combination of four terms highlighting the lack of clarity in terminology. This lack of clarity in terminology suggests that when conducting a literature search for methodological frameworks, it is likely that many methodological frameworks might not be identified. We recommend using ‘methodological framework’ in the title of the study as a minimum.

Many of the included studies did not use any keywords related to methodological frameworks suggesting that the studies were more focussed on the subject of the methodological framework rather than the actual process of developing the methodological framework itself.

As there is no existing guidance for developing methodological frameworks, it is not possible to interpret the results of this scoping review in light of what is already known. However, Rivera et al. [6] also concluded that methodological frameworks vary in their development, although there appear to be some common approaches. In their review, only one paper (4%) did not report any methods of development [40], compared to 37 (20.7%) in this review. Rivera et al. reported four key methods: using a literature review, stakeholders’ involvement, methods to incorporate stakeholder views and a pilot phase. The results from this scoping review identified additional methods, including: refined and validated, data synthesis, data synthesis and amalgamation and iteratively developed.

Strengths and limitations

To the best of our knowledge, this is the first study to identify approaches used for the development of methodological frameworks; our work addresses an important gap in the literature by providing suggestions for the development of future methodological frameworks and highlighting issues with terminology which can inform future work. Further strengths are; the methodological frameworks identified and analysed come from many contexts and demonstrate a degree of natural variation, and our research offers a contemporary slice of how methodological frameworks are used.

Certain limitations need to be acknowledged and addressed. As with any review this research is limited by dependency on the quality of included studies and the search strategy, specific limitations are discussed further below [41].

First, issues with lack of consistency in terminology meant that further examples of methodological frameworks may have been missed in the search if a different term to ‘methodological framework’ had been used in the title. However, a pragmatic balance had to be struck between the sensitivity and specificity of the search; using the search term ‘framework’ only would have resulted in an impractical number of results. This limitation to the search strategy will have potentially resulted in limiting the number of approaches reported and limited the identification of variations in terminology Also, as previously discussed, not all the studies identified included methods, limiting the amount of data that could be extracted and included in the scoping review. Linked to this, not all methods were clearly reported, perhaps because of word count, the aim and focus of the paper, or traditionally how different disciplines report. Moreover, data screening and extraction was conducted by one reviewer, although key decisions on study selection were discussed with the wider team. Last, scoping reviews do not assess the quality of included evidence; therefore, there is a risk that the frameworks included in this review were not of high quality, however, as there is scant evidence in this area, a scoping review was the most suitable method to use [12, 42].

Conclusions

The current lack of guidance provides an opportunity to make some initial steps towards addressing this gap in the knowledge. This scoping review summarises the reported approaches used in developing a methodological framework. This work can be viewed as the first step in developing robust guidance for developing a methodological framework. As the terminology, definitions and process are not widely agreed, there is a need for standardisation of these. Whilst terminology and definitions were not consistent, reported approaches for development were. This consistency allowed for suggestions to be made for developing methodological frameworks. Future research to update this scoping review and suggestions should include a systematic review based on the terminology identified, and collaboration with experts, for example using a Delphi panel or focus group, to develop best practise guidance. Furthermore, a standardised procedure to collecting qualitative data in phase one would add consistency and transparency to evidence gathering.

Availability of data and materials

Not applicable.

Referrences

  1. Chesson LA, Howa JD, Lott MJ, Ehleringer JR. Development of a methodological framework for applying isotope ratio mass spectrometry to explosive components. Forensic Chemistry. 2016;2:9–14.

    Article  CAS  Google Scholar 

  2. Kallio H, Pietila A-M, Johnson M, Kangasniemi M. Systematic methodological review: developing a framework for a qualitative semi-structured interview guide. J Adv Nurs. 2016;72(12):2954–65.

    Article  Google Scholar 

  3. Kumke M, Watschke H, Vietor T. A new methodological framework for design for additive manufacturing. Virtual Phys Prototyping. 2016;11(1):3–19.

    Article  Google Scholar 

  4. Pahl-Wostl C, Holtz G, Kastens B, Knieper C. Analyzing complex water governance regimes: the Management and Transition Framework. Environ Sci Pol. 2010;13(7):571–81.

    Article  Google Scholar 

  5. Squires H, Chilcott J, Akehurst R, Burr J, Kelly MP. A Framework for Developing the Structure of Public Health Economic Models. Value Health. 2016;19(5):588–601.

    Article  Google Scholar 

  6. Rivera SC, Kyte DG, Aiyegbusi OL, Keeley TJ, Calvert MJ. Assessing the impact of healthcare research: A systematic review of methodological frameworks. PLoS Med. 2017;14(8):e1002370.

    Article  Google Scholar 

  7. Global I. What is Methodological Framework | IGI Global 2019 [Available from: https://www.igi-global.com/dictionary/methodological-framework/18485.

    Google Scholar 

  8. Rodgers M, Thomas S, Harden M, Parker G, Street A, Eastwood A. Developing a methodological framework for organisational case studies: a rapid review and consensus development process. Southampton (UK): NIHR Journals Library; 2016.

  9. Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:9.

    Article  Google Scholar 

  10. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

    Article  Google Scholar 

  11. Colquhoun HL, Levac D, O’Brien KK, Straus S, Tricco AC, Perrier L, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.

    Article  Google Scholar 

  12. Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18:143.

    Article  Google Scholar 

  13. Godin K, Stapleton J, Kirkpatrick SI, Hanning RM, Leatherdale ST. Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. Syst Rev. 2015;4:138.

    Article  Google Scholar 

  14. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–73.

    Article  Google Scholar 

  15. Achillas C, Aidonis D, Iakovou E, Thymianidis M, Tzetzis D. A methodological framework for the inclusion of modern additive manufacturing into the production portfolio of a focused factory. J Manuf Syst. 2015;37:328–39.

    Article  Google Scholar 

  16. Anagnostou A, Taylor SJE. A distributed simulation methodological framework for OR/MS applications. Simul Model Pract Theor. 2017;70:101–19.

    Article  Google Scholar 

  17. Battini D, Faccio M, Persona A, Sgarbossa F. New methodological framework to improve productivity and ergonomics in assembly system design. Int J Ind Ergon. 2011;41(1):30–42.

    Article  Google Scholar 

  18. Dean E, Taylor MJ, Francis H, Lisboa P, Appleton D, Jones M. A Methodological Framework for Geographic Information Systems Development. Syst Res Behav Sci. 2017;34(6):759–72.

    Article  Google Scholar 

  19. George H, Bosc PM, Even MA, Belieres JF, Bessou C. Waw proposed methodological framework to monitor agricultural structural transformations and their contributions to sustainable development. Producing and reproducing farming systems New modes of organisation for sustainable food systems of tomorrow 10th European IFSA Symposium, Aarhus, ,Denmark 2012. 20121–4 July.

  20. Halbe J, Pahl-Wostl C, Adamowski J. A methodological framework to support the initiation, design and institutionalization of participatory modeling processes in water resources management. J Hydrol. 2018;556:701–16.

    Article  Google Scholar 

  21. Ianni M, de Leon MS. Applying Energy Performance-Based Design in Early Design Stages A methodological framework for integrating multiple BPS tools. Ecaade 2013: Computation and Performance, vol. 1; 2013. p. 31–40.

    Google Scholar 

  22. Kumar A, Singh AR, Deng Y, He X, Kumar P, Bansal RC. A Novel Methodological Framework for the Design of Sustainable Rural Microgrid for Developing Nations. Ieee Access. 2018;6:24925–51.

    Article  Google Scholar 

  23. Lee J, Jang S. A methodological framework for instructional design model development: Critical dimensions and synthesized procedures. Etr&D-Educ Technol Res Dev. 2014;62(6):743–65.

    Article  Google Scholar 

  24. Linek SB, Schwarz D, Bopp M, Albert D. When Playing Meets Learning: Methodological Framework for Designing Educational Games. Web Inf Syst Technol. 2010;45:73–85.

    Article  Google Scholar 

  25. Lopes AMB, Ruiz-Cecilia R. Designing Technology-Mediated Tasks for Language Teaching: A Methodological Framework. Hacettepe Universitesi Egitim Fakultesi Dergisi-Hacettepe University Journal of Education. 2017;32(2):265–79.

    Google Scholar 

  26. Nicod E, Kanavos P. Developing an evidence-based methodological framework to systematically compare HTA coverage decisions: A mixed methods study. Health Policy. 2016;120(1):35–45.

    Article  Google Scholar 

  27. Panagiotopoulou M, Stratigea A. A participatory methodological framework for paving alternative local tourist development paths—the case of Sterea Ellada Region. Eur J Futures Res 2, 44 (2014). https://doi.org/10.1007/s40309-014-0044-7.

  28. Procházka J, Melichar J. Methodological Framework for Operational Risk Assessment. Vojenské rozhledy. 2017;26:19–34.

    Article  Google Scholar 

  29. Reed MS, Kenter J, Bonn A, Broad K, Burt TP, Fazey IR, et al. Participatory scenario development for environmental management: A methodological framework illustrated with experience from the UK uplands. J Environ Manag. 2013;128:345–62.

    Article  CAS  Google Scholar 

  30. Reidsma P, Konig H, Feng S, Bezlepkina I, Keulen Hv, Ittersum MKv, et al. A methodological framework for sustainability impact assessment of land use policies in developing countries: re-using and complementing approaches. Proceedings of the Conference on integrated assessment of agriculture and sustainable development: Setting the Agenda for Science and Policy (AgSAP 2009), Hotel Zuiderduin, Egmond aan Zee, The Netherlands, 10–12 March 2009. 2009:138–139.

  31. Schmitt J, Apfelbacher C, Spuls PI, Thomas KS, Simpson EL, Furue M, et al. The Harmonizing Outcome Measures for Eczema (HOME) Roadmap: A Methodological Framework to Develop Core Sets of Outcome Measurements in Dermatology. J Invest Dermatol. 2015;135(1):24–30.

    Article  CAS  Google Scholar 

  32. Stratigea A, Papadopoulou CA. Foresight Analysis at the Regional Level - A Participatory Methodological Framework. J Manag Strategy. 2013;4(2). https://doi.org/10.5430/jms.v4n2p1.

  33. Stremke S, Van Kann F, Koh J. Integrated Visions (Part I): Methodological Framework for Long-term Regional Design. Eur Plan Stud. 2012;20(2):305–19.

    Article  Google Scholar 

  34. Sun Y & Strobel J. Elementary Engineering Education (EEE) Adoption and Expertise Development Framework: An Inductive and Deductive Study. J Pre-College Eng Educ Res (J-PEER). 2013;3(1):4. https://doi.org/10.7771/2157-9288.1079.

  35. Tappenden P, Chilcott J, Brennan A, Squires H, Stevenson M. Whole Disease Modeling to Inform Resource Allocation Decisions in Cancer: A Methodological Framework. Value Health. 2012;15(8):1127–36.

    Article  Google Scholar 

  36. Tondel K, Niederer SA, Land S, Smith NP. Insight into model mechanisms through automatic parameter fitting: a new methodological framework for model development. BMC Syst Biol. 2014;8:59.

    Article  Google Scholar 

  37. Brondizio ES, Vogt ND, Mansur AV, Anthony EJ, Costa S, Hetrick S. A conceptual framework for analyzing deltas as coupled social-ecological systems: an example from the Amazon River Delta. Sustain Sci. 2016;11(4):591–609.

    Article  Google Scholar 

  38. Rijke J, Brown R, Zevenbergen C, Ashley R, Farrelly M, Morison P, et al. Fit-for-purpose governance: A framework to make adaptive governance operational. Environ Sci Pol. 2012;22:73–84.

    Article  Google Scholar 

  39. Asnani MR, Bhatt K, Younger N, McFarlane S, Francis D, Gordon-Strachan G, et al. Risky behaviours of Jamaican adolescents with sickle cell disease. Hematol. 2014;19(7):373–9.

    Article  Google Scholar 

  40. Buykx P, Humphreys J, Wakerman J, Perkins D, Lyle D, McGrail M, et al. Making evidence count’: A framework to monitor the impact of health services research. Austr J Rural Health. 2012;20(2):51–8.

    Article  Google Scholar 

  41. Abedin B, Abedin B, Talaie Khoei T, Ghapanchi AR. A Review of Critical Factors for Communicating With Customers on Social Networking Sites; 2013.

    Book  Google Scholar 

  42. Sucharew H, Macaluso M. Methods for Research Evidence Synthesis: The Scoping Review Approach. J Hosp Med. 2019;14(7):416–8.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge Paul Cannon who assisted with the search strategy.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Health Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, Glasgow, G12 8RZ, UK

    Nicola McMeekin, Olivia Wu, Evi Germeni & Andrew Briggs

Authors
  1. Nicola McMeekin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olivia Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Evi Germeni
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrew Briggs
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NM conceived and carried out the scoping review. EG provided expertise in methodology. NM took the lead in writing in the manuscript. OW, EG and AB contributed to the draft manuscript, and all authors read, contributed to and approved the final manuscript.

Corresponding author

Correspondence to Nicola McMeekin.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

OVID Medline search September 2018.

Additional file 2.

Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist.

Additional file 3.

Basic study characteristics.

Additional file 4.

Extracted data from studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McMeekin, N., Wu, O., Germeni, E. et al. How methodological frameworks are being developed: evidence from a scoping review. BMC Med Res Methodol 20, 173 (2020). https://doi.org/10.1186/s12874-020-01061-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-020-01061-4

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us