Skip to main content

Measuring psychological safety in healthcare teams: developing an observational measure to complement survey methods

Abstract

Background

Psychological safety is a dynamic team-level phenomenon which exists when team members believe that it is safe to take interpersonal risks. In healthcare teams, the presence of psychological safety is critical to delivering safe care. Scholars have highlighted a need for alternative measures which compliment survey-based measures of psychological safety in healthcare teams.

Methods

The exploratory phase of this study raised concerns about whether current survey measures could provide a sufficient understanding of psychological safety within healthcare teams to inform strategies to improve it. Thus, previously validated psychological safety surveys and a meeting observation measure were adapted for use in healthcare teams. First, two group feedback sessions were held with 22 healthcare professionals, as well as a systematic literature review. Then, the members of eleven healthcare teams in Ireland and The Netherlands (n = 135) took part in the pilot test of the adapted composite measure.

Results

The final composite measure has two parts: a team meeting observation measure and an adapted survey. The observation measure has 31 observable behaviours fitting seven categories: voice, defensive voice, silence behaviours, supportive, unsupportive, learning or improvement-oriented and familiarity type behaviours. The survey part consists of 19 items in three sub-dimensions related to; the team leader, other team members and the team as a whole. Three additional items capture the perceived representativeness of the observed team meeting compared to other similar meetings. Final adaptations were made in order to integrate the observation and survey measure.

Conclusions

The resulting composite measure combines the strengths of observational and survey measures and is tailored for use in healthcare teams. It is uniquely co-developed with healthcare professionals and grounded in the psychological safety and healthcare literature. This composite measure can enable longitudinal research on psychological safety and inform future research to develop and test interventions to improve psychological safety.

Peer Review reports

Background

Psychological safety is fundamental to effective teamwork, communication, and collaboration at work. It is “a team level phenomenon where all team members believe they are safe to take interpersonal risks” ([1], p. 354). Psychological safety is particularly relevant to healthcare teams because they work in a highly complex, dynamic, and high stakes work environment that requires them to work interdependently to co-ordinate safe patient care [2]. Healthcare teams need to be psychologically safe in order to maintain and encourage key outcomes, such as: patient safety [2,3,4], learning [1], and team performance [5]. Psychological safety also facilitates “teaming”, an active process which allows multidisciplinary healthcare teams to work together to deliver increasingly complex patient care [6, 7]. In psychologically safe team’s essential teamwork processes can evolve, including mutual performance monitoring, mutual trust, decision making, team cohesion, team motivation, and conflict resolution [8]. Moreover, how healthcare professionals relate to their co-workers is deemed an antecedent of job satisfaction [9]. To date, surveys have dominated the measurement of psychological safety [5]. Relying only on survey instruments can be burdensome for respondents and is limited by self-report bias [10,11,12]. Within a healthcare context, surveys are characterized by challenges such as respondent exhaustion and, consequently, low and declining response rates [13, 14]. This is likely to have worsened recently as the ongoing covid-19 pandemic has increased both physical and mental exhaustion among healthcare professionals [15, 16]. A recent paper by Mathieu and colleagues [17] calls for new methods of measurement which can complement surveys by providing additional insights into team dynamics. The observation measure presented as part of this paper addresses this need and allows for repeated tracking of healthcare team dynamics without requiring their time. Observation measures can complement surveys as they provide a more objective understanding, that is not hindered by low response or high attrition rates [12]. Being able to assess changes in psychological safety over time is particularly important as healthcare teams adapt to the challenges of the pandemic through developing new collaborative practices and evolving models of care delivery.

To date, empirical research has relied on cross-sectional, quantitative survey data to measure psychological safety [5]. Known survey measures of psychological safety ranged from three- to eight-item self-report scales [1, 2, 18,19,20,21]. While these scales have strong psychometric properties for measuring psychological safety and have been used within a healthcare setting, they were not developed within a healthcare setting. As a result, they may need to be adapted to fit different cultural and/or professional settings [22]. Healthcare settings are characterised by unique concerns related to patient safety and the increasing complexity of the care. These issues highlight the importance of having measures which can offer an in-depth understanding of psychological safety which is specific to healthcare settings [7, 23]. The current study presents the first survey measure of psychological safety which involved the target audience (healthcare professionals) in the process of adapting survey items. Previous studies have highlighted that involving end users in survey development can improve accuracy, quality and relevance of survey research [24]. To provide a more holistic understanding of psychological safety in healthcare teams, we also present an observational measure which complements the adapted survey. Relying purely on survey measures is a key shortcoming of organisational behaviour research [11]. Welp and Manser [25] found that survey studies which examine teamwork, clinician well-being and patient safety, have failed to take a holistic approach which accounts for the complexity of healthcare teams and have focused on the individual profession rather than the entire multi-professional team. Similarly, a recent systematic review of interventions aiming to improve psychological safety in healthcare teams, concluded that, in order to fully understand whether these interventions are successful, more holistic, objective measures are needed [26]. Observational techniques may offer insights into team psychological safety that the team themselves are not fully aware of and that complement findings from survey measures [5, 26, 27]. Recent literature reviews have highlighted the need for mixed-methods approaches to explore teamwork in healthcare and psychological safety [4, 26]. The complementary strengths of survey and observational methods of measurement can offer a more holistic understanding of psychological safety at both individual and team levels [28].

In this study, we respond to calls for improved, mixed method measures of psychological safety [4, 26]. Below we explicitly describe the methodology used to develop an observation measure that is grounded in the psychological safety and healthcare literature, to involve healthcare professionals in the adaptation of a psychological safety survey measure, and to pilot test both of these measures with healthcare teams.

Methods

The present study aims to add to the existing body of literature by adapting current observational and survey measures, in collaboration with healthcare professionals, to provide a triangulated approach to measuring psychological safety at the team and individual level. For the purpose of this paper, a team will be defined as two or more healthcare professionals who: “socially interact (face-to-face or, increasingly, virtually); possess one or more common goals; are brought together to perform organizationally relevant tasks; exhibit interdependencies with respect to workflow, goals, and outcomes; have different roles and responsibilities; and are together embedded in an encompassing organizational system, with boundaries and linkages to the broader system context and task environment” ([26], p. 79). Team leaders will be included as part of the team because of the influence they have on psychological safety and collaboration within their teams [1,2,3,4,5, 29] this is especially the case in healthcare teams where team leaders typically function as actively involved foremen or -women [30].

Exploratory phase

In the exploratory phase of this study, psychological safety was measured in an acute hospital in Ireland. While staff spoke about issues related to low psychological safety in their team or organisation, survey results did not reflect these issues. The full details of this exploratory phase can be found in Appendix A, which is included as a supplementary file. Feedback from participating healthcare professionals raised questions about the suitability of the survey questions for a healthcare context, as they experienced some difficulty in understanding and interpreting how the questions related to their context. In order to gain a more in-depth understanding of psychological safety within the case study hospital, the current study adapted the original survey items and developed a corresponding observation measure.

Composite measure adaptation phase

Various steps were taken to develop a composite measure of psychological safety for use within healthcare teams. The composite measure consists of two parts: an observational measure and a survey measure. Both elements of the composite measure are adapted versions of previously used measures of psychological safety. Figure 1 illustrates the process through which the composite measure was developed, in two parallel streams.

Fig. 1
figure 1

Process of Adapting and Pilot Testing the Composite Measure

Developing the observation measure component through reviewing the literature

The observation measure was developed based on behaviours which were identified from seminal research outlined below and are presented in Table 1.

Table 1 Behaviours Identified for Inclusion in Observation Measure

When developing an observation measure for team psychological safety, Hoenderdos [12] drew on conflict and information or knowledge sharing literature and identified 29 behaviours relevant to psychological safety (see Table 1). These were observed in 10 workplace teams. Because these teams were not from a healthcare setting, the observation measure requires further development and validation for use with healthcare teams. Since psychological safety may also be inferred from the extent to which people adopt learning behaviours within teams, the items developed by Edmondson [1] were included (see Table 1). These learning behaviours were identified during a study of teams in a manufacturing company. Voice behaviours were also included, based on the work conducted by Le Pine and Van Dyne [31] and Van Dyne et al. [32] (see Table 1). The framework proposed by Van Dyne et al. [32] is particularly helpful because it provides examples and definitions of behaviours associated with different types of employee silence and voice.

To ensure that the observation measure was directly relevant to healthcare teams, behaviours were identified in a systematic review of enablers of psychological safety within a healthcare context [33] (see Table 1). These behaviours were integrated into the observation measure to ensure it was suitable for use in a healthcare setting.

The behaviours presented in the above literature generated a long list of potential items to be included in the observation measure. Draft versions of the observation measure were reviewed and refined by the authors to ensure that each behaviour was observable and relevant to measuring psychological safety. As a criterion for inclusion the authors adhered to Bergner’s ([34], p. 147) definition, “behavior is any observable overt movement of the organism generally taken to include verbal behavior as well as physical movements”. To ensure that healthcare staff could conduct routine, naked-eye observation assessments, [35], the observation measure had to fit on a single page and be easy to understand and use in the field.

Adapting the survey component through feedback sessions with healthcare professionals

Firstly, the survey component of the composite measure was adapted in consultation with healthcare professionals. Involving service users in healthcare research can identify research priorities, frame more rigorous research questions and produce higher levels of participation [36]. We conducted feedback sessions to adapt previously used psychological safety scale items for use in a healthcare context. The items which were adapted are presented in Table 2.

Table 2 Prominent Survey Measures of Psychological Safety

Two group feedback sessions were conducted with 22 healthcare staff, working in Irish hospitals (session 1, n = 8; session 2, n = 14). All participants worked within different teams and were from different disciplines, including, nurses, consultants and physiotherapists. Given that the focus of these sessions was on gaining feedback on the survey items, no further specific demographic details were collected from participants. The first session lasted 40 min and the second session lasted 20 min. The process for conducting these feedback sessions is presented in Table 3.

Table 3 Process for Conducting Feedback Sessions to Adapt Survey Measures of Psychological Safety

Pilot test phase

A pilot test was conducted to finalise the adapted composite measure. This pilot test was conducted within both Irish and Dutch hospitals. In Ireland, six hospital teams, ranging from management to clinical teams, took part and in the Netherlands, five nursing teams took part. The demographics of these teams are presented in Table 4. The teams’ weekly or monthly team meetings were observed, and team members completed the adapted survey. The pilot test was conducted over two phases (see Fig. 1). Three Irish and five Dutch teams took part in phase one. In phase two, the composite measure was updated based on the results from phase one and was then pilot tested with three other Irish teams.

Table 4 Participants in Pilot Test Demographics

Results

Composite measure adaptation phase results

The adapted observation measure

Thirty behaviours were identified in the literature on conflict, information and knowledge sharing learning and voice behaviours and enablers of psychological safety in healthcare teams. These behaviours were grouped according to the following categories: Voice behaviours, defensive voice behaviours, silence behaviours, supportive behaviours, unsupportive behaviours, learning or improvement-oriented behaviours, familiarity behaviours and safety oriented behaviour (see Appendix B in supplementary files). Users of the observation measure can track the behaviours being observed by making the appropriate mark in the “behaviour count” box. Team members and team leaders’ behaviours are placed in separate columns in order to account for differences in psychological safety according to status or hierarchy and to observe whether leadership behaviours are influencing levels of psychological safety in the team [3, 5]. The observation measure also includes a section for capturing observers’ overall ratings after the meeting.

The adapted survey measure

Following the first feedback sessions, the items which at least 50% of the participants chose to include in their survey were identified. This was done in order to reduce the volume of items to be reviewed at the second session. Thirteen items were retained (see Table 2) and were given to the second group of healthcare professionals.

A second feedback session was conducted to check if other healthcare professionals agreed with the 13 items chosen by the first group. More than 50% of the participants chose to include all 13 survey items presented in the second feedback session (at least 64.3% of participants agreed on retaining each item). Only one reverse scored item was included in the final set of items. This was done in order to remain consistent with feedback from healthcare professionals, to keep items as close as possible to their original wording and to reduce any negative impact on reliability and validity [37].

Comments from both sessions were incorporated into the adapted set of survey items. The following section presents the main topics discussed during the feedback sessions. Overall, the participants felt that the original scale items did not capture enough detail to accurately measure psychological safety within healthcare teams. In particular, three key points were raised by them: the sensitivity of certain words in healthcare settings, the importance of the target of voice, and the difference between speaking up about personal or work issues.

First of all, the word “risk” was identified as a misleading word to use within a healthcare setting because it implies risky behaviour that could harm patients. The word “risk” appears in one of the items developed by Edmondson [1]; “It is safe to take a risk on this team”. Participants suggested that this item could be broken down into specific interpersonal risks, such as making suggestions for change, asking questions or reporting mistakes. This would avoid the use of the word “risk” and would give more detail of the kinds of interpersonal risks respondents feel safe taking.

Moreover, participants noted that it can be more difficult to engage in speaking up behaviour when it is directed at a superior, rather than team members who they consider to be their peers. Therefore, they suggested that items referring to feeling safe to voice opinions should be split into whether the respondent is voicing their opinion to their peers or to a superior. In line with this suggestion, questions referring to speaking up specified whether it was to a peer or a team leader.

Finally, healthcare professionals said that they would feel differently depending on whether they needed to speak up about a personal issue or a work issue. Based on their discussion, they suggested that questions specify whether people feel safe speaking up about a) personal issues and b) work issues.

The final list of items incorporated this feedback and can be seen in Table 5. This adapted scale is an extended version of the six previously published and validated psychological safety scales presented in Table 2. The items from these six scales are still present in our adapted version. The main difference between the adapted psychological safety scale and the original scales is that items are split into three sub scales: 1) questions related to psychological safety in relation to the team leader; 2) questions related to psychological safety in relation to peers/other team members of the team; and 3) questions related to psychological safety in relation to the team as a whole.

Table 5 Final Survey Items

Pilot test phase results

An iterative approach was taken to pilot testing the adapted composite measure (see Fig. 1). Based on these experiences and initial reliability testing of the adapted survey scales the following changes were made to the original measures.

Changes made to the original observation measure (see Appendix B in supplementary files)

  • Behaviours which were observed during the team meetings and were not captured by the observation measure were added. These were: Correcting others, sharing future plans, acknowledging achievements/congratulating and delegating tasks. The behaviour “no eye contact (with speaker)” was deleted as it was already captured under “facial expressions indicate disengagement”.

  • The behaviour “leaders’ words and deeds align” was deleted as it was not possible to observe this during team meetings.

  • The category of behaviours originally labelled “safety-oriented behaviour” was removed and the remaining behaviour in that category, “informing the team about issues or mistakes related to patient safety” was moved to the category “Learning or improvement-oriented behaviour”.

  • A section was added to record the duration of the observed meeting. This was done in order to allow future studies to standardize observations and compared them across teams.

  • Clear definitions of each behaviour in the observation were decided upon (see Appendix C in supplementary files).

  • The final observation measure had 31 items which were grouped according to the following categories: voice behaviours, defensive voice behaviours, silence behaviours, supportive behaviours, unsupportive behaviours, learning or improvement-oriented behaviours and familiarity behaviours.

Changes made to the survey measure (see Table 5)

The reliability outcomes from the teams which took part in pilot tests are presented in Table 6.

Table 6 Survey-based Reliability Outcomes of the Pilot Test

Based on these pilot outcomes, the survey part of the measure was adapted in the following ways:

  • For Irish teams D-F and Dutch teams G-K, the original Likert scale of 1–7 was replaced by a scale of 1–10, with one indicating strongly disagree and 10 indicating strongly agree. The idea was to give participants an even wider spectrum of response options which allows the survey to capture more variability in participants’ responses [38]. The pilot tests conducted with Irish teams A-C used a 7-point Likert scale. Moving to a 10-point scale did not improve reliability outcomes, compared to the teams which used a 7-point scale. When compared to 7-point scales, 10-point scales have shown no marked difference in variance but have shown slightly lower mean scores [39]. Lastly, using a 7-point Likert scale facilitates easier comparison between the adapted survey and the original psychological safety surveys. Therefore, the adapted survey reverted to the 1–7 Likert scale.

  • Section 3 of the survey, referring to the team as a whole, had a Cronbach’s alpha which was below 0.7 for both Dutch and Irish teams (see Table 6). The low Cronbach’s alpha for this section can be explained by the fact that it had only three items [40, 41]. In addition, this was the only section which included a reverse scored item, which may have negatively impacted reliability [37]. The alpha if item deleted score revealed that the Cronbach’s alpha could be improved by removing the reverse scored item (question 17). If question 17 was removed the Cronbach’s alpha for section 3 would have increased to .675 for Irish teams A-C (full scale α: .902), .791 for Dutch teams G-K (full scale α: .930) and .902 for Irish teams D-F (full scale α: .960). Therefore, it is recommended that this item should be changed to have the same polarity as the other items: “It is easy to ask other members of this team for help”.

  • Three extra questions were added in order to capture participants’ perceptions of the representativeness of the observed meeting compared to other similar meetings [42]. Participants responses to these questions suggested that the meeting observed was not very different from other similar meetings. This outcome is also consistent with the fact that there was little reactivity to the researcher’s presence during the regular team meeting.

Integrating observation and survey measures to form a composite measure

A final adjustment was made to the observation measure in order to ensure that the observation and the survey measure could be integrated together, as well as to ease the analysis and comparison between the two. This final version of the observation measure included the target of each behaviour, specifically, whether the actor was directing their behaviour towards the team leader, other team members, or the team as a whole. In this version of the observation measure, there are two separate sections for recording team member behaviours and team leader behaviours. In addition, there is space for calculating the total score for both team leader and team members in categories that indicate a high score of psychological safety (voice behaviours, supportive behaviours, learning or improvement behaviour and familiarity behaviours) and the total score for the categories that relate to lower psychological safety (defensive voice behaviours, silence behaviours and unsupportive behaviours). This final observation measure is integrated with survey results and is presented in Table 7. Table 7 contains dummy data in order to visualise one of the various ways the data can be represented within the composite measure.

Table 7 Final Composite Measure Integrating Survey and Observation Components

Interpretation and analysis

We designed the composite measure such that the data collected through the observation and survey methods can be triangulated during data analysis. To highlight the complementary components of the observation and survey measure, Table 8 presents the items which theoretically correspond to one another. In the final version of the composite measure, both the observation and survey data are split according to psychological safety related to; team leaders, other team members and the team as a whole. Presenting the results in this form facilitates comparison and triangulation of the results from both the observation and survey measures. While it would not be appropriate to combine the observation and survey results into one score, it is possible to triangulate both outputs to gain a more robust understanding of psychological safety within teams. For example, by comparing team members response to section 1 of the survey to the behaviours team members display towards their team leader during the observed meeting we can gain a better understanding of team members feelings of psychological safety in relation to their team leader. Triangulating the results from both measures can also facilitate exploration of whether team members feel more psychologically safe around their team leader or with other team members. We can better understand any differences in psychological safety by comparing the amount of voice behaviour team members direct towards other team members and their scores in the second section of the survey to the first section of the survey and the behaviour directed towards their team leader.

Table 8 Corresponding Observation and Survey Items

Discussion

Previous studies identified the need to adapt and triangulate existing measures of psychological safety in healthcare teams to capture a more accurate and nuanced understanding of it at both individual and team levels [5, 26]. Building on previous research and feedback from healthcare professionals, this study describes the methodology used to adapt observational and survey measures of psychological safety, specifically for use within healthcare teams. The resulting adapted composite measure addresses concerns raised by healthcare professionals during the exploratory phase of this study, namely, that survey respondents may not have fully understood the questions, that the questions may not have been suitable for a healthcare context or that only the staff members with high psychological safety had responded to the survey. The adapted composite measure addresses these issues; since the survey items were adapted based on feedback from healthcare professionals, they are easily understood by healthcare professionals and directly relevant to a healthcare context. The observation measure provides a way to capture a team level measure of psychological safety that also includes staff members who do not complete the survey. In addition, the observation measure addresses calls for new methods of measurement that can complement survey measures and provide further insights into team dynamics, while minimising intrusiveness [17].

The similarities between the feedback from healthcare professionals and the psychological safety literature highlight the relevance and importance the adapted measure. The healthcare professionals highlighted a concern for patient safety, which has been found to facilitate psychological safety in healthcare teams [2, 3]. The importance of the target of voice was also highlighted as an issue. As noted by Amy Edmondson in her 2019 Academy of Management conference keynote speech, role-based status in teams may explain differences in team psychological safety. Healthcare professionals at the lower end of the hierarchy find it more difficult to speak to their superiors [2, 3]. Since the participating healthcare professionals recognised this, the resulting composite measure clarifies who participants feel comfortable speaking up to - their peers or their team leader.

The deliberate inclusion of common components across the survey and observation elements are a key strength of this adapted measure as it facilitates triangulation. The survey provides an understanding of individuals’ perceptions of psychological safety in relation to different organisational levels and regarding both professional and personal issues, while the observation measure targets observable behaviours associated with psychological safety at both the individual and team level. As previously mentioned, survey measures can be vulnerable to self-report bias, low response rates and are less suitable for longitudinal research due to response fatigue [11, 12, 14]. The observation measure compensates for these shortcomings by offering a more objective measure of psychological safety which can be repeated multiple times during longitudinal studies of psychological safety [12]. Given that psychological safety is seen as a state that can fluctuate over time, such longitudinal studies are called for [5]. The observation measure also offers an opportunity to capture data from employees who do not complete the survey and, as a result, reduce non-response bias. Using the observational and survey measures together also respects that the behaviour associated with silence and voice can contain elements of ambiguity [32], which make them challenging to interpret. To address this issue, the observation measure includes both verbal and non-verbal behaviours and individuals’ survey responses can further clarify any ambiguity in the observed behaviours. The results from both measures can be triangulated to understand the differences and similarities between self-reported levels of psychological safety and a more objective group level measure, thus providing a more robust and accurate assessment.

Strengths, limitations and future research

A key strength of this study is that we have adapted and further developed existing measures of psychological safety rather than developing entirely new ones. The observation component is equally grounded in the healthcare and psychological safety literature and offers a dynamic, team-level measure of psychological safety. The survey component is based on valid and reliable survey items and has been adapted based on feedback from healthcare professionals to ensure it is tailored for healthcare settings. It is the first survey measure of psychological safety to have involved the target audience (healthcare professionals) in the developmental stage. This improves the accuracy, quality and relevance of the adapted survey [24, 36]. Although a limitation of this study is the relatively small number of healthcare professionals who participated in the feedback sessions, the same issues came up in both sessions, suggesting a sufficient level of data saturation. In addition, all members of the second feedback session agreed on the use of the scale items included in the final survey.

As well as explicitly describing the methodology used to adapt an observational and a survey measure of psychological safety, which is tailored for use within healthcare teams, this study pilot tests the resulting composite measure. This pilot test was conducted in both Dutch and Irish hospitals, offering preliminary evidence that the composite measure is suitable for use within different cultural contexts. In addition, the pilot test was conducted with a variety of healthcare team types, including uni-disciplinary nursing, physiotherapy and speech and language teams as well as multidisciplinary clinical and management teams. As a result, the composite measure is also suitable for use within a wide variety of healthcare team types. Given that this study covers the process of developing and pilot testing the adapted composite measure of psychological safety, future more rigorous testing with larger samples is necessary in order to examine its construct validity and reliability and further develop it. This future testing will enable the incorporation of feedback from a larger sample of healthcare professionals and will contribute to the development of normative data for the instrument. Further testing of the composite measure should also build on the theoretical link between the observation and survey items to test whether scores on the observation measure items are statistically correlated with behaviour counts for the corresponding survey items. Individual interviews with members of the healthcare teams are needed to gain information on individuals’ experiences on the team, their experience of completing the survey and of their team being observed. In subsequent stages we hope to observe regular team meetings with a video camera to enable the involvement of multiple independent raters, including the calculation of inter-rater reliability coefficients [42, 43].

The observational component of this measure will facilitate longitudinal research on psychological safety, which has been limited to date [5]. Longitudinally applying this new composite measure will allow researchers to gain a more dynamic and holistic perspective of psychological safety which will expand our knowledge of how psychological safety works within healthcare teams. This will address the call made by Welp and Manser [25], for measures of teamwork in healthcare to account for temporal instability of healthcare teams.

Implications for practice

Healthcare teams can use this composite measure to learn about and improve psychological safety within their team. Harris et al. [27] suggest that it is feasible for healthcare professionals to undertake structured observational assessment and teams find feedback from such observations useful. We anticipate healthcare professionals using our observation measure to observe teams within their hospital to better understand psychological safety and stimulate team learning accordingly. It can also be used by team leaders or their coaches to identify observable behaviours related to psychological safety in their team. Being more conscious about such behaviours enables team leaders to find the root causes and act upon them. The outcomes of our work also inform Human Resource professionals. They can train team members to detect psychologically unsafe work situations and adopt relations-oriented behaviours that support a more psychologically safe, inclusive work climate instead [44].

Given the important role of psychological safety in healthcare teams, there is a need to understand the concept fully in order to consider how it can be improved [5, 26]. Creating and maintaining psychological safety will be paramount in dealing with the covid-19 crisis [45]. Healthcare teams will be required to draw on knowledge and learning from all parts of the healthcare system in order to make quick decisions, learn from mistakes and implement changes that will facilitate the safe delivery of care [45]. By gaining a better understanding of psychological safety in healthcare teams and using this knowledge to develop and implement interventions to improve psychological safety, we can increase team’s ability to learn, co-ordinate care and make decisions that will ultimately result in higher team performance. To date, there has been little guidance on how teams can introduce, improve, and maintain psychological safety. A recent systematic review identified both a lack of interventions targeting psychological safety and a lack of objective measures for identifying improvements in psychological safety [26]. The adapted measure presented in this article can be used to both inform the development of interventions to improve psychological safety, by gaining a more holistic understanding of it, and to assess the effectiveness of these interventions.

Conclusions

This study describes the methodology used to adapt observational and survey measures of psychological safety for use within healthcare teams, by building upon the feedback retrieved from the target audience: healthcare professionals. It also reports on a pilot test of the resulting composite measure. The adapted composite measure combines the strengths of observational and survey measures in order to gain a more holistic, nuanced understanding of psychological safety within healthcare teams, enable longitudinal research on psychological safety and inform future research to develop and test interventions to improve psychological safety.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

IRIS:

Centre for Interdisciplinary Research, Education, and Innovation in Health Systems

References

  1. Edmondson A. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44:350–83.

    Google Scholar 

  2. Nembhard IM, Edmondson AC. Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organ Behav. 2006;27:941–66.

    Google Scholar 

  3. Leroy H, Dierynck B, Anseel F, Simons T, Halbesleben JR, McCaughey D, et al. Behavioral integrity for safety, priority of safety, psychological safety, and patient safety: a team-level study. J Appl Psychol. 2012;97:1273–81.

    PubMed  Google Scholar 

  4. Edmondson AC, Lei Z. Psychological safety: the history, renaissance, and future of an interpersonal construct. Annu Rev Organ Psychol Organ Behav. 2014;1:23–43.

    Google Scholar 

  5. Newman A, Donohue R, Eva N. Psychological safety: a systematic review of the literature. Hum Resour Manag Rev. 2017;27:521–35.

    Google Scholar 

  6. Edmondson AC. Teaming: how organizations learn, innovate, and compete in the knowledge economy. San Francisco: Wiley; 2012.

  7. Nawaz H, Edmondson AC, Tzeng TH, Saleh JK, Bozic KJ, Saleh KJ. Teaming: an approach to the growing complexities in health care: AOA critical issues. J Bone Jt Surg Am. 2014;96:1–7.

    Google Scholar 

  8. Yeboah-Antwi K, Snetro-Plewman G, Waltensperger KZ, Hamer DH, Kambikambi C, MacLeod W, et al. Measuring teamwork and taskwork of community-based “teams” delivering life-saving health interventions in rural Zambia: a qualitative study. BMC Med Res Methodol. 2013;13:84.

    PubMed  PubMed Central  Google Scholar 

  9. Castle NG. An instrument to measure job satisfaction of nursing home administrators. BMC Med Res Methodol. 2006;6:47.

    PubMed  PubMed Central  Google Scholar 

  10. Mathieu JE, Hollenbeck JR, van Knippenberg D, Ilgen DR. A century of work teams in the journal of applied psychology. J. Appl. Psychol. 2017;102:452–67.

    PubMed  Google Scholar 

  11. Donaldson SI, Grant-Vallone EJ. Understanding self-report bias in organizational behavior research. J Bus Psychol. 2002;17:245–60.

    Google Scholar 

  12. Hoenderdos JW. Towards an observational measure for team psychological safety [bachelors thesis]. The Netherlands: University of Twente; 2013. p. 111.

    Google Scholar 

  13. Parkinson A, Jorm L, Douglas KA, Gee A, Sargent GM, Lujic S, et al. Recruiting general practitioners for surveys: reflections on the difficulties and some lessons learned. Aust J Prim Health. 2015;21:254–8.

    PubMed  Google Scholar 

  14. McLeod CC, Klabunde CN, Willis GB, Stark D. Health care provider surveys in the United States, 2000–2010: a review. Eval Health Prof. 2013;36:106–26.

    PubMed  Google Scholar 

  15. La Regina M, Tanzini M, Venneri F, Toccafondi G, Fineschi V, Lachman P, et al. Patient Safety Recommendations for Covid-19 Epidemic Outbreak; 2020. p. 7–30.

    Google Scholar 

  16. The Lancet. COVID-19: protecting health-care workers. Lancet. 2020;395:922.

    CAS  PubMed  PubMed Central  Google Scholar 

  17. Mathieu JE, Luciano MM, D’Innocenzo L, Klock EA, LePine JA. The development and construct validity of a team processes survey measure. Organ Res Methods. 2019;23(3):1–33.

  18. West M, Anderson N. The personality of Teamworking. Pers Manag. 1994. p. 81.

  19. Edmondson AC, Woolley AW. Understanding outcomes of organizational learning interventions. In: Easterby-Smith M, Lyles M, editors. Blackwell handbook of organizational learning and knowledge management. Malden: Blackwell Publishing; 2003.

    Google Scholar 

  20. Detert JR, Burris ER. Leadership behavior and employee voice: is the door really open? Acad Manag J. 2007;50:869–84.

    Google Scholar 

  21. Garvin DA, Edmondson AC, Gino F. Is yours a learning organization? Harv Bus Rev. 2008;86:109.

    PubMed  Google Scholar 

  22. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10:13.

    PubMed  PubMed Central  Google Scholar 

  23. Edmondson AC, Higgins M, Singer S, Weiner J. Understanding psychological safety in health care and education organizations: a comparative perspective. Res Hum Dev. 2016;13:65–83.

    Google Scholar 

  24. Dixon J, McNaughton-Nicholls C, d’Ardenne J, Doyle-Francis M, Manthorpe J. User involvement in designing a survey of people directly employing care and support workers. Evid Policy J Res Debate Pract. 2013;9:267–78.

    Google Scholar 

  25. Welp A, Manser T. Integrating teamwork, clinician occupational well-being and patient safety–development of a conceptual framework based on a systematic review. BMC Health Serv Res. 2016;16:281.

    PubMed  PubMed Central  Google Scholar 

  26. O’Donovan R, McAuliffe E. A systematic review exploring the content and outcomes of interventions to improve psychological safety, speaking up and voice behaviour. BMC Health Serv Res. 2020;20:1–11.

    Google Scholar 

  27. Harris J, Taylor C, Sevdalis N, Jalil R, Green JSA. Development and testing of the cancer multidisciplinary team meeting observational tool (MDT-MOT). Int J Qual Health Care. 2016;28:332–8.

    PubMed  PubMed Central  Google Scholar 

  28. Edmondson AC, McManus SE. Methodological fit in management field research. Acad Manag Rev. 2007;32:1246–64.

    Google Scholar 

  29. Chan BC, Perkins D, Wan Q, Zwar N, Daniel C, Crookes P, et al. Finding common ground? Evaluating an intervention to improve teamwork among primary health-care professionals. Int J Qual Health Care. 2010;22:519–24.

    PubMed  Google Scholar 

  30. Block LAM, Manning LJ. A systemic approach to developing frontline leaders in healthcare. Leadersh Health Serv. 2007;20:85–96.

    Google Scholar 

  31. Le Pine JA, Van Dyne L. Predicting voice behavior in work groups. J Appl Psychol. 1998;83:853–68.

    Google Scholar 

  32. Van Dyne LV, Ang S, Botero IC. Conceptualizing employee silence and employee voice as multidimensional constructs*. J Manag Stud. 2003;40:1359–92.

    Google Scholar 

  33. O’Donovan R, Mcauliffe E. A systematic review of factors that enable psychological safety in healthcare teams. Int J Qual Health Care. 2020;00:1–11.

    Google Scholar 

  34. Bergner RM. What is behavior? And so what? New Ideas Psychol. 2011;29:147–55.

    Google Scholar 

  35. Dinh JV, Traylor AM, Kilcullen MP, Perez JA, Schweissing EJ, Venkatesh A, et al. Cross-disciplinary care: a systematic review on teamwork processes in health care. Small Group Res. 2020;51:125–66.

    Google Scholar 

  36. Wright DN, Corner JL, Hopkinson JB, Foster CL. The case for user involvement in research: the research priorities of cancer patients. Breast Cancer Res. 2007;9:S3.

    PubMed Central  Google Scholar 

  37. Woods CM. Careless responding to reverse-worded items: implications for confirmatory factor analysis. J Psychopathol Behav Assess. 2006;28:186–91.

    Google Scholar 

  38. Darbyshire P, McDonald H. Choosing response scale labels and length: Guidance for researchers and clients. Aust J Market Res. 2004;12:17–26.

    Google Scholar 

  39. Dawes J. Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales. Int J Mark Res. 2008;50:61–104.

    Google Scholar 

  40. Cortina JM. What is coefficient alpha? An examination of theory and applications. J. Appl. Psychol. 1993;78:98–104.

    Google Scholar 

  41. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–5.

    PubMed  PubMed Central  Google Scholar 

  42. Hoogeboom MAMG, Wilderom CPM. A complex adaptive systems approach to real-life team interaction patterns, task context, information sharing, and effectiveness. Group Organ Manag. 2020;45:3–42.

    Google Scholar 

  43. Waller MJ, Kaplan SA. Systematic behavioral observation for emergent team phenomena: key considerations for quantitative video-based approaches. Organ Res Methods. 2018;21:500–15.

    Google Scholar 

  44. Tortorella G, van Dun DH, de Almeida AG. Leadership behaviors during lean healthcare implementation: a review and longitudinal study. J Manuf Technol Manag. 2019;31:193–215.

    Google Scholar 

  45. Stoller JK. Reflections on leadership in the time of COVID-19. BMJ Lead. 2020;0:1–3.

    Google Scholar 

  46. Kozlowski SWJ, Ilgen DR. Enhancing the effectiveness of work groups and teams. Psychol Sci Public Interest. 2006;7:77–124.

    PubMed  Google Scholar 

Download references

Acknowledgements

We thank ES for her contribution to the data collection in the Dutch teams.

Funding

This research is funded by the Irish Research Council and the Ireland East Hospital Group under the Employment Based Partnership Scholarship. The funders did not play a role in the design of the study, data collection, analysis and interpretation or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

All authors were involved in the design and planning of this study. ROD completed data collection and developed the first draft of the adapted measures. ROD conducted the pilot tests of the adapted measure in Ireland and DVD supervised the pilot testing in The Netherlands. All authors were involved in editing and finalising the adapted measures. ROD drafted the manuscript, DVD and EMcA contributed to writing and revising the paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Róisín O’Donovan.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained for this study from the University College Dublin Ethics Committee (Reference number: LS-17-67) and the University of Twente BMS Ethics Committee (Reference number: 190126). Written informed consent was obtained from all participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Appendix A.

Exploratory Phase Description. Table A1 Exploratory Phase Participant Information. Appendix B. Observation Measure Used During Pilot Tests. Appendix C. Definition of Behaviours in Observation Measure.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Donovan, R., Van Dun, D. & McAuliffe, E. Measuring psychological safety in healthcare teams: developing an observational measure to complement survey methods. BMC Med Res Methodol 20, 203 (2020). https://doi.org/10.1186/s12874-020-01066-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-020-01066-z

Keywords