Measuring non-technical skills in medical emergency care: a review of assessment measures.
- Authors: Cooper, Simon J. , Endacott, Ruth , Cant, Robyn
- Date: 2010
- Type: Text , Journal article
- Relation: Open Access Emergency Medicine Vol. 2, no. (2010), p. 7-16
- Full Text:
- Reviewed:
- Description: Aim: To review the literature on non-technical skills and assessment methods relevant to emergency care. Background: Non-technical skills (NTS) include leadership, teamwork, decision making and situation awareness, all of which have an impact on healthcare outcomes. Significant concerns have been raised about the rates of adverse medical events, many of which are attributed to NTS failures. Methods: Ovid, Medline, ProQUEST, PsycINFO and specialty websites were searched for NTS measures using applicable access strategies, inclusion and exclusion criteria. Publications identified were assessed for relevance. Results: A range of non-technical skill measures relevant to emergency care was identified: leadership (n = 5), teamwork (n = 7), personality/behavior (n = 3) and situation awareness tools (n = 1). Of these, 9 have been used with emergency care populations/clinicians. All had varying degrees of reliability and validity. In the last decade there has been some development of teamwork measures specific to emergency care with a predominantly global and collective rating of broad skills. Conclusion: A variety of non-technical skill measures are available; only a few have been used in the emergency care arena. There is a need for an increase in the focused assessment of teamwork skills for a greater understanding of team performance to enhance patient safety in medical emergency care.
Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM)
- Authors: Cooper, Simon J. , Cant, Robyn , Sellick, Kenneth , Porter, Joanne , Somers, George , Kinsman, Leigh , Nestel, Debra
- Date: 2010
- Type: Text , Journal article
- Relation: Resuscitation Vol. 81, no. 4 (2010), p. 446-452
- Full Text: false
- Reviewed:
- Description: Aim To develop a valid, reliable and feasible teamwork assessment measure for emergency resuscitation team performance. Background Generic and profession specific team performance assessment measures are available (e.g. anaesthetics) but there are no specific measures for the assessment of emergency resuscitation team performance. Methods (1) An extensive review of the literature for teamwork instruments, and (2) development of a draft instrument with an expert clinical team. (3) Review by an international team of seven independent experts for face and content validity. (4) Instrument testing on 56 video-recorded hospital and simulated resuscitation events for construct, consistency, concurrent validity and reliability and (5) a final set of ratings for feasibility on fifteen simulated ‘real time’ events. Results Following expert review, selected items were found to have a high total content validity index of 0.96. A single ‘teamwork’ construct was identified with an internal consistency of 0.89. Correlation between the total item score and global rating (rho 0.95; p < 0.01) indicated concurrent validity. Inter-rater (k 0.55) and retest reliability (k 0.53) were ‘fair’, with positive feasibility ratings following ‘real time’ testing. The final 12 item (11 specific and 1 global rating) are rated using a five-point scale and cover three categories leadership, teamwork and task management. Conclusion In this primary study TEAM was found to be a valid and reliable instrument and should be a useful addition to clinicians’ tool set for the measurement of teamwork during medical emergencies. Further evaluation of the instrument is warranted to fully determine its psychometric properties.
Communication challenges in surgical oncology
- Authors: Nestel, Debra , Cooper, Simon J. , Bryant, Melanie , Higgins, Vaughan , Tabak, Diana. , Murtagh, G. , Barraclough, B
- Date: 2011
- Type: Text , Journal article
- Relation: Surgical Oncology Vol. 20, no. 3 (2011), p. 155-161
- Full Text: false
- Reviewed:
- Description: In this essay we set out clinical communication challenges in surgical oncology. We draw directly on relevant examples where they are available. Otherwise, we refer to the more generic surgical and medical literature. We offer 'macro' and 'micro' perspectives on clinical communication. That is, exploring communication challenges at the level of the organization and between individuals, doctors and patients and interprofessionally across different settings. Training content and methods are reported that address the complex communication challenges associated with surgical oncology. Innovations in simulation-based education offer exciting new opportunities for formative and summative assessment. We outline limitations of the essay and finally propose the content of a surgical oncology communication program.
Developing team based acute care scenarios: a rural hospital experience
- Authors: Missen, Karen , Sparkes, Louise , Porter, Joanne , Cooper, Simon J. , McConnell-Henry, Tracy
- Date: 2013
- Type: Text , Journal article
- Relation: International Emergency Nursing Vol. 21, no. 3 (2013), p. 186-189
- Full Text: false
- Reviewed:
- Description: Background Health professionals work in teams in a variety of health care settings especially in medical emergency teams at times of crisis. However, Registered Nurses (RNs) rarely have the chance to partake in educational programs designed for teams of nurses to practice working together in life-threatening situations. Further RN’s employed in rural setting have less opportunities for professional development than their city based counterparts. Simulated scenarios with a patient actor in a rural hospital have been utilised in this study to provide nurses with the opportunity to work as a team in the early recognition and management of patients with acute medical conditions. Aim This discussion paper focuses on one aspect of a larger research project with the aim of describing the development of team based scenarios for a rural hospital setting, focusing on the detection and management of a deteriorating patient. Methods Three team based scenarios, the related assessments and feedback techniques are all described. Conclusion Team based simulation provides a unique opportunity to assist registered nurses in rural settings in re-skilling or maintaining their emergency management skills.
Emergency resuscitation team roles: What constitutes a team and who's looking after the family
- Authors: Porter, Joanne , Cooper, Simon J. , Taylor, Beverley
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Nursing Education and Practice Vol. 4, no. 3 (2014), p. 124
- Full Text:
- Reviewed:
- Description: Aim of study: This study aimed to investigate the attitudes of personnel working in emergency departments on the constitution of a resuscitation team in particular the perceptions of the family liaison role. Methods: A paper base survey on family presence during resuscitation was distributed to emergency personnel working in 18 public departments in the state of Victoria, Australia. Results: A combination of nurses (n = 282) and doctors (n = 65) working in rural and metropolitan emergency departments, identified seven unique resuscitation team roles. Resuscitation teams were identified as comprising of three doctors, three nurses and one other which could be either. Respondents identified seven unique roles as consisting of a team leader, airway doctor, airway nurse, procedure doctor and procedure nurse, drugs nurse and a scribe. The respondents identified the following components as key to discussions with family members; emergency personnel, reassurance, diagnosis, regular updates, intervention, and prognosis (ER-DRIP). Conclusion: The acronym ER-DRIP can be used as a reminder to emergency staff when speaking with family members during resuscitation events ensuring they receive all the necessary information and support.
Measuring the non-technical skills of medical emergency teams: an update on validity and reliability of Team Emergency Assessment Measure (Team).
- Authors: Cant, Robyn , Cooper, Simon J.
- Date: 2014
- Type: Text , Journal article
- Relation: Resuscitation Vol. 85, no. (2014), p. 31-33
- Full Text: false
- Reviewed:
- Description: Medical emergency team performance including non-technical skills, is receiving increased attention due to the influences on patient safety. The Team Emergency Assessment Measure View the MathML source was developed to enable standardized performance assessment and structured team debriefing. From several studies, the View the MathML source has demonstrated a substantial body of normative data confirming its validity and reliability. This includes high uni-dimensional validity, significant subscale relationships between Teamwork and Leadership and between Teamwork and Task Management (p < 0.001), a Cronbach alpha of 0.92 and adequate construct validity. The tool has potential for team training to improve team's non-technical performance. Further testing is required in ‘real’ clinical settings.
Improving the non-technical skills of hospital medical emergency teams : The Team Emergency Assessment Measure (TEAM™)
- Authors: Cant, Robyn , Porter, Joanne , Cooper, Simon J. , Roberts, Kate , Wilson, Ian , Gartside, Christopher
- Date: 2016
- Type: Text , Journal article
- Relation: EMA - Emergency Medicine Australasia Vol. 28, no. 6 (2016), p. 641-646
- Full Text: false
- Reviewed:
- Description: Objectives: This prospective descriptive study aimed to test the validity and feasibility of the Team Emergency Assessment Measure (TEAM™) for assessing real-world medical emergency teams' non-technical skills. Second, the present study aimed to explore the instrument's contribution to practice regarding teamwork and learning outcomes. Methods: Registered nurses (RNs) and medical staff (n = 104) in two hospital EDs in rural Victoria, Australia, participated. Over a 10 month period, the (TEAM™) instrument was completed by multiple clinicians at medical emergency episodes. Results: In 80 real-world medical emergency team resuscitation episodes (283 clinician assessments), non-technical skills ratings averaged 89% per episode (39 of a possible 44 points). Twenty-one episodes were rated in the lowest quartile (i.e. ≤37 points out of 44). Ratings differed by discipline, with significantly higher scores given by medical raters (mean: 41.1 ± 4.4) than RNs (38.7 ± 5.4) (P = 0.001). This difference occurred in the Leadership domain. The tool was reliable with Cronbach's alpha 0.78, high uni-dimensional validity and mean inter-item correlation of 0.45. Concurrent validity was confirmed by strong correlation between TEAM™ score and the awarded Global Rating (P < 0.001), with 38.4% of shared variance. RNs praised the instrument as it initiated staff reflection and debriefing discussions around performance improvement. Conclusion: Non-technical skills of medical emergency teams are known to often be suboptimal; however, average ratings of 89% were achieved in this real-world study. TEAM™ is a valid, reliable and easy to use tool, for both training and clinical settings, with benefits for team performance when used as an assessment and/or debriefing tool. © 2016 Australasian College for Emergency Medicine and Australasian Society for Emergency Medicine
Measuring teamwork performance: Validity testing of the Team Emergency Assessment Measure (TEAM) with clinical resuscitation teams
- Authors: Cooper, Simon J. , Cant, Robyn , Connell, Cliff , Sims, Lyndall , Porter, Joanne , Symmons, Mark , Nestel, Debra , Liaw, Sok Ying
- Date: 2016
- Type: Text , Journal article
- Relation: Resuscitation Vol. 101, no. (2016), p. 97-101
- Full Text: false
- Reviewed:
- Description: AimTo test the resuscitation non-technical Team Emergency Assessment Measure (TEAM) for feasibility, validity and reliability, in two Australian Emergency Departments (ED). BackgroundNon-technical (teamwork) skills have been identified as inadequate and as such have a significant impact on patient safety. Valid and reliable teamwork assessment tools are an important element of performance assessment and debriefing processes. MethodsA quasi experimental design based on observational ratings of resuscitation non-technical skills in two metropolitan ED. Senior nursing staff rated 106 adult resuscitation team events over a ten month period where three or more resuscitation team members attended. Resuscitation events, team performance and validity and reliability data was collected for the TEAM. ResultsMost rated events were for full cardiac resuscitation (43%) with 3–15 team members present for an average of 45min. The TEAM was found to be feasible and quickly completed with minimal or no training. Discriminant validity was good as was internal consistency with a Cronbach alpha of 0.94. Uni-dimensional and concurrent validity also reached acceptable standards, 0.94 and >0.63 (p=<0.001), respectively, and a single ‘teamwork’ construct was identified. Non-technical skills overall were good but leadership was rated notably lower than task and teamwork performance indicating a need for leadership training. ConclusionThe TEAM is a feasible, valid and reliable non-technical assessment measure in simulated and real clinical settings. Emergency teams need to develop leadership skills through training and reflective debriefing.
Team Emergency Assessment Measure (TEAM) for the assessment of non-technical skills during resuscitation : Validation of the french version
- Authors: Maignan, Maxime , Koch, Francois-Xavier , Chaix, Jordane , Phellouzat, Pierre , Binauld, Gery , Collomb Muret, Roselyne , Cooper, Simon J. , Labarère, José , Danel, Vincent , Viglino, Damien , Debaty, Guillaume
- Date: 2016
- Type: Text , Journal article
- Relation: Resuscitation Vol. 101, no. (2016), p. 115-120
- Full Text: false
- Reviewed:
- Description: Aim: Evaluation of team performances during medical simulation must rely on validated and reproducible tools. Our aim was to build and validate a French version of the Team Emergency Assessment Measure (TEAM) score, which was developed for the assessment of team performance and non-technical skills during resuscitation. Methods: A forward and backward translation of the initial TEAM score was made, with the agreement and the final validation by the original author. Ten medical teams were recruited and performed a standardized cardiac arrest simulation scenario. Teams were videotaped and nine raters evaluate non-technical skills for each team thanks to the French TEAM Score. Psychometric properties of the score were then evaluated. Results: French TEAM score showed an excellent reliability with a Cronbach coefficient of 0.95. Mean correlation coefficient between each item and the global score range was 0.78. The inter-rater reliability measured by intraclass correlation coefficient of the global score was 0.93. Finally, expert teams had higher French TEAM score than intermediate and novice teams. Conclusion: The French TEAM score shows good psychometric properties to evaluate team performance during cardiac arrest simulation. Its utilization could help in the assessment of non-technical skills during simulation. © 2015 Elsevier Ireland Ltd.
Rating teams’ non-technical skills in the emergency department : A qualitative study of nurses’ experience
- Authors: Porter, Joanne , Cant, Robyn , Cooper, Simon J.
- Date: 2018
- Type: Text , Journal article
- Relation: International Emergency Nursing Vol. 38, no. (2018), p. 15-20
- Full Text: false
- Reviewed:
- Description: Introduction: Non-technical skills (NTS) teamwork training can enhance clinicians’ understanding of roles and improve communication. We evaluated a quality improvement project rating teams’ NTS performance to determine the value of formal rating and debriefing processes. Methods: In two Australian emergency departments the NTS of resuscitation teams were rated by senior nurses and medical staff. Key measures were leadership, teamwork, and task management using a valid instrument: Team Emergency Assessment Measure (TEAM™). Emergency nurses were asked to attend a focus group from which key themes around the quality improvement process were identified. Results: Main themes were: ‘Team composition’ (allocation of resuscitation team roles), ‘Resuscitation leadership’ (including both nursing and medical leadership roles) and ‘TEAM™ ratings promote reflective practice’ (providing staff a platform to discuss team effectiveness). Objective ratings were seen as enabling staff to provide feedback to other team members. Reflection on practice and debriefing were thought to improve communication, help define roles and responsibilities, and clarify leadership roles. Conclusion: Use of a non-technical skills rating scheme such as TEAM™ after team-based clinical resuscitation events was seen by emergency department nurses as feasible and a useful process for examining and improving multi-disciplinary practice, while improving team performance. © 2018 Elsevier Ltd
The TEAM instrument for measuring emergency team performance: validation of the Swedish version at two emergency departments
- Authors: Karlgren, Klas , Dahlström, Anders , Birkestam, Anderz , Norling, Annelie , Forss, Gustav , Cooper, Simon J.
- Date: 2021
- Type: Text , Journal article
- Relation: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine Vol. 29, no. 1 (2021), p.
- Full Text:
- Reviewed:
- Description: Background: The Team Emergency Assessment Measure (TEAM) questionnaire is designed for rating the non-technical performance of emergency medical teams during emergencies, e.g., resuscitation or trauma management. Originally developed in Australia it has today been translated and validated into eleven languages, but a Swedish version is lacking. The aim was therefore to cross-culturally translate and evaluate the reliability and validity of the TEAM questionnaire in a Swedish health care setting. Methods: The instrument was forward and backward translated and adapted into a Swedish context according to established guidelines for cross-cultural adaptation of survey-based measures. The translated version was tested through 78 pairwise assessments of 39 high-priority codes at the emergency departments of two major hospitals. The raters observed the teams at work in real time and filled in the questionnaires immediately afterwards independently of each other. Psychometric properties of the instrument were evaluated. Results: The original instrument was translated by pairs of translators independently of each other and reviewed by an expert committee of researchers, nurses and physicians from different specialties, a linguist and one of the original developers of the tool. A few adaptations were needed for the Swedish context. A principal component factor analysis confirmed a single ‘teamwork’ construct in line with the original instrument. The Swedish version showed excellent reliability with a Cronbach’s alpha of 0.955 and a mean inter-item correlation of 0.691. The mean item-scale correlation of 0.82 indicated high internal consistency reliability. Inter-rater reliability was measured by intraclass correlation and was 0.74 for the global score indicating good reliability. Individual items ranged between 0.52 and 0.88. No floor effects but ceiling effects were noted. Finally, teams displaying clear closed-loop communication had higher TEAM scores than teams with less clear communication. Conclusions: Real time observations of authentic, high priority cases at two emergency departments show that the Swedish version of the TEAM instrument has good psychometric properties for evaluating team performance. The TEAM instrument is thus a welcome tool for assessing non-technical skills of emergency medical teams. © 2021, The Author(s). **Please note that there are multiple authors for this article therefore only the name of the first 5 including Federation University Australia affiliate “Simon Cooper" is provided in this record**