Measuring the quality of nursing clinical placements and the development of the Placement Evaluation Tool (PET) in a mixed methods co-design project
- Authors: Cooper, Simon J. , Cant, Robyn , Waters, Donna , Luders, Elise , Henderson, Amanda , Willetts, Georgina , Tower, Marion , Reid-Searl, Kerry , Ryan, Colleen , Hood, Kerry
- Date: 2020
- Type: Text , Journal article
- Relation: BMC Nursing Vol. 19, no. 1 (2020), p.
- Full Text:
- Reviewed:
- Description: Background: The quality of nursing clinical placements has been found to vary. Placement evaluation tools for nursing students are available but lack contemporary reviews of clinical settings. Therefore, the aim of this study was to develop a feasible, valid and reliable clinical placement evaluation tool applicable to nursing student placements in Australia. Methods: An exploratory mixed methods co-design project. Phase 1 included a literature review; expert rating of potential question items and Nominal Group Technique meetings with a range of stakeholders for item development. Phase 2 included on-line pilot testing of the Placement Evaluation Tool (PET) with 1263 nursing students, across all year levels at six Australian Universities and one further education college in 2019–20, to confirm validity, reliability and feasibility. Results: The PET included 19-items (rated on a 5-point agreement scale) and one global satisfaction rating (a 10-point scale). Placements were generally positively rated. The total scale score (19 items) revealed a median student rating of 81 points from a maximum of 95 and a median global satisfaction rating of 9/10. Criterion validity was confirmed by item correlation: Intra-class Correlation Co-efficient ICC =.709; scale total to global score r =.722; and items to total score ranging from.609 to.832. Strong concurrent validity was demonstrated with the Clinical Learning Environment and Supervision Scale (r =.834). Internal reliability was identified and confirmed in two subscale factors: Clinical Environment (Cronbach’s alpha =.94) and Learning Support (alpha =.96). Based on the short time taken to complete the survey (median 3.5 min) and students’ comments, the tool was deemed applicable and feasible. Conclusions: The PET was found to be valid, reliable and feasible. Use of the tool as a quality assurance measure is likely to improve education and practice in clinical environments. Further international evaluation of the instrument is required to fully determine its psychometric properties. © 2020, The Author(s).
- Description: This work was funded by the Council of Deans of Nursing and Midwifery (Australia and New Zealand) – 2019. The funding body had no role in the design of the study and collection, analysis, and interpretation of data, or in writing the manuscript.
What's in a name? Clarifying the nomenclature of virtual simulation
- Authors: Cant, Robyn , Cooper, Simon J. , Sussex, Roland , Bogossian, Fiona
- Date: 2019
- Type: Text , Journal article
- Relation: Clinical Simulation in Nursing Vol. 27, no. (2019), p. 26-30
- Full Text: false
- Reviewed:
- Description: Clinical simulation is an essential component of health professional education. Digital technologies can provide students with near-reality, interactive virtual simulation learning experiences on static and mobile appliances. Clarification is needed, however, regarding the various types of virtual simulation and the different program components. We drew on published literature to define virtual simulation modalities and to offer definitive terminology to clarify the nomenclature and composition of virtual simulation. Reporting should include description of ‘Fidelity’ ‘Immersion’ and ‘Patient’ to add clarity and utility to research in the field.
Do simulation studies measure up? A simulation study quality review
- Authors: Cant, Robyn , Levett-Jones, Tracy , James, Ainsley
- Date: 2018
- Type: Text , Journal article , Review
- Relation: Clinical Simulation in Nursing Vol. 21, no. (2018), p. 23-39
- Full Text:
- Reviewed:
- Description: Simulation-based education has become a ubiquitous teaching approach in nursing. However, ensuring the quality of simulation research is critical. We reviewed the methodological quality of 26 quantitative studies published in Clinical Simulation in Nursing, 2017. The Medical Education Research Study Quality Instrument and Simulation Research Evaluation Rubric showed that nearly all studies were of moderate to high quality (rated ≥50%). Correlation coefficients showed that interrater agreement was high overall (≥0.94). In conclusion, this was a valid approach for examining simulation study quality. Although most included studies were of high quality, some elements of study reporting can be improved upon.
Doing the right thing at the right time: Assessing responses to patient deterioration in electronic simulation scenarios using course-of-action analysis.
- Authors: Cooper, Simon J. , Cant, Robyn , Bogossian, Fiona , Bucknall, Tracey , Hopmans, Ruben
- Date: 2015
- Type: Text , Journal article
- Relation: CIN: Computers, Informatics, Nursing Vol. 33, no. 5 (2015), p. 199-207
- Full Text: false
- Reviewed:
- Description: International studies indicate that the recognition and management of deteriorating patients in hospitals are poor and that patient assessment is often inadequate. Face-to-face simulation programs have been shown to have an impact on educational and clinical outcomes; however, little is known about performance in contemporary healthcare e-simulation approaches. Using data from an open-access Web-based patient deterioration program (FIRSTACTWeb), the performance of 367 Australian nursing students in identification of treatment priorities and clinical actions was analyzed using a military model of Course of Action Simulation Analysis. Participants' performance in the whole program demonstrated a significant improvement in knowledge and skills (P ≤ .001) with high levels of participant satisfaction. Course of Action Simulation Analysis modeling identified three key participant groupings within which only 18% took the "best course of action" (the right actions and timing), with most (70%) completing the right actions but in the wrong order. The remaining 12% produced incomplete assessments and actions in an incorrect sequence. Contemporary approaches such as e-simulation do enhance educational outcomes. Measurement of performance when combined with Course of Action Simulation Analysis becomes a useful tool in the description of outcomes, an understanding of decision making, and the prediction of future events.
E-simulation:pre-registration nursing students' evaluation of an on-line patient deterioration program
- Authors: Cant, Robyn , Young, Susan , Cooper, Simon J. , Porter, Joanne
- Date: 2015
- Type: Text , Journal article
- Relation: CIN: Computers, Informatics, Nursing Vol. 33, no. 3 (2015), p. 108-114
- Full Text: false
- Reviewed:
- Description: This study explores preregistration nursing students’ views of a Web-based simulation program: FIRST2 ACTWeb (Feedback Incorporating Review and Simulation Techniques to Act on Clinical Trends-Web). The multimedia program incorporating three videoed scenarios portrayed by a standardized patient (human actor) aims to improve students’ recognition and management of hospital patient deterioration. Participants were 367 final-year nursing students from three universities who completed an online evaluation survey and 19 students from two universities who attended one of five focus groups. Two researchers conducted a thematic analysis of the transcribed narratives. Three core themes identified were as follows: “ease of program use,” “experience of e-Simulation,” and “satisfaction with the learning experience.” The Web-based clinical learning environment was endorsed as functional, feasible, and easy to use and was reported to have high fidelity and realism. Feedback in both focus groups and surveys showed high satisfaction with the learning experience. Overall, evaluation suggested that the Web-based simulation program successfully integrated elements essential for blended learning. Although Web-based educational applications are resource intensive to develop, positive appraisal of program quality, plus program accessibility and repeatability, appears to provide important educational benefits. Further research is needed to determine the transferability of these learning experiences into real-world practice.
Preparing nursing students for the future: development and implementation of an Australian Bachelor of Nursing program with a community health focus
- Authors: Cooper, Simon J. , Cant, Robyn , Browning, Mark , Robinson, Eddie
- Date: 2015
- Type: Text , Journal article
- Relation: Contemporary Nurse: A Journal for the Australian Nursing Profession Vol. 49, no. (2015), p. 68-74
- Full Text: false
- Reviewed:
- Description: This paper focuses on changes in the educational preparation of undergraduate nurses in line with contemporary primary and preventative healthcare models. We evaluated a new Australian nursing and community care degree programme using focus groups with 38 students in their first years of study, and quantitative performance data (regarding entry, performance and course attrition). Four main themes were identified related to students’ course experience: ‘I think community health should be an elective’; ‘Focus on relevance to practice’; ‘Teaching by non-nursing academics’ and ‘Access to support during transition to university.’ Overall pass rates were 94% (first year) and 97% (second year) with a low 11% attrition rate. We conclude that based on prior experiences and stereotypical views, students may be ambivalent about the inclusion of primary and preventative care models which nevertheless are essential to enhance practice and to prepare the future nursing workforce
Undergraduate nursing students' peformance in recognising and responding to sudden patient deterioration in high psychological fidelity simulated environments: Quantitative results from an Australian multi-centre study
- Authors: Bogossian, Fiona , Cooper, Simon J. , Cant, Robyn , Beauchamp, Alison , Porter, Joanne , Kain, Victoria , Bucknall, Tracey , Phillips, Nicole
- Date: 2014
- Type: Text , Journal article
- Relation: Nurse Education Today Vol. 34, no. 5 (2014), p. 691-696
- Full Text: false
- Reviewed:
- Description: Objectives This paper reports the quantitative findings of the first phase of a larger program of ongoing research: Feedback Incorporating Review and Simulation Techniques to Act on Clinical Trends (FIRST2ACTTM). It specifically aims to identify the characteristics that may predict primary outcome measures of clinical performance, teamwork and situation awareness in the management of deteriorating patients. Design Mixed-method multi-centre study. Setting High fidelity simulated acute clinical environment in three Australian universities. Participants A convenience sample of 97 final year nursing students enrolled in an undergraduate Bachelor of Nursing or combined Bachelor of Nursing degree were included in the study. Method In groups of three, participants proceeded through three phases: (i) pre-briefing and completion of a multi-choice question test, (ii) three video-recorded simulated clinical scenarios where actors substituted real patients with deteriorating conditions, and (iii) post-scenario debriefing. Clinical performance, teamwork and situation awareness were evaluated, using a validated standard checklist (OSCE), Team Emergency Assessment Measure (TEAM) score sheet and Situation Awareness Global Assessment Technique (SAGAT). A Modified Angoff technique was used to establish cut points for clinical performance. Results Student teams engaged in 97 simulation experiences across the three scenarios and achieved a level of clinical performance consistent with the experts' identified pass level point in only 9 (1%) of the simulation experiences. Knowledge was significantly associated with overall teamwork (p = .034), overall situation awareness (p = .05) and clinical performance in two of the three scenarios (p = .032 cardiac and p = .006 shock). Situation awareness scores of scenario team leaders were low overall, with an average total score of 41%. Conclusions Final year undergraduate nursing students may have difficulty recognising and responding appropriately to patient deterioration. Improving pre-requisite knowledge, rehearsal of first response and team management strategies need to be a key component of undergraduate nursing students' education and ought to specifically address clinical performance, teamwork and situation awareness.
Managing patient deterioration: A protocol for enhancing student nurses' competence through web-based simulation and feedback techniques
- Authors: Cooper, Simon J. , Beauchamp, Alison , Bogossian, Fiona , Bucknall, Tracey , Cant, Robyn , Devries, Brett , Endacott, Ruth , Forbes, Helen , Hill, Robyn , Kinsman, Leigh , Kain, Victoria , McKenna, Lisa , Porter, Joanne , Phillips, Nicole , Young, Susan
- Date: 2012
- Type: Text , Journal article
- Relation: BMC Nursing Vol. 11, no. 18 (2012), p.1-7
- Full Text:
- Reviewed:
- Description: Aims To describe a funded proposal for the development of an on-line evidence based educational program for the management of deteriorating patients. Background There are international concerns regarding the management of deteriorating patients with issues around the ‘failure to rescue’. The primary response to these issues has been the development of medical emergency teams with little focus on the education of primary first responders. Design/Methods A mixed methods triangulated convergent design. In this four phase proposal we plan to 1. examine nursing student team ability to manage deteriorating patients and based upon these findings 2. develop web based educational material, including interactive scenarios. This educational material will be tested and refined in the third Phase 3, prior to evaluation and dissemination in the final phase. Conclusion This project aims to enhance knowledge development for the management of deteriorating patients through rigorous assessment of team performance and to produce a contemporary evidence-based online training program.
Managing deteriorating patients: Registered nurses' performance in a simulated setting
- Authors: Cooper, Simon J. , McConnell-Henry, Tracy , Cant, Robyn , Porter, Joanne , Missen, Karen , Kinsman, Leigh , Endacott, Ruth , Scholes, Julie
- Date: 2011
- Type: Text , Journal article
- Relation: The Open Nursing Journal Vol. 5, no. (2011), p. 120-126
- Full Text:
- Reviewed:
- Description: Aim: To examine, in a simulated environment, rural nurses’ ability to assess and manage patient deterioration using measures of knowledge, situation awareness and skill performance. Background: Nurses’ ability to manage deterioration and ‘failure to rescue’ are of significant concern with questions over knowledge and clinical skills. Simulated emergencies may help to identify and develop core skills. Methods: An exploratory quantitative performance review. Thirty five nurses from a single ward completed a knowledge questionnaire and two video recorded simulated scenarios in a rural hospital setting. Patient actors simulated deteriorating patients with an Acute Myocardial Infarction (AMI) and Chronic Obstructive Pulmonary Disease (COPD) as the primary diagnosis. How aware individuals were of the situation (levels of situation awareness) were measured at the end of each scenario. Results: Knowledge of deterioration management varied considerably (range: 27%-91%) with a mean score of 67%. Average situation awareness scores and skill scores across the two scenarios (AMI and COPD) were low (50%) with many important observations and actions missed. Participants did identify that ‘patients’ were deteriorating but as each patient deteriorated staff performance declined with a reduction in all observational records and actions. In many cases, performance decrements appeared to be related to high anxiety levels. Participants tended to focus on single signs and symptoms and failed to use a systematic approach to patient assessment. Conclusion: Knowledge and skills were generally low in this rural hospital sample with notable performance decrements as patients acutely declined. Educational models that incorporate high fidelity simulation and feedback techniques are likely to have a significant positive impact on performance.