Development of a valid and reliable video-based decision-making test for Australian football umpires
- Authors: Larkin, Paul , Mesagno, Christopher , Berry, Jason , Spittle, Michael
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Science and Medicine in Sport Vol. 17, no. 5 (2014), p. 552-555
- Full Text: false
- Reviewed:
- Description: OBJECTIVES: To develop a valid and reliable video-based decision-making test to examine and monitor the decision-making performance of Australian football umpires. DESIGN: Validation assessments with test re-test reliability. METHODS: A video-based decision-making test was developed from a pool of 156 video-based decision-making situations. Australian football umpires (n=56) and players (n=45) participated in two separate phases of analysis. In phase one, players completed a test re-test reliability assessment with a 100 video-clips. Results indicated 24 clips were a reliable measure of decision-making performance. In phase two, umpires completed a test re-test protocol with 80 clips, 24 of which were the reliable clips identified by the player cohort in phase one. These 24 clips provided a measure of construct validity. Face and content validity were assessed by skill acquisition specialists, expert umpire coaches, and umpires. RESULTS: From each of phase one and two of the reliability assessment, 24 clips were found to have a kappa value greater than 0.30, providing a total of 48 reliable video-clips. Construct validity was supported, with the umpire group performing significantly better than the player group on the 24 clips presented to both groups on each testing occasion. Face and content validity were also demonstrated. CONCLUSIONS: This investigation demonstrated the ability prospectively to determine reliability and validity of the video-based decision-making test designed specifically for Australian football umpires. Establishing the validity and reliability of the video clips ensures future investigations can accurately and consistently measure the decision-making performance of Australian football umpires.
Video-based training to improve perceptual-cognitive decision-making performance of Australian football umpires
- Authors: Larkin, Paul , Mesagno, Christopher , Berry, Jason , Spittle, Michael , Harvey, Jack
- Date: 2017
- Type: Text , Journal article
- Relation: Journal of Sports Sciences Vol. 36, no. 3 (2017), p. 239-246
- Full Text: false
- Reviewed:
- Description: Decision-making is a central component of the in-game performance of Australian football umpires; however, current umpire training focuses largely on physiological development with decision-making skills development conducted via explicit lecture-style meetings with limited practice devoted to making actual decisions. Therefore, this study investigated the efficacy of a video-based training programme, aimed to provide a greater amount of contextualised visual experiences without explicit instruction, to improve decision-making skills of umpires. Australian football umpires (n = 52) were recruited from metropolitan and regional Division 1 competitions. Participants were randomly assigned to an intervention or control group and classified according to previous umpire game experience (i.e., experienced; less experienced). The intervention group completed a 12-week video-based decision-making training programme, with decision-making performance assessed at pre-training, and 1-week retention and 3-week retention periods. The control group did not complete any video-based training. Results indicated a significant Group (intervention; Control) x Test interaction (F(1, 100) = 3.98; P = 0.02, partial 2 = 0.074), with follow-up pairwise comparisons indicating significant within-group differences over time for the intervention group. In addition, decision-making performance of the less experienced umpires in the intervention group significantly improved (F(2, 40) = 5.03, P = 0.01, partial 2 = 0.201). Thus, video-based training programmes may be a viable adjunct to current training programmes to hasten decision-making development, especially for less experienced umpires.