TY - JOUR
T1 - Evaluation of 3 cognitive load measures during repeated simulation exercises for novice anesthesiology residents
AU - Toy, Serkan
AU - Miller, Christina R.
AU - Guris, Rodrigo J.Daly
AU - Duarte, Shirley S.
AU - Koessel, Sophia
AU - Schiavi, Adam
N1 - Funding Information:
Partially supported by a Johns Hopkins University Department of Anesthesiology and Critical Care Medicine Stimulating and Advancing ACCM Research (StAAR) Grant.
Publisher Copyright:
© 2020 Lippincott Williams and Wilkins. All rights reserved.
PY - 2020/12
Y1 - 2020/12
N2 - Introduction: Maintaining an appropriate level of cognitive load during simulations is crucial to optimize learning.We evaluated 3 subjective measures of cognitive load in a simulated operating room (OR) context across multiple scenarios of varying complexity. Methods: This observational study of 25 first-year anesthesiology residents took place during a 5-day simulation "Boot Camp." Each day, participants completed 2 different high-fidelity scenarios in a fully equipped simulatedOR. After each simulation, participants completed 3 cognitive load measures: The Paas scale, NASA Task Load Index (TLX), and Cognitive Load Component (CLC) questionnaire. Two-way repeated-measures and mixed-design analyses of variance, with the cognitive load measures and scenarios as independent factors, were used to determine the effect of using different measures to report cognitive load. Results: Cognitive load scores reported by all measures correlated significantly with one another (P < 0.01): TLX and Paas (r = 0.65); Paas and CLC (r = 0.63); and TLX and CLC (r = 0.61). The CLC subscale scores (intrinsic, extraneous, germane) also correlated significantly with composite TLX and Paas scores (P < 0.01). Scenarios and measures displayed significant interaction: F(10, 210) = 3.01, P = 0.001. Participants reported highest overall cognitive load using the Paas scale. Conclusions: All cognitive load measures were sensitive to scenario variability and showed similar fluctuation patterns across the 10 scenarios. The findings suggest that cognitive load measures can help create benchmarks based on learner perceptions of cognitive burden for different simulation scenarios.
AB - Introduction: Maintaining an appropriate level of cognitive load during simulations is crucial to optimize learning.We evaluated 3 subjective measures of cognitive load in a simulated operating room (OR) context across multiple scenarios of varying complexity. Methods: This observational study of 25 first-year anesthesiology residents took place during a 5-day simulation "Boot Camp." Each day, participants completed 2 different high-fidelity scenarios in a fully equipped simulatedOR. After each simulation, participants completed 3 cognitive load measures: The Paas scale, NASA Task Load Index (TLX), and Cognitive Load Component (CLC) questionnaire. Two-way repeated-measures and mixed-design analyses of variance, with the cognitive load measures and scenarios as independent factors, were used to determine the effect of using different measures to report cognitive load. Results: Cognitive load scores reported by all measures correlated significantly with one another (P < 0.01): TLX and Paas (r = 0.65); Paas and CLC (r = 0.63); and TLX and CLC (r = 0.61). The CLC subscale scores (intrinsic, extraneous, germane) also correlated significantly with composite TLX and Paas scores (P < 0.01). Scenarios and measures displayed significant interaction: F(10, 210) = 3.01, P = 0.001. Participants reported highest overall cognitive load using the Paas scale. Conclusions: All cognitive load measures were sensitive to scenario variability and showed similar fluctuation patterns across the 10 scenarios. The findings suggest that cognitive load measures can help create benchmarks based on learner perceptions of cognitive burden for different simulation scenarios.
KW - Cognitive load theory
KW - Cognitive load types
KW - Self-report measures of cognitive load
KW - Simulation design; anesthesiology simulations
UR - http://www.scopus.com/inward/record.url?scp=85097122926&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097122926&partnerID=8YFLogxK
U2 - 10.1097/SIH.0000000000000458
DO - 10.1097/SIH.0000000000000458
M3 - Article
C2 - 33269900
AN - SCOPUS:85097122926
SN - 1559-2332
VL - 15
SP - 388
EP - 396
JO - Simulation in Healthcare
JF - Simulation in Healthcare
IS - 6
ER -