TY - JOUR
T1 - A Systematic Review of Validity Evidence for the Fundamentals of Laparoscopic Surgery Examination in Gynecology
AU - Lerner, Veronica
AU - DeStephano, Christopher
AU - Ulrich, Amanda
AU - Han, Esther S.
AU - LeClaire, Edgar
AU - Chen, Chi Chiung Grace
N1 - Publisher Copyright:
© 2021 AAGL
PY - 2021/7
Y1 - 2021/7
N2 - Objective: The Fundamentals in Laparoscopic Surgery (FLS) examination is designed to test laparoscopic surgery skills. Our aim for this systematic review was to examine validity evidence supporting or refuting the FLS examination specifically as a high-stakes summative assessment tool in gynecology. Data Sources: The data sources were PubMed, MEDLINE, Embase, and Scopus. Methods of Study Selection: The study eligibility criterion was the subject of the FLS examination as an assessment tool in gynecology. We developed a data extraction tool and assigned articles for screening and extraction to all authors, who then abstracted data independently. Conflicts that arose during the extraction process were resolved by consensus. We organized validity evidence for the cognitive and manual skills portions on the basis of the categories of current validation standards. Tabulation, Integration, and Results: From 1971 citations identified, 9 studies were included, involving 319 participants. For the cognitive portion of the test, the results were mixed in 5 studies in relationships with the other variables category. For the manual portion of the test, most of the studies focused on the relationships with other variables evidence with mixed findings. The concerning findings in the manual skills portion included the lack of transferability of skills to the operating room, limited mixed evidence for improvement in operating room performance, and worse performance by obstetrics and gynecology surgeons compared with other specialties. We did not find supportive content-based, response process, or consequential evidence in either the cognitive or manual skills portion of the test. Conclusion: Validity evidence for the FLS examination was either mixed, as it pertained to relationships with other variables, or lacking in other important evidence categories. Further evidence is required to justify the use of the FLS examination scores as a high-stakes summative assessment.
AB - Objective: The Fundamentals in Laparoscopic Surgery (FLS) examination is designed to test laparoscopic surgery skills. Our aim for this systematic review was to examine validity evidence supporting or refuting the FLS examination specifically as a high-stakes summative assessment tool in gynecology. Data Sources: The data sources were PubMed, MEDLINE, Embase, and Scopus. Methods of Study Selection: The study eligibility criterion was the subject of the FLS examination as an assessment tool in gynecology. We developed a data extraction tool and assigned articles for screening and extraction to all authors, who then abstracted data independently. Conflicts that arose during the extraction process were resolved by consensus. We organized validity evidence for the cognitive and manual skills portions on the basis of the categories of current validation standards. Tabulation, Integration, and Results: From 1971 citations identified, 9 studies were included, involving 319 participants. For the cognitive portion of the test, the results were mixed in 5 studies in relationships with the other variables category. For the manual portion of the test, most of the studies focused on the relationships with other variables evidence with mixed findings. The concerning findings in the manual skills portion included the lack of transferability of skills to the operating room, limited mixed evidence for improvement in operating room performance, and worse performance by obstetrics and gynecology surgeons compared with other specialties. We did not find supportive content-based, response process, or consequential evidence in either the cognitive or manual skills portion of the test. Conclusion: Validity evidence for the FLS examination was either mixed, as it pertained to relationships with other variables, or lacking in other important evidence categories. Further evidence is required to justify the use of the FLS examination scores as a high-stakes summative assessment.
KW - Assessment
KW - Fundamentals of laparoscopic surgery
KW - Gynecology
KW - Simulation
KW - Validation
UR - http://www.scopus.com/inward/record.url?scp=85106263034&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85106263034&partnerID=8YFLogxK
U2 - 10.1016/j.jmig.2021.04.010
DO - 10.1016/j.jmig.2021.04.010
M3 - Review article
C2 - 33895352
AN - SCOPUS:85106263034
SN - 1553-4650
VL - 28
SP - 1313
EP - 1324
JO - Journal of Minimally Invasive Gynecology
JF - Journal of Minimally Invasive Gynecology
IS - 7
ER -