Integrated Learner Assessment for Readiness Tracking within Virtual Reality Medical Simulation

Longitudinal learning performance, assessment, and readiness tracking are essential components for maintaining the high standard of capability required of DOD medical personnel. However, different learning modalities for medical training make standardization and performance tracking difficult. In this work, we report on our efforts to develop an integrated virtual assessment capability for medical simulation training using existing standardized assessment tools and integrate it into a pre-existing human performance tracking system to enable the future generation of novel insights into human performance, assessment, and readiness tracking. The Pararescue Medical Skills Certification Scoring Guide from Air Force Instruction 10-3502 was selected as the assessment instrument for this project, and the appropriate assessable items were selected for integration into the medical simulation system’s moderator tool. Additionally, an application programming interface (API) was identified for the performance tracking system to allow integration with the longitudinal readiness tracking system. The specified assessment tool was successfully implemented into the medical simulation system moderator tool. Major categories assessed included initial assessment tasks, recording of vitals and patient history, secondary assessment tasks, scenario-dependent tertiary tasks and MIST reporting, and specific knowledge assessment of protocols. Assessments were enabled on a per-learner basis, and the system API was used to enable upload of learner assessments, which then integrated assessments into the overall data analysis and tracking system. This was then integrated into a Tactical Combat Casualty Care (TCCC)-based medical simulation scenario proof-of-concept curriculum discussed in a separate report. The resulting capability then underwent initial testing and evaluation during training exercises by Pararescuemen and combat controllers at Hurlburt Field Air Force Base. Initial acceptance testing demonstrated the practical usability of the assessment scoring system by training facilitators, and a successful upload capability to the performance tracking system. Based on this result, further testing and evaluation is planned across an expanded trainee set.