Utility of the Jefferson Teamwork Observation Guide for Measuring Collaborative Practice Competencies Virtually, In-Person, and Across Health Professions: A Rasch Analysis

Modern healthcare increasingly requires interprofessional teams to collaborate both in person and virtually to effectively achieve common goals. To prepare students for interprofessional collaborative practice (CP) universities need evaluation tools that can validly and reliably measure students' CP competencies after online and in-person interprofessional education. The Jefferson Teamwork Observation Guide (R) (JTOG) is a 360-degree evaluation tool previously validated to measure nationally-defined CP competencies. The psychometrics of the Individual JTOG have been examined in a sample of interprofessional healthcare students after online interprofessional education. The present study examined the psychometric properties of the Individual JTOG in 709 students after in-person interprofessional education using Rasch Modeling and compared results across collaborative settings and student professions. Results indicated that item and person statistics, unidimensionality, scaling performance, and local independence of the Individual JTOG were comparable between online and in-person samples, suggesting it is consistent in its measurement of CP competencies across collaborative settings. Psychometric properties were strong, but ceiling effects were present. Minor deviations were found in the Individual JTOG's unidimensionality between professional groups. The Values and Ethics construct was more strongly separated from others for nursing than other health professions. Recommendations for future research and possible adaptations to the instrument are discussed.