In response to the request to provide detailed description of the metric development, validation and scoring for OSIEs and detailed description of the development and evaluation of prevention and leader surveys, we provide two published manuscripts, a Rand report and an article from Health Promotion Practice.
The RAND report, Novel Methods to Assess the Military's Evolving Prevention Capabilities: Development and Pilot Test of the On-Site Installation Evaluation Process describes in detail the development and pilot testing of the OSIE methods and metrics. The initiative was driven by the need to address harmful behaviors within the military, including sexual assault, harassment, domestic violence, and suicide, which can significantly affect service members' health, quality of life, and force readiness.
Metrics: OSIEs measure progress in prevention capacity at installations based on 9 maturity score dimensions. The conceptualization and development of these metrics are documented in Chapter 2 (pp. 6 – 22). This section includes identification and supporting evidence for maturity score dimensions and sub-dimensions and how maturity score dimensions are scored. Chapter 3 (pp. 23 – 35) documents pilot testing of the OSIE process including site selection, OSIE data collection procedures, additional details on scoring metrics, and validation of the metrics.
Surveys: Two surveys were developed by Rand to assess competencies in prevention. One for prevention practitioners and one for service members identified as leaders (officers, senior enlisted leaders). Both surveys were adapted from the Competency Assessment for Sexual Assault Prevention Practitioners (CASAPP, O’Neill et al., 2023). Development and validation of the CASAPP is detailed in the O’Neill paper. The adaptation for use in OSIEs is described in the Rand report (pp.28 – 30).
Acosta, J. D., Chinman, M., Atshan, S., Baker, J., Barton, C., Bialas, A., Blagg, T. L., Bhandarkar, M., Estrada-Darley, I., Flaspohler, P., Hernandez, B., Holliday, S. B., Imm, P., LaCoste, C. K., Lee, S. D., Meadows, S. O., Miller, L. L., Pint, E. M., Scholl, K., … Zenger, K. (2023). Novel methods to assess the military’s evolving prevention capabilities: Development and pilot test of the on-site installation evaluation process. RAND Corporation. https://www.rand.org/pubs/research_reports/RRA1353-1.html
O’Neill, A. S., Acosta, J. D., Chinman, M., Tharp, A. L., & Fortson, B. L. (2023). Development and pilot test of the competency assessment for sexual assault prevention practitioners. Health Promotion Practice, 24(3), 514–522. https://doi.org/10.1177/15248399221084228
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Flaspohler, Paul D. |
| File Modified | 0000-00-00 |
| File Created | 2025-02-28 |