FY18 Patient Safety Survey
21 March 2018
SUPPORTING STATEMENT – PART B
1. Description of the Activity
The proposed project will administer the patient safety culture survey as a web-based instrument to a census of all staff, both clinical and non-clinical, working in Continental United States (CONUS) and internationally (OCONUS) Military Health System (MHS) facilities. There are approximately 144,200 MHS staff, military and civilian employees, assigned to military health facilities throughout CONUS and OCONUS (estimate from FY 2018 TRICARE Report to Congress). Of these personnel, approximately 23,000 (about 16%) of the personnel are contractors, local nationals, volunteers or other civilian MHS staff who are not direct employees of the DoD. Based upon the historical overall response rate of approximately 40%, we anticipate 57,680 total completed responses with 9,200 of those completed surveys resulting from individuals who are not direct employees of the DoD (contractors, local nationals, volunteers, other non-DoD MHS staff). The survey takes about 10 minutes to complete. All survey responses are voluntary and will be individually anonymous; only group-level results will be tabulated to protect individual anonymity.
While we recognize the OMB guidance requests a description of how non-response bias will be addressed, conducting a non-response analysis in this case is not feasible. Because no sampling frame of the population will be created, and the population universe is somewhat unknown, it is difficult if not infeasible to compare respondents to non-respondents. Additionally, because of the sensitivity of the survey topic, the Patient Safety Program places emphasis on anonymity; to ensure this anonymity, each Military Treatment Facility (MTF) is responsible for distributing the survey link to staff members rather than the contractor receiving a sampling frame and distributing survey invitations. Each MTF reports the total number of staff eligible to take the survey so that a response rate can be calculated, but no demographic information or any other characteristics are provided. We will take the measures described elsewhere in this document to encourage a high response rate and will calculate response rates at the population level.
2. Procedures for the Collection of Information
The proposed project will administer the patient safety culture survey as a web-based instrument to a census of all staff, both clinical and non-clinical, working in CONUS and OCONUS MHS facilities. To standardize the process across MHS facilities, data collection will be simultaneously conducted at Army, Navy, Air Force, and the National Capital Region (NCR). MHS facilities. This survey will be administered on a voluntary-basis to all staff working in MTF hospitals, ambulatory and dental services. Responses and respondents will remain anonymous. There are two versions of the survey that may be administered, corresponding to the setting in which care is delivered, either Hospital (inpatient) or Medical Office (ambulatory/outpatient/clinic setting). All responses will be collected through the use of internet-based information technology and there will be no hard copy surveys administered. Using a web-based survey will accommodate the CONUS and OCONUS survey dissemination, shorten the field period necessary for data collection and decrease the need for data cleaning since only valid responses can be entered and automatic storage of responses can occur in an electronic database.
3. Maximization of Response Rates, Non-response, and Reliability
The 40% response rate goal was estimated based upon response rates from previous survey findings. This study design will implement standard techniques to maximize response rates Potential respondents will receive a pre-notification letter followed by an email survey notification containing an embedded hyperlink to the internet location where the survey can be completed. Several reminder notifications will be sent, approximately one week to 10 days apart, so that the data collection field period will be approximately eight weeks for each Service.
To maximize response rates, the following steps will be taken:
The survey website will be beta tested at MTFs to confirm that it functions properly.
A pre-notification letter will be sent to participants detailing the purpose of the survey;
Other communication approaches will be used to familiarize staff with the survey effort and assure them of the confidentiality and anonymity of their responses, such as printed flyers, blog posts by leadership, and supporting letters from leadership.
A first survey email notification will be emailed including a hyperlink to the survey web site where they can complete the web survey,
Reminder email notification(s) will be sent with hyperlink to the survey web site, and;
A final notification will be sent with hyperlink to the survey website before the survey closes.
Response rate reports will be circulated frequently to encourage friendly competition among MTFs.
To improve respondent trust of anonymity and increase the likelihood of individual response, no individual identifiers will be used. Therefore, all follow-up survey notifications will be sent to everyone; those who have already completed the web survey will be thanked for their participation and asked to disregard additional follow-up notices.
4. Tests of Procedures
The Survey on Patient Safety Culture, hospital and medical office versions, to be used for data collection was previously developed and piloted tested by the creators, Agency for Healthcare Research and Quality (AHRQ). Pilot data on the hospital version were gathered from over 1,200 staff from 21 hospitals. After data analysis, the survey was revised and the final survey has demonstrated reliability and validity. This hospital survey has been used in previous data collections (2005, 2008, 2011, and 2015) in MHS facilities. Similarly, the medical office version was pilot tested by AHRQ across 200 medical offices and data were gathered from over 4,100 staff. Based on pilot data, the medical office version was revised and has demonstrated reliability and validity. The medical office version was utilized in the MHS within the Air Force in 2011 and 2015, and will be used again in this current survey administration.
5. Statistical Consultation and Information Analysis
Deloitte Consulting LLP, has been contracted to conduct this web survey data collection and analyze the survey feedback results. The individuals assigned to the project include:
a. Provide names and telephone number of individual(s) consulted on statistical aspects of the design.
Kimberley Marshall-Aiyelawo, PhD
Senior Health Care Research Analyst
Defense Health Agency
Decision Support Division
kimberley.a.aiyelawo.civ@mail.mil
Patrick Koeppl, PhD
Deloitte Consulting, LLP
+1.240.460.9407
Leanne Goldstein, PhD
Deloitte Consulting, LLP
+1.202.714.4609
lgoldstein@deloitte.com
b. Provide name and organization of person(s) who will actually collect and analyze the collected information.
Patrick Koeppl, PhD
Deloitte Consulting, LLP
+1.240.460.9407
pkoeppl@deloitte.com
Sarah Godby, PhD
Deloitte Consulting, LLP
+1.571.388.7511
Danielle Kogut, MSc
Deloitte Consulting, LLP
+1.415.629.8400
Marc Penz
Zogby Analytics
+1.315.534.6167
marc@zogbyanalytics.com
No other persons have consulted on statistical aspects of this survey nor will any other persons either collect or analyze the data.
Page
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Title | DoD Patient Safety Culture Survey |
| Author | Golson, Patricia, CTR, DHA |
| File Modified | 0000-00-00 |
| File Created | 2021-01-20 |