Work@Health Phase 2 SS_A

Work@Health Phase 2 SS_A.doc

CDC Work@Health Program: Phase 2 Training and Technical Assistance Evaluation

OMB: 0920-1006

⚠️ Notice: This form may be outdated. More recent filings and information on OMB 0920-1006 can be found here:

2016-01-11 - Revision of a currently approved collection

Document [doc]

Download: doc | pdf

CDC Work@Health™ Program:

Phase 2 Training and Technical Assistance Evaluation

New

Supporting Statement: Part A

Program official/project officer: Jason Lang, MPH, MS

Team Lead, Workplace Health Programs

(CDC/NCCDPHP/DPH)

Tel: (770) 488-5597

Fax: (770) 488-5962

Email: jlang@cdc.gov

November 25, 2013

Table of Contents

Section A

A-1 Circumstances Making the Collection of Information Necessary

A-2 Purpose and Use of the Information Collection

A-3 Use of Improved Information Technology and Burden Reduction

A-4 Efforts to Identify Duplication and Use of Similar Information

A-5 Impact on Small Businesses or Other Small Entities

A-6 Consequences of Collecting the Data Less Frequently

A-7 Special Circumstances Relating to the Guidelines of 5 CFR 1320.5

A-8 Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency

A-9 Explanation of Any Payment or Gift to Respondents

A-10 Assurance of Confidentiality Provided to Respondents

A-11 Justification for Sensitive Questions

A-12 Estimate of Annualized Burden Hours and Costs

A-13 Estimates of Other Total Annual Cost Burden to Respondents or Record Keepers

A-14 Annualized Cost to the Government

A-15 Explanation for Program Changes or Adjustments

A-16 Plans for Tabulation and Publication and Project Time Schedule

A-17 Reason(s) Display of OMB Expiration is Inappropriate

A-18 Exceptions to Certification for Paperwork Reduction Act Submissions

Attachments

Attachment A-1. Authorizing Legislation, Public Health Service Act

Attachment A-2. Funding Authority - Patient Protection and Affordable Care Act Prevention and Public Health Fund (P.L. 111-148, Section 4002)

Attachment A-3. Public Health Service Act, Research and Investigations Generally

Attachment B-1. Federal Register Notice – 60 Day

Attachment B-2. Summary of Public Comments

Attachment C. Work@Health™ Program Objective – Survey Instrument Crosswalk

Attachment D. Work@Health™ Data Collection Flow Chart

Attachment E-1. Work@Health™ Employer Application Form

Attachment E-2. Representative Screen Shots of Work@Health^TM Employer Application Form

Attachment E-3. CDC Worksite Health Scorecard

Attachment E-4. Representative Screen Shots of CDC Worksite Health Scorecard

Attachment E-5. Work@Health™ Organizational Assessment

Attachment E-6. Representative Screen Shots of Work@Health^TM Organizational Assessment

Attachment E-7. Work@Health™ Employer Follow-up Survey

Attachment E-8. Representative Screen Shots of Work@Health^TM Employer Follow-up Survey

Attachment E-9. Work@Health™ Case Study Interviews with Senior Leadership

Attachment E-10. Work@Health™ Case Study Interviews with Employees

Attachment F-1. Work@Health™ Trainee KAB Survey

Attachment F-2. Representative Screen Shots of Work@Health^TM Trainee KAB Survey

Attachment F-3. Work@Health™ Trainee Reaction Survey Hands-on Model

Attachment F-4. Work@Health™ Trainee Reaction Survey Online Model

Attachment F-5. Representative Screen Shots of Work@Health^TM Trainee Reaction Survey Online Model

Attachment F-6. Work@Health™ Trainee Reaction Survey Blended Model

Attachment F-7. Work@Health™ Trainee Technical Assistance Survey

Attachment F-8. Representative Screen Shots of Work@Health^TM Trainee Technical Assistance Survey

Attachment F-9. Work@Health™ Case Study Interviews with Selected Trainees

Attachment F-10. Work@Health™ Trainee Focus Group Discussion Guide

Attachment G-1. Work@Health™ Train-the-Trainer Application Form

Attachment G-2. Representative Screen Shots of Work@Health^TM Train-the-Trainer Application Form

Attachment G-3. Work@Health™ Train-the-Trainer Participant Survey

Attachment G-4. Representative Screen Shots of Work@Health^TM Train-the-Trainer Participant Survey

Attachment G-5. Work@Health™ Trainee Reaction Survey Train-the- Trainer Model

Attachment G-6. Work@Health^TM Train-the-Trainer Trainee Technical Assistance Survey

Attachment G-7. Representative Screen Shots of Work@Health^TM Train-the-Trainer Trainee Technical Assistance Survey

Attachment H-1. Work@Health™ Wave 2 Trainee Reaction Survey

Attachment I. Work@Health™ Instructor/Coach Group Discussion Guide

Attachment J. Work@Health™ Employer Training FAQ

Overview

This is a new Information Collection Request (ICR) supporting establishment and evaluation of CDC’s Work@Health™ Program, a comprehensive worksite health training program which includes the development of a worksite health training curriculum and delivery of training to employers nationwide to improve the health of workers and their families. The training will include four separate training models each aimed at raising employer knowledge and skill related to effective science-based worksite health programs, policies, practices, and strategies and supporting their adoption in the worksite. CDC plans to initiate full-scale implementation and evaluation of the Work@Health™ Program in Winter/Spring 2014 (Work@Health™ Phase 2). CDC conducted a Phase 1 needs assessment, pilot training and evaluation in Fall 2013 to inform the full-scale implementation phase of Work@Health (OMB No. 0920-0989, expiration date 9/30/2014).

In this new ICR, CDC requests two year OMB approval to initiate Phase 2 data collection in Winter/Spring 2014. A combination of qualitative and quantitative data elements will be collected for analysis. The outcome evaluation will include a descriptive component as well as statistical models to determine the extent to which the program affected the target outcomes. These analyses will be supplemented with interview data collected for approximately six case studies. Employers will be recruited to participate in the Work@Health™ training and evaluation scheduled to begin in December 2013. The training models will be evaluated by assessing the participating employers’ changes in readiness to develop or enhance a worksite health program; environmental elements of the physical worksite such as facilities; aggregate employee participation in programs and community partnership activities; and elements of worksite structure, practices, and policies related to health and safety. CDC will also assess trainees’ knowledge, attitudes, and behaviors related to worksite health and their reaction to the Work@Health™ training, including their satisfaction with the training and opinions about whether it met their needs. No individual-level health data will be collected.

Section A. Justification

Circumstances Making the Collection of Information Necessary

The Centers for Disease Control and Prevention (CDC) is the primary Federal agency for protecting health and promoting quality of life through the prevention and control of disease, injury, and disability. CDC is committed to programs that reduce the health and economic consequences of the leading causes of death and disability, thereby ensuring a long, productive, healthy life for all people.

Chronic diseases, such as heart disease, stroke, cancer, obesity, and diabetes are among the most prevalent, costly and preventable of all health problems. Chronic diseases negatively affect the lives of individuals, the health care system in the U.S., and productivity in the worksite. The use of effective worksite health programs and policies can reduce health risks and improve the quality of life for American workers. Maintaining a healthier workforce can lower direct costs such as insurance premiums and worker’s compensation claims for employers. It will also positively impact many indirect costs such as absenteeism and worker productivity.^1,
2 As a result, many employers are turning to worksite health programs to help employees lower their risk of developing chronic diseases and maintain a healthy lifestyle.

Large employers are more likely to offer worksite health programs than small employers. An analysis of the 2004 National Worksite Health Promotion Survey found that small employers (i.e., those with fewer than 100 employees) were less likely to offer health promotion activities (e.g., smoking cessation programs), screenings or counseling (e.g., cancer screenings), or disease management programs (e.g., diabetes) than large employers. Small employers were also less likely to provide an environment supporting physical activity, such as an on-site fitness center or signage promoting stair use. These strategies when coordinated and implemented together form the basis for a comprehensive worksite health promotion program. Small employers are the least likely to offer comprehensive worksite health promotion programs.³

Furthermore, most published research about the effectiveness of worksite health programs is based on data collected from large employers.^4,
5 Information about the effectiveness of worksite health programs at small and mid-size companies is lacking.⁶ Small employers employ a significant number of people. Small businesses (defined as having fewer than 500 employees) make up 99.7 percent of U.S. employer firms and employ 50 percent of the working population.⁷ CDC recognizes the importance of worksite health programs at small employers and is actively working to support this population and meet the Healthy People 2020 developmental goal to increase the number of small and mid-size employers offering a health promotion program to their employees.⁸

In January 2013, the Work@Health™ Program was established by the CDC National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP). The Work@Health™ Program seeks to raise employer knowledge and skills related to effective science-based worksite health programs, policies, practices, and strategies and support their adoption in the worksite. The Work@Health™ Program is authorized through the Public Health Service Act (section 42 U.S.C. 280l-280l-1, Sections 399MM and 399MM-1; see Attachment A-1) and funded through the Patient Protection and Affordable Care Act Prevention and Public Health Fund (PPHF; P.L. 111-148, Section 4002; see Attachment A-2) which was enacted to address the underlying drivers of chronic disease and to help the country move from today’s sick-care system to a true “health care” system that encourages health and well-being. The PPHF is designed to expand and sustain the necessary infrastructure to prevent disease, detect it early, and manage conditions before they become severe. CDC is also authorized to conduct information collection by section 241 of the Public Health Service Act, Research and investigations generally (Attachment A-3).

The primary goals of Work@Health™ are to:

Increase understanding of the training needs of employers and the best way to deliver skill-based training to them.
Increase employers’ level of knowledge and awareness of worksite health program concepts and principles as well as access to tools and resources to support the design, implementation, and evaluation of effective worksite health strategies and interventions.
Increase the number of science-based worksite health programs, policies, and practices in place at participating employers’ worksites and increase the access and opportunities for employees to participate in them.

Work@Health™ will provide employers with training in how to maximize employee engagement and participation in worksite health program offerings; raise employee awareness and education around health; and help establish a healthy work environment to address unhealthy behaviors and lifestyle choices and reduce employee risk for chronic disease and injury. The program will be developed around the use of evidenced-based best practices and will include, but not be limited to, the following worksite health topics:

The health and economic impact of worksite health programs (i.e., the business case),
Leadership and employee engagement,
Principles, strategies, and tools for assessment, planning, implementation, and evaluation,
Relevant and applicable laws, regulations, and legal requirements,
Leveraging and integrating existing and new worksite health programs, strategies, and activities,
Developing partnerships, community linkages, and peer learning networks among employers, and
Special topics of interest to employers such as the aging of the workforce.

The Work@Health™ Program will use a problem-based training approach requiring employers to complete authentic learning tasks to acquire and apply information and data about worksite health in areas such as obesity, nutrition, physical activity and their effects on job performance, current level of healthy lifestyle engagement, perceived barriers of access to healthy lifestyle activities and attitudes toward health/wellness programs. Learning tasks will require employers to construct their own responses to challenges rather than select from pre-formatted lists and to address challenges faced in the real world of their worksites. For example, when presented with a real-world worksite health problem to solve, employers will learn worksite health best practices and meet other employers in the process of developing a solution to the task.

The Work@Health™ Program training will be delivered through the following four training models:

Hands-on Model - Four regional Work@Health™ workshops will be held. A professional instructor will lead employers through lectures, skill lessons, practical demonstrations, case studies, and participant discussions aimed at increasing employer’s knowledge and skills about worksite health programs. This model will consist of 8 modules which will be covered in one full-day workshop.
Online Model – Self-paced training activities will be completed by employers working independently via the Internet. Activities include e-learning modules, Webinars, teleconferences, and/or streaming videos aimed at increasing employers’ knowledge and skills about worksite health programs. Training materials, lessons, presentations, case studies, and learning resources will be posted to a Web-based learning platform. A professional instructor will provide online coaching or mentoring. The Online Model will consist of 8 modules, which will take approximately one full day to complete.
Blended Model – Four regional Work@Health™ workshops will be held. A combination of Hands-on activities and Online learning activities will aim at increasing employers’ knowledge and skills about worksite health programs. Employers will participate in regional workshops where Hands-on training will be delivered and cohorts of employers will be organized. Following the regional workshops, employers will complete training activities via the Online model and then each cohort will meet again for a roundtable session to receive continued training and support. Employers will also participate in their cohort’s online Learning Community. The Online portion will consist of 6 modules, which will take approximately 5 hours to complete, the Hands-on portion will consist of 2 modules which will be covered in one half-day workshop.
Train-the-Trainer Model – This model is designed to prepare qualified individuals to acquire the knowledge and skills needed to train employers through Online, Hands-on or Blended models. Four regional Work@Health™ workshops will be held for employers, trainers, facilitators, and organizations that support employers (e.g., state or local health departments) interested in becoming certified trainers for the Work@Health™ Program. A professional instructor will lead trainees in online, hands-on and blended training activities to assist them in developing the knowledge and skills needed to deliver the Work@Health™ Program to other employers. Participants who demonstrate expected levels of proficiency will be awarded the title of Certified Trainer and receive a certificate of achievement that recognizes their role and levels of expertise and performance.

Following their participation in one of the four Work@Health™ training models, trainees will receive technical assistance and have the opportunity to participate in peer learning networks. The technical assistance will be led by subject matter experts and will provide services, such as online coaching, Webinars, Go-To-Meeting discussions, and instant messaging to support trainees. The peer learning networks will provide an opportunity for trainees to interact with their peers to share ideas, goals, and issues for collaborative problem-solving and program development and to share materials and templates developed during and after training for other employers to adopt or adapt in their worksites.

The primary reason for providing technical assistance to trainees is to ensure their success in building a comprehensive worksite health program. After trainees complete their initial training, they are expected to apply what they learned in their worksites to design and implement a comprehensive worksite health program. The goal of the technical assistance is to extend the trainees’ knowledge and skills and build capacity for responding to challenges, problems, and needs specific to each company’s mission and work environment. While the curricula for the training models are common to all employers and trainees, technical assistance is data-driven, customized, and responsive to the dynamic needs of the employers and their worksites.

The technical assistance will provide support to the Train-the-Trainer participants in increasing their knowledge and improving their training skills as they work to prepare for and deliver the Work@Health™ training to at least five employers. The technical assistance will include a review of a videotaped demonstration by each of the Train-the-Trainer participants delivering a brief Work@Health™ training episode. Feedback will then be given by their peers and an instructor.

CDC plans to select a group of 600 employers and other organizations (approximately 540 participants for the Hands-on, Online, and Blended models and 60 participants for the train-the-trainer model) who support employers across the country (“Work@Health™ Participants”) to participate in the full-scale Work@Health™ Program. Work@Health™ employer participants in the Hands-on, Online, and Blended models will represent small (i.e., 20-100 employees), mid-size (i.e., 101-500 employees), and large employers (i.e., over 500 employees) across industry sectors and geographic locales. Seventy-five percent of these participants will be small and mid-size employers. Work@Health™ participants in the Train-the-Trainer model will represent employers of diverse sizes and industry sectors who are interested in training other employers as well as organizations such as public health agencies, professional organizations, or trade associations who support employer worksite health efforts or have employers as members who can be trained in the Work@Health™ program.

To be eligible for participation in Work@Health™, employers must have at least 20 employees, a valid business license and have been in business for at least one year. Employers must at least have minimal worksite health program knowledge and experience as well as offer health insurance to their employees. Employers who wish to participate in Work@Health™ must agree to participate fully in program implementation (e.g., allow the training participant to participate in one of the four training models during work-hours, complete pre- and post-training assessments), and agree to become active participants in Peer Learning Networks.

The timely identification of potential employer participants will be accomplished by reaching them through large membership and association organizations representing a broad array of industries. These “gatekeeping” organizations have the existing infrastructure to reach their constituents quickly and provide credibility to Work@Health™ invitations to participate in the implementation of the Work@Health™ Program.

Priority will be given to those gatekeepers whose constituent base is located in geographic regions with high chronic disease prevalence. CDC will meet with these gatekeeper organizations, such as the Small Business Administration, to present an overview of the Work@Health™ Program and identify the best strategies, such as Webinars and conferences to reach their constituents. With support and introductions from gatekeeper organizations, CDC will reach out directly to employers to describe the Work@Health™ Program and solicit their interest in participating in the training program. CDC will reach out to employers through Webinars, conferences, and other strategies identified by the gatekeeper organizations and through regular gatekeeper communications (e.g., newsletters, e-newsletters). Employers who are interested in participating in Work@Health™ will be directed to a Website to review the eligibility criteria and complete the Employer Application Form (Attachment E-1 and E-2).

After all eligibility and inclusion factors are considered, approximately 540 selected employers will be assigned to participate in either the Hands-on model, Online model, or Blended training model in roughly equal numbers of each (n=180). Assignment of employers to one of the three training models will seek to achieve a diverse group of employers in each based on factors including geography, employer size, industry sector and worksite health program maturity. Prior to registration and enrollment, employers will be informed that they can express their preference for a model but that placement in a particular model cannot be guaranteed.

As discussed above, the Train-the-Trainer model is designed to prepare approximately 60 qualified individuals to acquire the knowledge and skills needed to train employers through Online, Hands-on or Blended models to implement the Work@Health™ curriculum. Each candidate for participation in the Train-the-Trainer model will have: 1) a referral from state or local health department, or other qualifying organization; 2) evidence of worksite health program knowledge and skills; 3) training skills and experience; and 4) experience with implementing worksite health programs.

The Work@Health™ Program will be conducted in two phases:

Phase 1: Needs assessment and pilot training evaluation of the program designed to include an employer needs assessment survey with 200 small employers and pilot training evaluations of the four training models involving 15 trainees per model needed to develop and refine a full-scale worksite health training curriculum and implementation schedule. CDC obtained OMB approval for Phase 1 formative evaluation tasks (Work @ Health Phase 1, OMB No. 0920-0989, exp. 9/30/2014). Findings have been used to inform the Phase 2 data collection.
Phase 2: Full-scale implementation of the program with 600 employers and other organizations that support employers using four distinct training models. Phase 2 will evaluate the effectiveness of the four training models by enrolling and training 600 participants. CDC may request additional changes to the Phase 2 data collection plan upon further analysis of Phase 1 findings.

The Phase 1 pilot test was conducted between October 28 and November 14, 2013 involving all four training models. Overall, the Work@Health^TM program was positively received by participants. While the overall content of the course consistently scored well with participants, respondents indicated the pace of the course was fast and that the amount of information being presented was difficult to fully process. As a result of this feedback, CDC will be streamlining the course content and moving some level of detail into the technical assistance activities that will allow the pace to slow as well as dedicate more time to participant’s check for understanding and questions. Initial findings of the Phase 1 needs assessment survey which is still being analyzed also indicated that the core principles and practices which are the focus of the course content are in line with employer needs and their current level of knowledge (majority of respondents rated these important or very important). The training curricula will not be altered in terms of specific learning objectives, modular structure, technology usage, or learning activities. Therefore, CDC does not anticipate corresponding changes to the Phase 2 training reaction surveys or KAB surveys. Retaining questions specific to the pace of the training and the level of detail in the formal training as well as questions about specific instructional concepts in the KAB survey will enable the course evaluation to understanding if the streamlining process was effective.

Based on the findings from the pilot evaluations, two significant changes to the application and evaluation forms for Phase 2 have been incorporated. The first is to reduce the minimum eligibility requirement for employer participation from 30 employees to 20 employees. This is due to the high interest from small employers to participate in the Work@Health^TM program as well as evaluation findings that the training content with respective to small employers was relevant, appropriate, and useful to them. The second change involves terminology on multiple evaluation forms. The term “workplace” has been substituted for “worksite” to avoid confusion exhibited by participants in the pilot trainings as to whether the health programs being designed and implemented by participants applied to a single worksite or multiple worksites. The term worksite is specific to a single work location whereas the term workplace can apply to multiple locations within a single organization. Since the main target audience for the Work@Health^TM program are smaller employers that are more likely to operate out of a single location, a substitution in terminology was consistently made in the Phase 2 evaluation forms (Supporting Statement B.4).

OMB approval for the Phase 2 full scale implementation is requested. Information will be collected from interested employers and other organizations to (1) select participants for the Work@Health™ training; (2) assess trainees’ reactions to the Work@Health™ training, technical assistance and peer learning networks; and (3) evaluate outcomes and the ways in which participating trainees increased their knowledge and perceived ability to implement worksite health programs, policies, and environmental support changes that will improve employee health.

A summary of program objectives as they relate to specific information collection instruments (Crosswalk) is provided in Attachment C.

CDC requests OMB approval by January 2014 in order to begin selecting employers and implementing the training beginning in winter 2014. Information will be collected over a period of two years.

Privacy Impact Assessment

Overview of Information Collection

Information will be collected from: (1) employers who indicate interest in participating in the Work@Health™ Program (2) employers who are selected for full participation in Work@Health™ (3) employees who participate in the Work@Health™ training (i.e., trainees), (4) senior leaders and employees at organizations selected for case studies who were not trainees but participate in worksite health programs that are developed as a result of their organization’s participation in training, and (5) Work@Health™ Program instructors and coaches. Information will be collected over a two-year period consisting of a one-year implementation phase and a one-year follow-up evaluation phase. During the first year, information collection will be focused on employer recruitment and enrollment into Work@Health™; organizational assessments of the status of the employer’s worksite health program; and assessments of trainees’ knowledge, attitude, and behaviors related to worksite health and wellness and skills in leading worksite health training. In the second year, information will be collected to follow-up on the progress of employer-based worksite health program interventions, document changes in trainee knowledge, attitudes, and behaviors, capture strategies for successful program implementation and sustainability, and identify barriers to efficient program implementation. The primary modes of information collection will be online surveys, paper forms and semi-structured interviews.

No individual-level health information will be collected from trainees or employees within their organizations. Employers will not be asked to report on any individual-level health indicators from their employees.

Work @Health^TM participants will be trained and supported by CDC’s implementation contractor, ASHLIN Management Group, and CDC’s evaluation contractor, RTI. In addition to RTI, Public Health Management Corporation (PHMC), ASHLIN’s evaluation sub-contractor, is also charged with the evaluation of the Work@Health™ Program. These organizations are experienced in the collection and management of personal, identifiable, and/or sensitive information.

In order to measure changes over time in employer and trainee specific assessments, data collection forms will contain employer and trainee identification information. ASHLIN, PHMC, and RTI will be the only organizations to collect, store, and maintain information that identifies specific individuals or employers. Computer data files used for analysis will identify individuals and employers using ID numbers and will not include employers’ names or contact information. ASHLIN, PHMC, and RTI have consulted with CDC information security experts to review the data acquisition, storage, and processing procedures proposed for Work@Health™.

Information collection and management will be conducted according to a plan that has been approved by CDC’s Office of the Chief Information Security Office, and will comply with the Privacy Act and required government data privacy and security procedures.

Only de-identified data will be used for program evaluation, and CDC will not attempt to identify individuals by data linkages involving demographic, geographic, or outcome information, contact individual participants, or disclose any participant-level data. A summary of program objectives as they relate to specific information collection instruments is provided as Attachment C and an outline of the timing of data collection for each instrument is presented in the Data Collection Flow Chart (Attachment D).

Items of Information to be Collected

At the organizational (employer) level for participating employers, CDC will assess: 1) readiness to develop or enhance a worksite health program; 2) environmental elements of the physical worksite such as facilities; 3) rates of employee participation in programs and community partnership activities; 4) elements of worksite structure, practices, and policies related to health and safety; and 5) the impact of the training on the worksite through the development of case studies.

At the trainee level CDC will assess: 1) the knowledge, attitudes, and behaviors related to worksite health of trainees participating in the Work@Health™ Program; 2) trainees’ reactions to the Work@Health™ training, including their satisfaction with the training and perceived utility of the training; and 3) their involvement in and the impact of technical assistance and peer learning networks.

At the instructor and coach level, CDC will assess opinions about the successes and challenges of implementing the Work@Health™ training.

Respondents and their respective data collection assessments are categorized as follows:

A. Interested Employers. Includes employers who wish to be considered for inclusion in the Work@Health™ Program as Program Participants; these data represent organizational entities (employers), not individuals. A senior leader from each employer who has indicated that their organization meets the program eligibility requirements will be asked to complete an online Employer Application Form (Attachment E-1 and E-2). This form will collect information from interested employers related to the eligibility criteria, employer characteristics (e.g., number of employees, type of industry), and status of their worksite health program.

B. Selected Employers. CDC will select 540 employers to participate in Work@Health™ trainings. As described above, the selection process will take into consideration the size of the employer as well as the need for geographic and industry sector diversity. Information to be collected from the selected employers includes the CDC Worksite Health Scorecard, Organizational Assessment, Case Studies, and the Employer Follow-up Survey. Each of these instruments is described in more detail below.

The CDC Worksite Health Scorecard (Attachment E-3 and E-4) will collect information from the 540 employers selected to participate in Work@Health™ to assess the extent to which employers have implemented evidenced-based health promotion interventions in their worksites and identify gaps in their health promotion activities.

The Organizational Assessment (Attachment E-5 and E-6) will collect information from the 540 employers selected to participate in Work@Health™ to assess changes in environmental elements of the physical worksite such as facilities and settings where employees work, as well as access to opportunities and resources for health promotion in the surrounding community.

The Employer Follow-up Survey (Attachment E-7 and E-8) will be used to collect information from the 540 employers who participated in the Work@Health™ Program to assess maintenance and sustainability of worksite health and wellness programs, policies, and environmental changes.

The Evaluation Team will conduct a series of interviews with senior leaders, employees, and trainees to develop Case Studies. The interviews will take place during site visits and by telephone between approximately March and June of 2015. From the worksites selected for the employer level case studies, a senior leader will be invited to discuss his or her experience with the program, using the Case Study Interviews with Senior Leadership discussion guide (Attachment E-9). These discussions will focus on the extent to which the program met their expectations, challenges to and strategies for successful program implementation, and plans for sustainability. The evaluation team will also conduct interviews with one to two employees (who were not trainees of the Work@Health™ Program) from case study sites who participated in worksite-based health promotion activities developed as a result of the applied knowledge gained through the training, using the Case Study Interviews with Employees discussion guide (Attachment E-10). These discussions will focus on the employees’ expectations for healthy changes, perceptions of changes in the worksite’s physical and social environment, their own experiences with healthy options, and plans for continued healthy behaviors. No personally identifiable information will be collected in these interviews. Data stored from these interviews will not contain names or other personal identifiers. The employer organization will be identified by ID number.

C. Trainee Participants. Each of the 540 employers selected to participate in Work@Health™ will assign a maximum of two employees to participate in the Work@Health™ training. These 1,080 trainee participants will participate in either the Hands-On, Online, or Blended Training Model. The instruments used to collect data from the trainees include a Trainee KAB Survey, Trainee Reaction Survey, Trainee Technical Assistance Survey, a Trainee Focus Group guide, and Case Study Interview guides for selected trainees. Each of these instruments is described in more detail below.

The Trainee KAB Survey (Attachment F-1 and F-2) will collect information from the 1,080 Work@Health™ trainee participants to assess changes in trainees’ knowledge, awareness, skill, and behavior related to implementing worksite health programs.

The Trainee Reaction Survey includes a Trainee Reaction Survey for the Hands-on model (Attachment F-3), the Online model (Attachment F-4 and F-5), and the Blended model (Attachment F-6). The Reaction Surveys will assess trainees’ reactions to the Work@Health™ training including their satisfaction with the training they received, whether the training was engaging, whether the facilitator, materials, and activities supported the goals of the training, whether the training met their needs, and their confidence in implementing or enhancing a health and wellness program at their place of employment. The trainees participating in either the Hands-on or Blended model will complete a paper and pencil survey at the end of the last in-person session. Trainees will be asked to seal their completed surveys in an envelope provided for the purpose to assure them that the facilitators will not see their answers. The trainees participating in the Online model will complete the trainee reaction survey online.

The Web-based Trainee Technical Assistance Survey (Attachment F-7 and F-8) will be conducted to capture how much trainees have used the technical assistance and their perceptions about the utility of the technical assistance they received through the course of the program. Trainees will be asked to assess how useful different aspects of the technical assistance (e.g., topical Webinars, interactive discussions with peers and facilitators) were to their ability to transfer what they learned to their worksites.

From the worksites selected for the case studies, the individuals who participated in the training program will be invited to discuss their experiences, using the Case Study Interviews with Selected Trainees discussion guide (Attachment F-9). These discussions will focus on trainees’ expectations for the program, their experiences in the training and trying to implement what they learned, their perceptions of the outcomes, and sustainability of the changes.

The Evaluation Team will observe two Hands-on training sessions and two Blended model in-person sessions. Evaluators will convene a focus group of trainees immediately following these sessions. The discussion will be guided by the questions in the Trainee Focus Group Discussion Guide (Attachment F-10).The purpose of the focus group will be to gather in-depth information from trainees about their perceptions of the training; content they expect to be useful; effectiveness of the instructor; the pace of the session; areas for additional technical assistance; and plans for participating in future technical assistance activities.

D. Interested Train-the-Trainer Participants. Individuals interested in participating in the Train-the-Trainer model of the Work@Health™ Program will be asked to complete a Train-the-Trainer Application Form (Attachment G-1 and G-2). The online form will be used to assess applicants’ background experience in worksite health programs and training facilitation.

E. Selected Train-the-Trainer Participants. CDC will select 60 qualified employers, trainers, and facilitators to participate in the Train-the-Trainer model of the Work@Health™ Program. Information to be collected from the selected Train-the-Trainer participants includes a Train-the-Trainer Participant Survey, Train-the-Trainer Reaction Survey, and Train-the-Trainer Technical Assistance Survey. Each of these instruments is described in more detail below.

The Train-the-Trainer Participant Survey (Attachment G-3 and G-4) will collect information from the 60 Train-the-Trainer participants to assess changes in trainees’ facilitation skills and ability to train others using the Work@Health™ curriculum. The Trainee Reaction Survey – Train-the-Train Model (Attachment G-5) will assess trainees’ reaction to the Work@Health™ training including their satisfaction with the training they received, whether the training was engaging and whether the facilitator, materials, and activities supported the goals of the training, whether the training met their needs, and their confidence in training others in the Work@Health™ Program

Train-the-Trainer participants will complete the Trainee Technical Assistance Survey (Attachment G-6 and G-7) to capture how much trainees have used the technical assistance and their perceptions about the utility of the technical assistance they received through the course of the program. Trainees will be asked to assess how useful different aspects of the technical assistance (e.g., topical Webinars, interactive discussions with peers and facilitators) were to their ability to transfer what they learned to their worksites.

F. Trainee Participants Wave 2. Each participant who completes the Train-the-Trainer curriculum (i.e., certified trainers) will be required to conduct the Work@Health™ training with five employer representatives known as Wave 2 Trainee participants. CDC will collect information from these 300 employer representatives (60 Train-the-Trainer participants * 5 employers per Train-the-Trainer participant) through the Wave 2 Trainee Reaction Survey (Attachment H-1) to assess their satisfaction with the training they received, whether the training was engaging, whether the facilitator, materials, and activities supported the goals of the training, whether the training met their needs, and their confidence in implementing or enhancing a health and wellness program at their place of employment..

G. Training Instructor and Coach Group Discussions (Attachment I) The Evaluation Team will gather information from training instructors and online coaches about their perceptions of the training, challenges trainees experienced, areas of high and low participation, and suggested improvements. The focus group discussions will take place by telephone.

Identification of Website(s) and Website Content Direct at Children Under 13 Years of Age

No information collection involves children less than 13 years of age. The following instruments will be administered via a Web-based survey: CDC Worksite Health Scorecard, Organizational Assessment, Employer Follow-up Survey, Trainee KAB Survey, Trainee Reaction Survey Online Model, , Train-the-Trainer Participant Survey, and Trainee Technical Assistance Surveys.

2. Purpose and Use of the Information Collection

CDC, through its program implementation and evaluation contractors, will conduct assessments throughout the program to 1) select participating employers, 2) document processes and outcomes of the Work@Health™ Program, and 3) set the parameters for future worksite health cooperative agreements or contracts. The collection of these data is necessary for the successful planning, implementation, and evaluation of the core worksite health interventions.

The lessons learned from this project may be of interest to several other ongoing activities including:

a. Provide feedback and support the implementation efforts of employers participating in the Work@Health™ Program and the CDC National Healthy Worksite Program.

i. Improve technical assistance given to participating employers in both programs.

ii. Identify effective and efficient ways to deliver worksite health training to employers with limited time, capacity, and competing priorities.

b. Inform future program efforts at CDC and other Federal agencies such as:

i. CDC will use this information to refine key success elements and best practices in worksite health training to operationalize future surveillance activities in framing potential questions that represent important elements of effective program training. These data would provide information on employer worksite health promotion training practices and gaps. CDC will also use the information gained and described from the Work@Health™ Program to produce case studies and success stories to provide greater technical assistance to employers seeking guidance on building or maintaining worksite health promotion programs.

c. Provide models for replication through the development of tools, resources, and guidance.

i. CDC will develop tools, resources, and guidance to support broader worksite health efforts.

ii. Employers will be able to utilize the public domain curricula, training materials and aides for their own worksite health program planning, implementation, and evaluation efforts.

3. Use of Improved Information Technology and Burden Reduction

CDC designed this information collection to minimize the burden to respondents and to the government, to maximize convenience and flexibility, maximize employer participation and engagement, and to ensure the quality and utility of the information collected. The primary method of data collection will be conducted online to maximize convenience to respondents. Paper-based surveys will be used for the Trainee Reaction Surveys for the Hands-on, Blended and Train-the-Trainer models including Wave 2 because trainings will be held in a variety of settings that may not provide ready access to an online survey. In addition, trainees in these models will be present at the time of survey administration making a paper and pencil version practical and efficient.

4. Efforts to Identify Duplication and Use Similar Information

The Work@Health™ Program is a new initiative with new requirements to evaluate training on implementing and/or improving worksite health programs. An extensive review of the literature indicates that there is no publicly available information that would allow CDC to understand small employers’ needs for worksite health policy training specifically and give CDC the information needed to evaluate these training programs for employers.

The data collection instruments for this ICR were derived in part from information available from the broader field including the HHS Office of Disease Prevention and Health Promotion National Survey of Worksite Health Promotion Programs (OMB No. 0937-0149, exp. 7/31/1986), the HHS/DOL Wellness Programs Study (OMB No. 0990-0387, exp. 1/31/2015) which did not evaluate worksite health trainings and focused on larger sized employers, and prior CDC work including capacity building and training components of the National Healthy Worksite Program (OMB No. 0920-0965, exp. 5/31/2016) and the development of organizational worksite health assessment tools, such as the CDC Worksite Health Scorecard. The program team carefully considered the content, need, and structure of the questions so that they are brief, easy to use, understandable, and relevant to the program objectives.

5. Impact on Small Businesses or Other Small Entities

The Work@Health™ Program is open to employers with at least 20 employees. Approximately 75% of participating employers will be small (20-100 employees) and mid-size employers (101-500 employees).

Since the program is voluntary and the employer indicates their desire to participate by acknowledging an understanding of the eligibility criteria by completing the Employer and Train-the-Trainer Application Forms (Attachment E-1 and E-2 and Attachment G-1 and G-2), the impact of the data collection on respondents – including small employers – is expected to be minimal.

6. Consequences of Collecting the Data Less Frequently

Information collection will take place for approximately 20 months (December 2013 – July 2015) during the employer selection phase, pre- and post-program implementation phase, and program evaluation phase. Pre- and post-assessments are required to characterize changes resulting from program training efforts. Less frequent reporting would not allow CDC to evaluate the following program goals:

Increase employers’ level of knowledge and awareness of worksite health program concepts and principles as well as tools and resources to support the design, implementation, and evaluation of effective worksite health strategies and interventions.
Increase understanding of the training needs of employers and the best ways to deliver skill-based training to them.
Increase the number of science-based worksite health programs, policies, and practices in place at participating employers’ worksites and increase the access and opportunities for employees to participate in them.

If information is collected less frequently, CDC will not be able to effectively conduct the planning, implementation, and evaluation activities required to meet the program objectives and document outcomes. If the worksite health training program is not planned, implemented and evaluated effectively, the program will be ineffective and could potentially be harmful to the reputation of NCCDPHP, and undermine efforts to encourage employers to participate in future CDC programs.

7. Special Circumstances Relating to the Guidelines of 5 CFR 1320.5

This request fully complies with the regulation 5 CFR 1320.5.

8. Comments in Response to the Federal Register Notice and Efforts to Consult Outside of the Agency

A. Federal Register Notice. A 60-day Notice was published in the Federal Register on July 24, 2013 (Volume 78, Number 142, pages 44564-44566; see Attachment B-1). CDC received two public comments and provided courtesy replies (Attachment B-2). One supportive comment emphasized the importance of relying upon qualified providers to deliver the Work@Health^TM program which CDC agrees with and has incorporated more explicitly into the qualification and selection process for Work@Health^TM instructors/coaches as well as train-the-trainer model applicants (Attachment G-1 and G-2).

B. CDC developed the data collection plan in collaboration with subject matter experts at CDC, ASHLIN Management Group, the Public Health Management Corporation, Accenture, and RTI International. CDC also discussed the Work@Health™ Program and proposed data collection with a broad variety of colleagues that are members of the CDC National Center for Chronic Disease Prevention and Health Promotion Worksite Workgroup. CDC also pre-tested the survey materials for clarity, organization, and timing with a group of external employers (n=4) who would represent the target audience of the full scale Work@Health™ training, and healthcare providers with experience in training (n=3).

Table 8-a. Staff within the Agency and Consultants outside the Agency Consulting on Data Collection Plan and Instrument Development

Staff from CDC

Jason Lang

Team Lead, Workplace Health Programs

CDC/ONDIEH/NCCDPHP

Phone: (770) 488-5597

Email: jlang@cdc.gov

Toye Williams

Division of Population Health

CDC/ONDIEH/NCCDPHP (Carter Consulting)

Phone: (678) 977-9338

Email: TMWilliams2@cdc.gov

Implementation and Evaluation Contractors

Linda Botts

ASHLIN Management Group

Phone: (301) 345-8357

Email: lbotts@ashlininc.com

Calvin Johnson

ASHLIN Management Group

Phone: (301) 345-8357

Email: cjohnson@ashlininc.com

Kristin Minot