ICDI FRN_Section B_Supporting Statement_Clean

Supporting Statement

President’s Council on Fitness, Sports & Nutrition

U. S. Department Health and Human Services

I Can Do It, You Can Do It! Program Evaluation

I Can Do It, You Can Do It! Program Evaluation

B. STATISTICAL METHODS

1. Respondent Universe and Sampling Methods

The sample will be a non-representative sample of children and adults with a wide range of physical, sensory, intellectual, and/or behavioral health disability. Results from the study will not be used to generalize to the universe of children and adults with a disability in the United States. Therefore, sample size and power are of secondary importance. No prediction that necessitates a requisite amount of power is being made.

2. Procedures for the Collection of Information

Sites will be recruited for the ICDI Evaluation in Summer 2018, by the HHS Office of the President’s Council on Sports, Fitness & Nutrition and the Office on Women’s Health using a variety of marketing and promotional efforts including blogs, newsletters, social media messages, and others. Any school or community-based organization who meets the following requirements is eligible to participate in the ICDI Evaluation:

• Ability to establish and manage a health promotion program for children and/or adults with disabilities that uses the three ICDI Core Tenets.

• Ability to plan and execute two program waves of at least ten weeks each with no less than 8 weeks of goal-based activities and communication with the Vantage Support Team member.

• Ability to recruit required number (35) and distribution of (50% women/girls with a disability) participants.

• Ability to fulfill evaluation requirements (e.g., complete, administer, collect assessments, communicate with Support Team, etc.)

A. Statistical Methodology For Stratification And Sample Selection

The sample will be a convenience sample. Stratification will not be used.

B. Estimation Procedure

The estimated number of respondents completing the weekly goal-setting guide is 700 over two program implementation waves. 700 will complete the Mentee Pre-Assessment and 700 will complete the Mentee Post-Assessment. The estimated number of mentors completing the registration form and Mentor Feedback Survey is 700. The estimated number of site coordinators completing the End of Wave Feedback Survey is 10.

C. Degree of Accuracy Needed

The online survey was designed to meet the non-inferential goals of this study. The use of online surveys was selected to increase the accuracy of the data by: (a) providing increased privacy conducive to accurate and honest reporting by respondents, (b) eliminating the need for hardcopy records, (c) providing easy back-up to ensure no loss of data, and (d) reducing respondent error related to skip patterns.

Because the data will be entered directly by respondents, the only data entry errors will be on the part of the participants. Edit checks will be built into items as needed to ensure that respondents cannot give out-of-range or other inappropriate responses. Participants will be given identification numbers to enter in order to gain access to the survey, to ensure that participants do not complete the survey more than once.

Additionally, the paper-based Mentee Pre- and Post- Assessment may require the assistance of a parent/guardian/caretaker. Any errors would be on the part of the participant and the individual who assisted in completing the assessments.

D. Unusual Problems Requiring Specialized Sampling Procedures:

No unusual problems requiring specialized sampling procedures are anticipated.

E. Any use of less frequent than annual data collection to reduce burden

All questions have been limited to those considered essential to evaluate the program’s outcomes. This study is an ad hoc data collection (i.e., a one-time study), and therefore the data are collected less frequently than annually.

3. Methods to Maximize Response Rates and Deal with Nonresponse

PCFSN’s ability to gain the cooperation of site coordinators is the key to the success of this endeavor. Through an orientation and training program for site coordinators and the encouragement of mentors, PCFSN believes that the response rate will be high. All contact with participants will be within the guidelines for the protection of human subjects to avoid even the appearance of coercion of respondents. Respondents will always be reminded that they are able to not respond to one or more items or an entire survey if they choose. Contacts with site coordinators will be structured to simply remind them that they have not responded, and there is still time to do so. The study will be submitted for review by IRB once OMB approval is received. No research will be conducted until both OMB and IRB approval is received.

4. Test of Procedures or Methods to be Undertaken

PCFSN plans to thoroughly test the Mentee Pre- and Post-Assessment between July and August 2018, with a group of nine or fewer children and adults with a disability prior to data collection. The complete study protocol, including the security of the transmission of data, the receipt system and other aspects of the program will be tested internally before the start of data collection. Findings of the pre-test will be shared with OMB.

5. Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data

Data will be collected and analyzed by Vantage Human Resource Services, Inc. PCFSN designed the questions and analysis procedures.

The team leader for the Vantage contract is:

Lauren Darensbourg, 240-276-9871, Lauren.Darensbourg@hhs.gov

Additional staff on the Vantage team who contributed to the evaluation plan are:

Jennifer Shultz, 410-835-8684, jshultz@vantagehrs.com

Susan Schoenberg, 703-998-7086, sschoenberg@vantagehrs.com

Dr. Thomas Moran, 540-568-4877, morante@jmu.edu

In addition to the subject matter experts referenced above, an internal review process was conducted with HHS offices including: OWH, ODPHP, and ACL.

3