Comments

Public Comments Received for I Can Do It, You Can Do It! Evaluation 60-Day Federal Register notice Published on October 12, 2017, vol. 82, No. 47536; pp. 47536-37 (https://www.federalregister.gov/documents/2017/10/12/2017-21983/agency-information-collection-request-60-day-public-comment-request).

Comment 1:

Feedback for Evaluation Documents

End of Wave Interview Questions:

• Add a question(s) about feedback on Toolkit Materials (how helpful, efficient, relevant?).

• Add a question(s) about what TA members can do and/or provide after the incentivized year.

Response: These questions are included in the End of Wave 1 and 2 Feedback Survey. They are not included in the End of Wave Interview to avoid duplication.

End of Wave Site Coordinator Feedback on ICDI:

• Consolidate questions that are similar to shorten the length of document.

• Make multiple choice questions with similar answers into a chart for ease of use.

• Allow Site Coordinators to view this document before the wave begins so that they can keep track of some of the data to be ready to provide in their answers at the end.

Response: Questions have been consolidated. We will consider allowing coordinators to view the questions in advance.

Mentee Focus Group Questions:

• Different levels needed for varying cognitive abilities (different wording, pictures, etc.).

Response: The focus groups have been removed from the evaluation plan.

Mentee Post Assessment:

• Instructions should be more concise.

• #6-9 can be consolidated into one questions with “check all that apply”

• #29-37 are very specific. Can it be changed to a broader nutrition question to cut down on length?

• #50 can be eliminated (redundant)

• #53-58 can be consolidated/combined

• WAY TOO LONG. This is not a realistic survey for someone to fill out with accuracy and focus. Consolidating needs to happen in order to gather efficient data.

• Different levels needed for varying cognitive abilities (different wording, pictures, etc.).

Response: Questions have been consolidated. Redundant questions have been removed. Length of the assessment has been reduced.

Mentee Pre Assessment:

• Similar comments as stated above

Response: Questions have been consolidated. Redundant questions have been removed. Length of the assessment has been reduced.

Mentor Program Feedback:

• #9&10 are redundant

Response: Length of survey has been reduced. Redundancies have been removed.

Mentor Weekly Goal Setting:

• Last 2 questions change the “No” option to “not yet”

• Add graphics/color to make it more engaging

• Add Goal writing tips to ensure well rounded SMART Goals

• Potentially add mentor logging also… to encourage participation alongside of the mentee!

Response: The purpose of this document is to set weekly goals for the mentee, not the mentor. This version of the document only includes the questions, tips, colors, and graphics will be added at a later date.

Comment 2:

Feedback on the 0990-New-60D

I Can Do It, You Can Do It Evaluation

Review of 2017 Documents

Provided By:

Brad Weiner, M. Ed., NBCT, CAPE

• 2013 National Adapted Physical Education Teacher of the Year

• Past Vice President of the National Consortium for Physical Education for Individuals with Disabilities

• Past President of the Maryland Adapted Physical Education Consortium

• Previous Executive Director of Camp Abilities Maryland, Inc.

• Chair Elect for the Society of Health and Physical Education America’s Adapted Physical Education/Activity Special Interest Group

Contact Information:

Brad.M.Weiner@gmail.com

516-606-5202

www.myphysicaleducator.com

Prior to sending all the data collection sheets out, there should be a review of each question. Two levels should be defined (Good information to have and essential question). The good information won’t be used for analysis or provide much information moving forward. The essential questions are needed for a comprehensive analysis to move the program forward. These two levels could have been sent out to reviewers.

It is recommended that the maximum time length a questionnaire, survey, or assessment should take in one sitting is 10 minutes. Answers provided after 10 minutes may not accurately reflect the thoughts and opinions of the individual. Decreased attention and cognitive exhaustion will impact the answers.

The objective should be to get the essential information needed without placing a ton of additional time and strain on the mentor and mentee as possible.

How much time does ICDI want coordinators and mentees filling out their survey?

Response: All instruments have been reviewed for redundancies. Only essential questions are included.

Focus Group Script

There is a certain level of cognitive understanding and attention span that the mentee’s require to sit and complete the questions. This may work for an individual with physical disabilities, but how will you plan to collect the data you seek for an individual demonstrating more impactful Autistic characteristics? This is really only good for adults and veterans.

I believe this focus group questionnaire is a shallow level document that is not necessary, but nice to have. It also does not take into consideration the various population (level of cognition and attention) of athletes programs will have.

Response: Focus groups have been removed from the evaluation.

Mentee Post-Assessment Form

There should be an indication at the top of the page, that this should be used for mentee’s 14 years and older. I say this based on the questions asked throughout and I do not believe children under 14 should be asked the questions on the form.

Number 4: Add Sensory Processing Difficulty

This assessment is way to long. How is ICDI going to analyze 63 questions for each participant throughout the country and effectively utilize all that data to make informed decisions? It is recommended to cut this down. This will take at least 45 minutes for someone without a disability to complete. Consider someone who has processing difficulties, physical impairments, and speech and language difficulties. You are now asking a mentee to focus and sit for up to 2 hours to complete this assessment form. After question 20, mentees will either stop or start clicking an answer to finish. This is something that should be strongly considered by the development team prior to putting it out. Sit down and read this out to one person with a disability.

Pick the 4 most essential questions from physical activity, nutrition, general information, and program evaluation. That gives you 16 questions plus the participant information.

Response: Individuals who are 18 or older will only complete this assessment. Mentees younger than 18 are required to have the assistance of a parent/caretaker. The disability groupings used are aligned with the US Census. The length has been reduced.

End of Program Wave 2 – Sit Coordinator Feedback

The first paragraph says please take a few moments, and then the tool goes on to ask 26 questions. It is recommended that the developing team time themselves reading through everything slowly and to give an accurate estimated time. It is also recommended for the team to consider what is nice to have and what information is essential.

Question 8 and 9 could be combined.

Question 10 and 11 could be combined. You don’t need to ask the yes or no question. Just ask how much of the incentive was used. If they put $0, then nothing was used. This can be said for all the questions to 18 cutting down some of the length for the tool AND time on the person completing it.

Delete question 20 or the same reasons above.

Delete the questions regarding the technical assistance because you get this and more information from the interview questions. At no time should similar questions be asked on two different forms. Both are not essential.

Response: Redundancies have been removed. The survey has been shortened in length. The cost and time-use table was reformatted. Technical Assistance is included in this survey only and not in the interview questions.

End of Program Wave 2 – Interview Questions

This is ok, but seems long.

Response: Length has been reduced.

End of Program Wave 1 – Sit Coordinator Feedback

There are 69 questions being asked. Do the developers believe that every question is essential and all the data will be analyzed and used? If all the information is essential, the group needs to consider a 5 year plan and each year focus on 2 – 3 areas for questioning. This year focus on recruitment, next year focus on materials and resources. I find it hard to believe that everything can be focused on all at once and it puts more strain on the coordinators. This is way too much!!! Coordinated planning is important.

Questions have been consolidated. Redundant questions have been removed. Length of the assessment has been reduced.

Mentee Pre-Assessment Form

There should be an indication at the top of the page, that this should be used for mentee’s 14 years and older. I say this based on the questions asked throughout and I do not believe children under 14 should be asked the questions on the form.

Number 4: Add Sensory Processing Difficulty

49 questions for a mentee is a lot. 10 – 15 should be the maximum asked of a mentee. Combine questions, delete unnecessary questions or questions that ask for similar information.

My high school special Olympic athletes who have longer attention spans and higher cognitive capabilities than any other program I’ve run would not be able to sit for this. I would also feel horrible asking them to. No assessment should take more than 10 minutes.

Individuals who are 18 or older will only complete this assessment. Mentees younger than 18 are required to have the assistance of a parent/caretaker. The disability groupings used are aligned with the US Census. The length has been reduced.

Technical Assistance Assessment

This is ok, but long. I’ve run programs where I’ve had to analyze data and know that when too much data is collected, it becomes hard to focus the data results. Data often will get thrown out for the essential data. It is beneficial for everyone to focus on the essential prior to sending out the assessments.

Response: Sites will receive only relevant portions of this assessment based on their technical assistance needs. No site will be expected to complete the full assessment.

End of Program Wave 1– Interview Questions

This is ok, but seems long.

Mentor Program Feedback

Question 5: Add Sensory Processing Difficulty

Section IV: Materials and Resources. This should be cut down. Where the resources useful, what did you like and what could be improved or was missing. There is no reason to ask so many questions. There are many nonessential questions being asked.

Over-all: Too long, should be cut down

Response: The survey has been reduced in length.