GenIC Request - Cognitive Testing

DEPARTMENT OF HEALTH & HUMAN SERVICES Public Health Service

Centers for Disease Control and Prevention

National Center for Health Statistics

3311 Toledo Road

Hyattsville, Maryland 20782

June 3, 2016

Margo Schwab, Ph.D.

Office of Management and Budget

725 17th Street, N.W.

Washington, DC 20503

Dear Dr. Schwab:

The staff of the NCHS Center for Questionnaire Design and Evaluation Research (CQDER) (OMB No. 0920-0222, exp. 07/31/2018) plans to conduct a cognitive interviewing study to examine Traumatic Brain Injury questions developed by CDC’s National Center for Injury Prevention and Control (NCIPC).

We propose to start recruiting for volunteer participants as soon as we receive clearance and to start testing as soon as possible after that.

Background Information about Cognitive Testing of Questionnaires

The methodological design of this proposed study is consistent with the design of typical cognitive testing research. As you know, the purpose of cognitive testing is to obtain information about the processes people use to answer survey questions as well as to identify any potential problems in the questions. The analysis will be qualitative.

Proposed project: Evaluation of Traumatic Brain Injury Questions for CDC’s National Center for Injury Prevention and Control (NCIPC)

Traumatic brain injuries (TBIs) are a significant public health concern in the United States, contributing to an estimated 2.2 million Emergency Department (ED) visits, 280,000 hospitalizations, and 50,000 deaths in 2010 [1]. These numbers, however, underestimate the true public health and economic burden of TBIs in the U.S. because they are based on healthcare administrative data that only capture information on the number of ED visits, hospitalizations, and deaths identified as TBI-related [2, 3]. As a result, current national estimates do not account for TBIs treated by physicians during office visits or other outpatient settings [2], those who received care at a Federal facility (e.g., Veterans Affairs hospital), TBIs that co-occurred with more serious non-brain injuries [3, 4] or undiagnosed TBIs [5-7]. Furthermore, the current data lacks critical contextual information related to the mechanism of injury leading to TBI, such as specific activity or environmental characteristics [4, 8].

Similar gaps have been identified with respect to the calculation of national incidence estimates of sports- and recreation-related concussions among youth. In recognition of these gaps, the Institute of Medicine (IOM) recommended in its 2013 report, Sports-Related Concussions in Youth: Improving the Science, Changing the Culture, that the CDC develop a national surveillance system to capture health information on concussion in the United States [9]. While studies have reported on the incidence of TBIs in high school- and NCAA athletes [10-12], data on the incidence of such injuries in non-academic settings and for youth younger than high school-age are lacking. A system which can collect data that addresses these limitations can aid in the formulation of policies and prevention strategies related to TBIs among adults as well as youth who sustain sports- and recreation-related (SRR) TBIs. Data collected will help to guide and evaluate progress in reducing the public health burden of TBI for both adults and youth, regardless of injury mechanism.

Question Provenance

Adult Disability: These questions are consistent with the questions used in the most recent version of the survey for the Behavioral Risk Factor Surveillance System (BRFSS) [13]. The follow up questions linking the disability to a head injury were developed for this study by the CDC TBI team and retained experts.

Past 12 Months TBI: These questions were drafted by the CDC TBI team and retained experts after reviewing The Second Injury Control and Risk Survey [14].

Signs and Symptoms: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing The Second Injury Control and Risk Survey [14], The Colorado Traumatic Brain Injury Study [15], The Ohio State University TBI Identification Method [16], the Abbreviated OSU TBI-ID for BRFSS Module (version 2.1) [20]. Proxy and direct adolescent versions of questions were developed based on recent research into parent reporting and adolescent reporting of TBI [17].

SRR Initial Question: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing The Consumer Styles Survey and the National High School Sports-Related Injury Surveillance System (RIO) [21].

Military Questions: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing Health-Related Behaviors of Military Personnel [18].

Mechanism and Location: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing The Colorado Traumatic Brain Injury Study [15], The Ohio State University TBI Identification Method [16], The Consumer Styles Survey and the Abbreviated OSU TBI-ID for BRFSS Module (version 2.1) [20].

SRR cause: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing National High School Sports-Related Injury Surveillance System (RIO) [21].

SRR Specific Follow Ups: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing National High School Sports-Related Injury Surveillance System (RIO) [21].

SRR Organized Activity: These questions drafted by the CDC TBI team and retained experts for the adult interview after reviewing Abbreviated OSU TBI-ID for BRFSS Module (version 2.1) and the National High School Sports-Related Injury Surveillance System (RIO) [21].

Medical Care: These questions drafted by the CDC TBI team and retained experts for the adult interview after reviewing The Second Injury Control and Risk Survey [14], The Consumer Styles Survey and the National Health Interview Survey: Unintentional Injuries Supplement [19].

Lifetime TBI: These questions were drafted by the CDC TBI team and retained experts for the adult interview after reviewing The Colorado Traumatic Brain Injury Study [15] and the Ohio State University Traumatic Brain Injury Identification Method [16].

Adult Demographics: These questions drafted by the CDC TBI team and retained experts for the adult interview after reviewing the National Alcohol Survey, ICF International [22].

Child Proxy Demographics: These questions drafted by the CDC TBI team and retained experts for the adult interview after reviewing the National Alcohol Survey, ICF International [22].

Injury Description, Return to play, Return to school, Return to work, Still Experiencing S/S, SRR Activity Selector: These questions were drafted by the CDC TBI team and retained experts.

The Traumatic Brain Injury questions we are evaluating are included as Attachment 1. The testing procedure conforms to the cognitive interviewing techniques that have been described in CQDER’s generic OMB clearance package (No. 0920-0222, exp. 07/31/2018).

We propose to recruit 40 respondents: Adults (ages > 18) and teens (ages 12-17). The teens will be recruited in matched-pair dyads along with their parents.

Thus, we will recruit:

1. Adults (ages >18) to answer questions about their own head and neck injuries. (Adult respondent)

2. Adults (ages >18) who are parents of children ages 5-17 to answer questions about their children’s head and neck injuries. (Proxy respondent)

3. Teens (ages 12-17) to answer questions about their own head and neck injuries. (Direct respondent)

Recruitment will be carried out through a combination of a newspaper advertisement, flyers, special interests groups, and word-of-mouth. The newspaper advertisements/flyers used to recruit respondents are shown in Attachment 2a-e. The 5 minute screener used to determine eligibility of individuals responding to the newspaper advertisements/flyers is shown in Attachment 3a&b. Note that wording of the template has been approved and is contained within our umbrella package. Only project specific information has been added to the document. Recruitment advertisements are targeted at Adults and Parent/Guardian Teen pairs. Hence, for Parent/Guardian Teen pairs, initial telephone contact may be made with either the teen or the parent/guardian. Both parent/guardian and teen respondents will be screened prior to inclusion in the study. It is anticipated that as many as 72 individuals may need to be screened in order to recruit 40 participants.

Interviews averaging 60 minutes (including the completion of a Respondent Data Collection Sheet) will be conducted by CQDER staff members with English speaking respondents. Interviews will be conducted in the Questionnaire Design and Evaluation Research Laboratory as well as at off-site locations. All interviews conducted in the Questionnaire Design and Evaluation Research Laboratory will be video and audio recorded to allow researchers to review the behaviors and body language of the respondents. Interviews conducted off-site will only be audio recorded. These recordings will allow researchers to ensure the quality of their interview notes. In the rare case that a study participant initially agrees to audio recording during the telephone screening, but changes their mind and checks “no” to allowing the interview to be recorded on the informed consent document the interview will proceed without audio recording. In this case the interviewer will depend on their handwritten notes when conducting analysis. In addition, individuals who select “yes” for allowing the audio recording on the informed consent form, but “no” for retaining the recording for future research (final text before signatures on informed consent form), will be allowed to participate in the study.

After respondents have been briefed on the purpose of the study and the procedures that CQDER routinely takes to protect human subjects, respondents will be asked to read and sign an Informed Consent/Informed Assent document (Attachment 4a-c). Only project specific information has been added to the document. Adults, Parents/guardians will also be asked to fill in their demographic characteristics on the Respondent Data Collection Sheet (Attachment 5). This document is contained in our umbrella package. The burden for completion of this form is captured in the interview.

The interviewer will then ask the respondent to confirm that he/she understands the information in the Informed Consent/Informed Assent, and then state that we would like to record the interview. The recorder will be turned on once it is clear that the procedures are understood and agreed upon.

The interviewer will then orient the respondent to the cognitive interview with the following introduction:

[fill staff name] may have told you that we will be working on some questions that will eventually be added to national surveys. Before that happens, we like to test them out on a variety of people. The questions we are testing today are about head or neck injuries [your/your child] may have experienced. We are interested in your answers, but also in how you go about making them. I may also ask you questions about the questions—whether they make sense, what you think about when you hear certain words, and so on.

I will read each question to you, and I’d like you to answer as best you can. Please try to tell me what you are thinking as you figure out how to answer. Also, please tell me if:

there are words you don’t understand,

the question doesn’t make sense to you,

you could interpret it more than one way,

it seems out of order,

or if the answer you are looking for is not provided.

The more you can tell us, the more useful it will be to us as we try to develop better questions. Okay? Do you have any questions before we start? If yes, answer questions. If not, let’s get started.

After the interview, respondents will be given the thank-you letter (document contained in umbrella package) signed by the Charles J. Rothwell, Director of NCHS (Attachment 6), a copy of the informed consent document, and $40. After the cognitive interview is over, adult respondents/parents/guardians will be asked to read the Special Consent for Expanded Use of Video and Audio Recordings (Attachment 7). There will be no coercion and the respondents will be told that they can call and reverse the decision at any time if they change their minds. If respondents do sign the special consent form they will be given a copy of that as well. Teen respondents will not be asked for Special Consent.

Extreme care will be taken with all recordings and paperwork from the interviews conducted off-site. Recordings and identifying paperwork will be stored in a secured travel case until returned to NCHS, at which point they will be transferred to the usual secured locked storage cabinets.

We propose giving participants $40 incentives, which is our standard incentive. In total, for this project, the maximum respondent burden will be 46 hours. A burden table for this project is shown below:

Form Name	Number of Participants	Number of Responses/ Participant	Average hours per response	Response Burden (in hours)
Screener	72	1	5/60	6
Questionnaire	40	1	1	40

Attachments (7)

cc:

V. Buie

T. Richardson

DHHS RCO

REFERENCES

1. Centers for Disease Control and Prevention. TBI: Get the facts. 2016 04/22/2016]; Available from: http://www.cdc.gov/traumaticbraininjury/get_the_facts.html.

2. Taylor, C., et al., Comparability of national estimates for traumatic brain injury-related medical encounters. The journal of head trauma rehabilitation, 2015. 30(3): p. 150-159.

3. Coronado, V.G., et al., Trends in sports-and recreation-related traumatic brain injuries treated in US emergency departments: the National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) 2001-2012. The Journal of head trauma rehabilitation, 2015. 30(3): p. 185-197.

4. Centers for Disease Control and Prevention, Nonfatal traumatic brain injuries related to sports and recreation activities among persons aged≤ 19 years---United States, 2001--2009. MMWR: Morbidity and mortality weekly report, 2011. 60(39): p. 1337-1342.

5. McCrea, M., Unreported concussion in high school football players: implications for prevention. Clinical journal of sport medicine, 2004. 14(1): p. 13.

6. Meehan, W., et al., The prevalence of undiagnosed concussions in athletes. Clinical journal of sport medicine, 2013. 23(5): p. 339-342.

7. Voss, J.D., et al., Update on the Epidemiology of Concussion/Mild Traumatic Brain Injury. Current Pain and Headache Reports, 2015. 19(7): p. 1-8.

8. Coronado, V.G., et al., Trends in traumatic brain injury in the US and the public health response: 1995–2009. Journal of Safety Research, 2012. 43(4): p. 299-307.

9. Institute of Medicine (IOM) and National Research Council (NRC), Sports-related concussions in youth: Improving the science, changing the culture. 2014, Washington, DC: The National Academies Press.

10. Marar, M., et al., Epidemiology of Concussions Among United States High School Athletes in 20 Sports. The American Journal of Sports Medicine, 2012. 40(4): p. 747-755.

11. Gessel, L., et al., Concussions among United States high school and collegiate athletes. Journal of Athletic Training, 2007. 42(4): p. 495-503.

12. Daneshvar, D., et al., The Epidemiology of Sport-Related Concussion. Clinics in sports medicine, 2011. 30(1): p. 1-17.

13. Courtney-Long, E.A., et al., Prevalence of Disability and Disability Type Among Adults — United States, 2013. MMWR Morb Mortal Wkly Rep, 2015. 64(29): p. 777-783.

14. Centers for Disease Control and Prevention, The Second Injury Control and Risk Survey (ICARIS-2), National Center for Injury Prevention and Control, Editor. 2011, United States Department of Health and Human Services: Atlanta, GA.

15. Whiteneck, G., et al., Risk of Negative Outcomes After Traumatic Brain Injury: A Statewide Population-Based Survey. The journal of head trauma rehabilitation, 2016. 31(1): p. E43-E54.

16. Corrigan, J. and J. Bogner, Initial reliability and validity of the Ohio State University TBI Identification Method. The journal of head trauma rehabilitation, 2007. 22(6): p. 318-329.

17. Sady, M.D., C.G. Vaughan, and G.A. Gioia, Psychometric Characteristics of the Postconcussion Symptom Inventory in Children and Adolescents. Archives of Clinical Neuropsychology, 2014. 29(4): p. 348-363.

18. Barlas, F.M., et al., 2011 Health Related Behaviors Survey of Active Duty Military Personnel. 2013: Fairfax, VA.

19. National Center for Health Statistics, National Health Interview Survey, 1991: Unintentional Injuries Supplement. 1993, Inter-university Consortium for Political and Social Research: Ann Arbor, MI.

20. Centers for Disease Control and Prevention. (2007). Nonfatal traumatic brain injuries from sports and recreation activities--United States, 2001-2005. MMWR: Morbidity and mortality weekly report, 56(29), 733-737.

21. Fletcher, E. N., McKenzie, L. B., & Comstock, R. D. (2014). Epidemiologic comparison of injured high school basketball athletes reporting to emergency departments and the athletic training setting. Journal of athletic training, 49(3), 381.

22. Rehm, J., Greenfield, T. K. and Rogers, J. D. (2001) Average volume of alcohol consumption, patterns of drinking and all-cause mortality. Results from the U.S. National Alcohol Survey. American Journal of Epidemiology 153, 64-71.



7 | Page