ATUS Eating and Health Module 2022-2023 Cognitive Interviewing Protocol
Introduction
Hello, my name is ______________ and I work the Bureau of Labor Statistics. Thank you for taking the time to talk with me today. I’m joined by my colleague __________ today.
We are going to be working with some questions that might be asked as part of the American Time Use Survey, which is an ongoing national survey that provides information about how Americans spend their time. This survey first asks how you spent your time in the previous 24 hours. After these questions, some questions about eating, drinking and health.
Before new survey questions are asked, it’s important to test them out with people like you, to make sure that they make sense and are easy to follow. Your answers will help us improve the questions. There are no right or wrong answers; we’re looking for your reactions and honest feedback. Your name will not be included in the report, and nothing that you say will be attributed directly to you.
We are not here to evaluate you, we are looking to improve the questions. We are actually more interested in how easy the questions are to understand more than the information about your eating and health.
Informed Consent:
Upon beginning a remote testing session, participants will read this information or shown the following information and asked for their verbal consent prior to beginning the study:
We estimate the session will last 45 to 60 minutes. If you have any comments regarding this estimate or any other aspect of this study, send them to BLS_PRA_Public@bls.gov.
Your participation in this research project is voluntary, and you have the right to stop at any time.
The Bureau of Labor Statistics is conducting this voluntary study under OMB No. 1220-0141, which expires on March 31, 2021. Without this currently approved number, we could not conduct this research. Your responses are also protected by law:
The Bureau of Labor Statistics, its employees, agents, and partner statistical agencies, will use the information you provide for statistical purposes only and will hold the information in confidence to the full extent permitted by law. In accordance with the Confidential Information Protection and Statistical Efficiency Act (44 U.S.C. 3572) and other applicable Federal laws, your responses will not be disclosed in identifiable form without your informed consent. Per the Federal Cybersecurity Enhancement Act of 2015, Federal information systems are protected from malicious activities through cybersecurity screening of transmitted data.
In accordance with the Privacy Act of 1974 as amended (5 U.S.C. 552a), this study is being conducted by the U.S. Department of Labor, Bureau of Labor Statistics (BLS), under the authority of 29 U.S.C. 2. Your voluntary participation is important to the success of this study and will enable the BLS to better understand the behavioral and psychological processes of individuals, as they reflect on the accuracy of BLS information collections. The information will only be used by and disclosed to BLS personnel and contractors who need the information for activities related to improving BLS information collection. Information on routine uses can be found in the system of records notice, DOL/BLS – 14, BLS Behavioral Science Research Laboratory Project Files (81 FR 47418).
Do you have any questions before we proceed?
Do you agree to participate?
Questionnaire completion:
If screen sharing the survey:
I will share my screen, which has the copy of the survey. (Verify screen sharing is working/visible to participant)
As you complete the questions, please read the questions to yourself but say your answers aloud
If a question isn’t clear or you don’t understand some wording that is used, please let me know. We want these questions to be clear and easy to understand.
If there are any questions you would rather not answer, let me know.
If reading the survey/administering over the phone:
I will read the survey aloud to you, please tell me your answers.
If a question isn’t clear or you don’t understand some wording that is used, please let me know. We want these questions to be clear and easy to understand.
If there are any questions you would rather not answer, let me know.
Before we get started, I want to verify some information. Can you please confirm your age and the number of people living in your household?
Age: ___
Household size: ___
Thank you. As mentioned, the American Time Use Survey is interested in understanding how people spent their time in the previous 24-hours. So now I'd like to find out how you spent your time yesterday, <DAY & DATE>. If an activity is too personal, there's no need to mention it.
Let’s begin with yesterday, <DAY>, at 4 a.m. What were you doing?
(if sleeping) What time did you wake up yesterday?
(if not sleeping) What did you do next?
What did you do next?
How long did you spend <ACTIVITY>?
What did you do next?
How long did you spend <ACTIVITY>?
What did you do next?
How long did you spend <ACTIVITY>?
What did you do next?
How long did you spend <ACTIVITY>?
*… (Continue until the participant mentions sleep or runs through 4 a.m. of the interview day)
What time did you wake up?
(If woke up before 4 am) What did you do next?
How long did you spend <ACTIVITY>?
*…(Continue until the participant reaches 4am of the interview day)
EHM Questions
Thank you for walking me through your day. Next, I would now like to ask you some questions about eating and health. We’re interested in finding out more about how people fit meals and snacks into their schedules.
<go through entire EHM questionnaire; see Appendix A)
Debriefing section
Thanks for your answers so far. I would like to get some general feedback before we talk about some of the questions individually, so I can understand what you were thinking when you answered them.
What was your reaction to the questions overall? (if necessary, specify just the EHM questions)
Did any of those questions stand out to you for any reason?
Were there any questions in this survey that you think some people might find sensitive?
Were there any questions in this survey that you think some people might find difficult to answer?
Potential probes
What does this question mean to you?
Could you repeat the question in your own words?
What do you think this question is really asking?
How did you arrive at that answer?
Can you tell me what you were thinking when you answered this question?
For this question you answered ______. Can you tell me more about that?
What is the primary reason you shop there?
What is the primary reason you use [delivery/pick-up/in-store]?
What time period were you thinking of when you answered this question?
Can you tell me what specific days you were thinking of when you answered this question?
What purchases were you thinking of when you answered this question?
Did you have any difficulties in answering this question? Do you think other people would have difficulties answering this question?
Did you find this question personal? Do you think other people would find it personal?
EAT
What do you think this question is really asking?
What comes to mind when you think of “small meals.” How about “snacks?”
What does it mean to fit small meals and snacks into your schedule while doing something else? How do you do this?
GROSHP2
How did you come up with that answer?
To you, what does it mean to be “responsible” for the grocery shopping?
What does “usually” mean to you in this question? Did you think about a certain timeframe?
GROSHP3
For this question you answered ______. Can you tell me more about that?
(If somewhat or a lot) for what reasons do you enjoy grocery shopping?
(If not at all or a little) for what reasons do you not enjoy grocery shopping?
STORES
How did you come up with your answer?
How did you decide that _____ was where you get the majority of your groceries?
Was it easy or difficult to select only one of these options? How so?
What does “shopping in person” mean to you?
Did you only think about times when you shopped there in-person?
STREASON
For this question you answered ______. Can you tell me more about that?
Was it easy or difficult to select only one of these options? How so?
To you, what is the difference between Location and Convenience?
ONLINE1
Could you tell me what you think this question was asking in your own words?
(If more than 1 time) For this question you answered ______ number of times. Can you tell me more about how you came up with that number?
What time frame were you thinking about when you answered this question?
To you, what does “purchasing groceries online” mean? What are some examples that come to mind of online grocery shopping?
[Insert ERS definition/examples] What is your reaction to this definition? Would you change anything about it?
ONLINE2
Could you tell me what you think this question was asking in your own words?
How did you come up with that answer?
What does “usually” mean to you in this question? Did you think about a certain timeframe?
ONLINE3
For this question you answered ______. Can you tell me more about that?
Besides your answer of ____, what other reasons would you choose to purchase groceries online instead of in person?
I am going to read/show you a list of potential reasons why people might grocery shop online (display ONLINE3 response options). After you see/hear them, what are your reactions? Do any of them stand out to you?
(If needed) What other reasons not listed you can think of?
ONLINE4
For this question you answered ______. Can you tell me more about that?
Besides your answer of ____, what other reasons would you choose NOT to purchase groceries online?
I am going to read/show you a list of potential reasons why people might NOT grocery shop online (display ONLINE4 response options). After you see/hear them, what are your reactions? Do any of them stand out to you?
What other reasons not listed you can think of?
FASTFD2
(If zero) For this question you answered 0 times. Did you or someone else in your household prepare your meals?
(If more than 1 times) For this question you answered ______ number of times. Can you tell me more about how you came up with that number?
What went through your mind when you came up with that answer?
What time frame were you thinking about when you answered this question?
What foods come to mind when you hear “ready-to-eat food?”
What foods come to mind when you hear “prepared foods from a deli?”
I am going to show/read you a definition of “prepared foods from a deli”:
Prepared foods from a deli” include ready-to-eat foods from a grocery store deli department, such as rotisserie chicken, pizza, sandwiches, and salads from a salad bar. Frozen foods, including frozen meals, are not included.
What are your reactions to that definition? Are there foods that came to mind not included in the examples?
FASTFD_YEST2
For this question you answered ______. Can you tell me more about that?
(If yes), what type of food did you eat?
What time frame did you think about when answering this question?
To you, what does the term “food service provider” mean?
When you heard the term “any other type of eatery” what types of places came to mind?
When you hear the term “nonprofit food provider” what types of places come to mind?
In your opinion, would the following be included in other types of eateries?
Meals on wheels
Food pantry
Soup kitchen
School cafeteria
Any others?
Did you find this question personal? Do you think other people would find it personal?
PRPMEL2
How did you come up with that answer?
To you, what does being “responsible” for meal preparation mean?
What does “usually” mean to you in this question? Did you think about a certain timeframe?
PRPMEL3
For this question you answered ______. Can you tell me more about that?
(If somewhat or a lot) for what reasons do you enjoy doing the food preparation for your household?
(If not at all or a little) for what reasons do you not enjoy doing the food preparation for your household?
Conclusion
Thank you very much for that information. I have a few final follow-up questions for you:
Is there anything you would like to see changed or improved in the survey?
Is there anything that we have not already discussed that you would like to share?
Thank you very much for your time. We very much appreciate all of your feedback.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Modified | 0000-00-00 |
| File Created | 2021-10-15 |