8 Debriefing Interview Questionnaire

Appendix T: Debriefing Interview Questionnaire

Household Survey questions

The Household Survey collected information about your household, including income, education, health, and work or school. The next few questions ask about your experience answering the Household Survey.

A1V1. How burdensome was the Household Survey to you?

1. Not at all burdensome

2. A little burdensome

3. Somewhat burdensome

4. Very burdensome

5. Extremely burdensome

A1V2. What did you think of the length of the Household Survey?

1. It was okay as-is

2. It was too long

A1V3. Overall, how easy or difficult were the Household Survey questions to answer?

1. Very easy

2. Somewhat easy

3. Neither easy nor difficult

4. Somewhat difficult

5. Very difficult

A2. [If “Somewhat difficult” or “Very difficult” in A1V3] Which types of questions were difficult to answer? [Checkbox question]

Select all that apply.

• Only show “[State SNAP name]” benefits if respondent reported this in the Household Survey.

• Only show “WIC benefits” if respondent reported this in the Household Survey.

• Only show “School and Education” if respondent reported any household members aged 5 to 22 in school currently or on summer break in the Household Survey.

• Only show “Number of breakfasts and lunches received from school” if respondent reported any children are in school currently or on summer break in the Household Survey.

• Only show “Number of meals and snacks received from after school or summer programs” if respondent reported any children are in those programs in the Household Survey.

• Only show “Child Care Provider” if respondent reported any children less than 5 years old in the Household Survey.

• Only show “Number of snacks and meals received from Child Care Provider” if respondent reported any children less than 5 years old in the Household Survey.

1. Food sharing groups (groups of people who purchase and prepare meals together and eat household food)

2. Demographics (for example, age, race, sex, gender)

3. School and education

4. Number of breakfasts, lunches, and/or snacks received from school, after school, and/or summer programs

5. Child care provider (for example, child care center, Head Start)

6. Number of snacks and meals received from child care provider

7. [Insert name of “State SNAP name”] benefits

8. WIC benefits

9. Where you get your food and why

10. Health (for example, smoking status, diabetes, blood pressure and cholesterol levels, height, and weight)

11. Military service

12. Mortgage or rent expenses

13. Work related activities

14. Sources of income (for example, work, savings)

15. Other, specify (for example, difficult questions about another person in the household): ________________

A3. [If item in A2 is selected then show A3; Repeat as necessary for each selection.] What made it difficult to answer the [insert answer from A2] question?

___________________________ [open-ended text field]

A4. [If respondent started but did not complete the Household Survey] We noticed that you started but were not able to finish the Household Survey. We would like to know your reason(s) for not completing the survey so that improvements can be made based on your feedback. Please provide your reason(s) for not being able to complete the survey.

___________________________ [open-ended text field]

Food Log questions

The next few questions ask about your experience reporting food and drinks in the Food Log for the [insert number of day fill] day period.

B1AV1. How burdensome was reporting food and drinks for [insert number of day fill] days?

1. Not at all burdensome

2. A little burdensome

3. Somewhat burdensome

4. Very burdensome

5. Extremely burdensome

B1AV2A. How easy or difficult was it to use each of these features in the Food Log?

[Programmer note: grid style question with very easy, somewhat easy, neither easy nor difficult, somewhat difficult, very difficult scale in columns and the row are the following]

Barcode scanner

Uploading receipts

Table of contents

Entering the survey more than once a day

B1AV2B. [If “Somewhat difficult” or “Very difficult” in B1AV2A] What made the [response option from B1AV2A] difficult to use?

___________________________ [open-ended text field]

B2. How easy or difficult was it to keep track of all the foods and drinks you got during the study so you could report them in the Food Log?

1. Very easy

2. Somewhat easy

3. Neither easy nor difficult

4. Somewhat difficult

5. Very difficult

B2A. [If “Somewhat difficult” or “Very difficult” in B2] What made it difficult to keep track of all the foods and drinks you got?

___________________________ [open-ended text field]

NEW. Please rate the following statements from strongly agree to strongly disagree:

[Programmer note: grid style question with strongly agree, agree, neither agree nor disagree, disagree, strongly disagree scale in columns and the row are the following]

NEWa. I understood which items to include in the Food Log.

NEWb. I understood which items exclude from the Food Log.

NEWa_FOLLOWUP. [If “Disagree” or “Strongly disagree” in NEWa] Which item(s) were you unsure about including in the Food Log?

___________________________ [open-ended text field]

NEWb_FOLLOWUP. [If “Disagree” or “Strongly disagree” in NEWb] Which item(s) were you unsure about excluding from the Food Log?

___________________________ [open-ended text field]

B3. [Display if any children under 14] How easy or difficult was it to do the following in the Food Log:

[Programmer note: grid style question with very easy, somewhat easy, neither easy nor difficult, somewhat difficult, very difficult scale in columns and the row are the following]

a. Keep track of the foods and drinks that children age 13 and under in your household got?

b. Record the foods and drinks that children age 13 and under in your household got?

B4a. [If “Somewhat difficult” or “Very difficult” in B3a] What made it difficult to keep track of the foods and drinks children got?

___________________________ [open-ended text field]

B4b. [If “Somewhat difficult” or “Very difficult” in B3b] What made it difficult to record the foods and drinks children got?

___________________________ [open-ended text field]

B5. [If respondent was in the seven day reporting period] You were asked to report the foods and drinks you got in the Food Log for seven days. If you only had to report the foods and drinks for four days in the study, would you have been more motivated to respond?

1. Yes, I would have been more motivated to respond for four days only.

2. No, my motivation would not have changed if fewer days were requested.

B6. As you might remember, the Food Log does not allow people to make any changes on days marked complete. During the [insert number of day fill] day period, did you ever try to go back to an earlier day to make changes on what you had reported?

1. Yes

2. No

B7. [If “Yes” to B6] When the Food Log did not allow you to go back to an earlier day to make changes, how did you handle the changes you intended to make?

1. You entered the correct information on another day.

2. You left the information entered as it is.

3. You tried to reach the study contacts for help (for example, calling the study’s help desk).

4. You did something else, specify: _________________

B8. Sometimes people cannot report all the foods and drinks they get during this study because it is too much work or they do not have enough time, or for some other reason. Which statement below best describes you? We appreciate your honesty and your answers will not change how much money you have earned from this study.

1. I did not report any food or drink items I got in the past [insert number of day fill] days.

2. I reported only a few food or drink items I got in the past [insert number of day fill] days.

3. I reported some food or drink items I got in the past [insert number of day fill] days.

4. I reported most of the food or drink items I got in the past [insert number of day fill] days.

5. I reported all of the food or drink items I got in the past [insert number of day fill] days.

6. I did not get any food or drink items in the past [insert number of day fill] days.

B9. Did you experience any of the following challenges in the Food Log? [Checkbox question]

1. Yes, there were too many questions/it was too much work to complete.

2. Yes, I did not have time to complete it.

3. Yes, I did not know how to report the weight or volume of items.

4. Yes, something else, specify: ___________________________

5. No, I did not experience any of these challenges.

B10. [If respondent started but did not complete the Food Log] We noticed that you started but were not able to finish the Food Log. We would like to know your reason(s) for not completing the Food Log so that improvements can be made based on your feedback. Please provide your reason(s) for not being able to complete the Food Log.

___________________________ [open-ended text field]

B12. [If more than one person in the household] How burdensome was completing all the tasks required in this study for your household?

1. Not at all burdensome

2. A little burdensome

3. Somewhat burdensome

4. Very burdensome

5. Extremely burdensome

Food acquisition behaviors/infrequent places shopped questions

The next few questions ask about your food shopping and any food you got for free during the study period.

C3. [If there are any children who receive school meals] Did you report any school meals during the [insert number of day fill] day reporting period?

1. Yes

2. No, I forgot to report some or all of the school meals

3. No, the [child/children] were not in school during those days because they were sick, on vacation, on school break, or another reason

C4. There are some places where people rely on getting food in addition to what they purchase at supermarkets or grocery stores. Does your household rely on getting food at any of these places? [Checkbox question]

Select all that apply.

1. Food pantry or food bank

2. Charitable or free events

3. Other place, specify: ________

C5. [If yes to any of the places in C4] How often do you go to a [insert answer from C4] to get foods and drinks?

1. More than once a week

2. Once a week

3. Once every 2 weeks

4. Once every month

5. Only a few times per year

C6. Did you go to a [insert answer from C4] during the study?

1. Yes

2. No

[Note, C5 and C6 repeat for each place reported in C4.]

C7. Sometimes people involved in a study change their typical behaviors because of being in the study. We want to know if being involved in this study changed people’s behavior from what they normally do. In general, during the [insert number of day fill] day Food Log, did you (or other household members) change the way you got food because you were taking part in this study? We appreciate your honesty and your answers will not change how much money you have earned from this study. [Checkbox question]

Select all that apply.

1. [I/we] ate out more often

2. [I/we] ate out less often

3. [I/we] did more food shopping

4. [I/we] did less food shopping

5. [I/we] bought a specific item(s) just to be able to report it

6. [I/we] avoided specific items so it wouldn’t have to be reported

7. Other changes, specify: ________________________________

8. No, [I/we] did not change how [I/we] got our food

C8. At the beginning of the study, you were told that [fill:you/your household] would earn a gift card for participating. Did that information change how much [fill:you/your household] spent during the study compared to what you normally spend on food? [Checkbox question]

Select all that apply.

1. Yes

2. No

C8a. [If C8 is Yes] Did you/your household spend more money on food or less money on food compared to what you normally spend?

1. I/my household spent more money on food

2. I/my household spent less money on food

C9. If household did not report spending money on food, display “[It seems that (you/your household) did not buy any food during the study period]”

If household reports spending money on food, display “[(You/your household) spent about (fill with total food spending reported to Food Log) on food during the study period]”

[It seems that (you/your household) did not buy any food during the study period. / (You/your household) spent about (fill with total food spending reported to Food Log) on food during the study period.]

How much [do you/does your household] USUALLY spend on food at all the different places [you/your household] could go IN A WEEK? Please include any purchases made with [SNAPNAME] or food stamp benefits, but do not include non-food items such as toilet paper, medications, or pet food.

$_______________________

Food preparation questions

The next few questions ask about the meals that your household prepared during the [insert number of day fill] day reporting period.

C10. During the [insert number of day fill] day reporting period, on how many days did (you/you or someone else in your household) prepare food for dinner or supper at home?

____________ days (Range 0-7)

[If household size >1, ask C11]

C11. During the [insert number of day fill] day reporting period, how many meals did all or most of your household sit down and eat together? This includes meals eaten away from home.

____________ meals (Range 0-30)

C12. During the [insert number of day fill] day reporting period, did any guests come to your home for meals or snacks?

1. Yes

2. No

C12A. [If “Yes” to C12] How many days last week did guests come to your home for a meal or snack?

____________ days (Range 0-7)

Household benefits questions

[This section is displayed only if any State SNAP name, WIC voucher or check, income from child support, disability income or SSI income, income from social security, pension and retirement income, or income from other sources was “Yes” in Household Survey]

The next few questions ask about your household’s income or benefits.

D1. Do you shop for food depending on when you receive income or food assistance benefits (WIC, [Insert State SNAP Name], etc.)?

1. Yes, I wait for [Insert reported benefits from household survey] to shop for food

2. No, I do not wait for [Insert reported benefits from household survey] to shop for food

D2. Did your household receive any benefits from [State SNAP name] during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D3. Did your household receive any benefits from WIC during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D4. Did {you/anyone [else] in your household} receive income from child support during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D5. Did {you/anyone [else] in your household} receive disability income or Supplemental Security Income (SSI) during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D6. Did {you/anyone [else] in your household} receive income from social security during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D7. Did {you/anyone [else] in your household} receive pensions and retirement income during the [insert number of day fill] day Food Log period?

1. Yes

2. No

D8. Did {you/anyone [else] in your household} receive income from other sources during the [insert number of day fill] day Food Log period?

1. Yes

2. No

Incentive questions

The next few questions ask about the gift card you will receive as a thank you for participating in the study.

E1. Was the gift card you were offered for completing different parts of the study important when deciding whether or not to participate in this study?

1. Yes

2. No

E2. [If Yes to E1] How was it important?

___________________________ [open-ended text field]

E3. You received $5 before the study began. Was that important when deciding whether or not to participate in this study?

1. Yes

2. No

E4. [If Yes to E3] How was it important?

___________________________ [open-ended text field]

E5. For completing the Household Survey, you received $(Insert amount). Would you say it was:

1. Very motivating

2. Somewhat motivating

3. Not at all motivating

E6. For all of the days you reported foods and drinks in the Food Log, you received $(insert amount). Would you say it was:

1. Very motivating

2. Somewhat motivating

3. Not at all motivating

[If respondent was in $5 experiment]

E7. You received $5 for each day you reported your foods and drinks. Did this amount motivate you to report your foods and drinks each day?

1. Yes

2. No

[If No to E7, skip to E10]

E8. [If Yes to E7] You received $5 for each day you reported your food and drinks. Do you think this was an appropriate amount?

1. Yes

2. No

E9. [If No to E8] What do you think would have been the appropriate amount to receive each day?

1. $6-10

2. $11-15

3. More than $15

[If respondent was in $5/$10 experiment and completed all of the days in the Food Log]

[Display for E10-E14 for these questions “For each of the first three days, you received $5 for completing the Food Log. Then, for each of the last four days, you received $10 for completing the Food Log.”]

E10. Were these instructions clear when you were completing the study?

1. Yes

2. No

E11. [If No to E10] Please describe how you understood the instructions for receiving the gift card.

___________________________ [open-ended text field]

E12. Do you think the total gift card amount for the Food Log was an appropriate amount?

1. Yes

2. No

E13. Were you more likely to participate in the first three days given the increase in the gift card in the last four days?

1. Yes

2. No

E14. Did the $10 amount in the last four days motivate you to complete the study on those days?

1. Yes

2. No

E15. [For everyone] Did the fact that the study was coming to an end motivate you to log your foods and drinks during the final days?

1. Yes

2. No

E16. [If yes to E15] Please list the reasons for wanting to complete the food and drink logging during the final days?

_________________________ [open ended text field]

Contact strategy questions

[These questions are asked If households were in the pre-notice experiment where they received an autodialer pre-notice.]

Prior to the beginning of the National Food Study, you received a phone call that mentioned you would soon receive a letter inviting you to participate in this study.

F1. Do you remember receiving this phone call?

1. Yes

2. No

F2. [If Yes to F1] Did this phone call make it more likely, or not any more likely, to check your paper mail for a letter asking you to participate in this study?

1. Yes, I checked the mail more often for this letter

2. No, I did not check the mail any more often than usual for this letter

F3. [If Yes to F1] Did this phone call make it more likely, or not any more likely, to participate in this study?

1. Yes, this phone call made it more likely for me to participate in the study

2. No, this phone call made no difference in my likelihood to participate in the study

F4. [If needed follow up via phone during the Household Survey] During the National Food Study, you received a phone call reminding you to either start or finish the Household Survey. Did you find this phone call helpful?

1. Yes

2. No

F4A. [If No to F4] Please provide the reason(s) this phone call was not helpful.

___________________________ [open-ended text field] The next few questions ask about how you were reminded to report your foods and drinks in the Food Log during the [fill number of days] day reporting period.

[Fills will display whether they received emails or text messages during the study]

F5. Do you think that the daily [insert “email” or “text message”] reminders were helpful in motivating you to complete the daily food log?

1. Yes

2. No

F6. Did you find the timing of the [insert "email" or "text message"] reminders to report the foods and drinks helpful?

1. Yes, I found the timing of the [insert "email" or "text message"] reminders helpful.

2. No, I did not find the timing of the [insert "email" or "text message"] reminders helpful.

F7. [If No to F6] What time of day would you have preferred to receive the [insert “email” or “text message”] reminding you to report the foods and drinks for the day?

_ _:_ _ am/pm

F8. Do you think that receiving a single daily reminder was the right number of reminders?

1. Yes, one was the right number of reminders

2. No, one daily reminder was too many reminders

3. No, one daily reminder was too few reminders

Completing study in another language questions

G1. Would you have wanted to complete or learn about any of the following in another language? [Checkbox question]

Select all that apply.

1. Questionnaires

2. Video training

3. Food Log

4. Frequently Asked Questions (FAQs) and help links

5. No, I did not want to complete or learn about these tasks in another language.

G2. [If any of the options selected except “No, I did not want to complete or learn about these tasks in another language.”] What language would you want to complete or learn about [Insert selected options from G1] in?

1. Spanish

2. Mandarin Chinese

3. Vietnamese

4. Russian

5. Tagalog

6. Arabic

7. Other, specify: ___________

G3. [If the PR completed any part of the Food Log in Spanish] Even though you accessed the Food Log in Spanish, food and drink items were displayed to you in English when using the text search option. How easy or difficult was it to search for food and drink items using the text search option in the Food Log?

1. Very easy

2. Somewhat easy

3. Neither easy nor difficult

4. Somewhat difficult

5. Very difficult

G4. [If the PR completed any part of the Food Log in Spanish] Even though you accessed the Food Log in Spanish, locations were displayed to you in English when using the location search. How easy or difficult was it to use the location search in the Food Log?

1. Very easy

2. Somewhat easy

3. Neither easy nor difficult

4. Somewhat difficult

5. Very difficult

Training materials questions

H1. Did you use any of the following resources to assist you in completing the study? [Checkbox question]

Select all that apply.

1. Videos

2. Frequently asked questions (FAQs)

3. Help links

4. Telephone assistance

5. Email assistance

6. Other, specify: ___________

H2. [If yes to any of the options in H1] Were/was the [insert answer from H1] helpful or not helpful for learning about and completing the study?

1. Helpful

2. Not helpful

[Note: H2 repeats for each response reported in H1]

H3. [If at least one option selected in H1] Do you have any suggestions for improving the [insert all answer from H1] for future studies?

___________________________ [open-ended text field]

Open feedback question

I1. Is there anything else you would like to share regarding your experience participating in the National Household Food Study?

___________________________ [open-ended text field]