Attachment J
NTEWS Alternative Question Testing_Protocol
Round 2 & 3 Alternative Questions
Face-to-face Interview Protocols
NOTE: Only administer this protocol in a face-to-face interview and if there is sufficient time and the end of the interview.
RESEARCH QUESTIONS:
Do respondents understand and answer the alternative question correctly?
How do the alternative questions perform compared to the NTEWS versions? Is it the same, better, or worse?
MATERIALS:
Two copies of each alternative question
Alternative question testing Protocol
The NTEWS questionnaire the respondent filled out
GENERAL PROBING:
In your own words, what do you think this question is asking?
If I were not here, how would you answer this question?
You mentioned _______. Can you tell me more about that?
How did you come up with your answer?
What were you including in that answer? What were you excluding?
Alternative Question: Principal Job Title
NOTE: This question is an alternative way of collecting the same information in Question 12 of the NTEWS questionnaire.
General Observations and Probing:
Note any problems with any question/response options/response.
Note if respondents seem to read the examples. Are they helpful or problematic?
Note whether respondents follow the skip pattern(s).
All specified probes should be asked of all respondents.
In general, probe this question retrospectively, unless the respondent is stuck.
Use general probes and any necessary follow-ups as needed.
I would like to show you a different way we could ask about work. I would like you to read and answer this question, and then I will ask you about it.
(Hand the respondent the alternative version of main job question:
What was the title of your principal job?
Example: Financial Analyst
__________________________ [Blank space for respondent’s answer]
Have them read and answer it.)
Observe:
Any differences in response to the two questions.
Probes:
In your own words, what do you think this question was asking?
How did you come up with your answer?
Thinking about this question and the question about your main job (point out question again), are these questions different or the same to you? Can you tell me about what makes them (the same/different)?
Do you have a preference for one question over the other or no preference? Can you tell me about that?
Alternative Question: Principal Employer
NOTE: This question is an alternative way of collecting the same information in Question 17 and Question 19 of the NTEWS questionnaire.
General Observations and Probing:
Note any problems with any question/response options/response.
Note if respondents seem to read the examples. Are they helpful or problematic?
Note whether respondents follow the skip pattern(s).
All specified probes should be asked of all respondents.
In general, probe this question retrospectively, unless the respondent is stuck.
Use general probes and any necessary follow-ups as needed.
I also would like to show you a different way we could ask about your job. I would like you to read and answer this question and then I will ask you about it.
(Hand respondent the alternative version of combined employer question:
Which one of the following best describes your principal employer? Were you
Mark one answer.
SELF-EMPLOYED or a BUSINESS OWNER
__in a non-incorporated business, professional practice, or farm
__in an incorporated business, professional practice, or farm
PRIVATE SECTOR employee
__in a for-profit company or organization
__in a non-profit organization (including tax-exempt and charitable organizations)
GOVERNMENT employee
__in a local government (e.g., city, county, school district)
__in a state government (including state colleges/ universities)
__in the U.S. military service, active duty, or Commissioned Corps (e.g., USPHS, NOAA)
__in the U.S. Federal Government (e.g., civilian employee)
__ANOTHER type of employer
Specify other type of employer:______________
Have them read and answer it.)
Observe:
How respondent answers this question.
Any difficulties with selecting the correct response option
Probes:
In your own words, what do you think this question was asking?
How did you come up with your answer?
(Probe any difficulties with the response options.)
Thinking about this question and the question about your employer (point out question again), are these questions different or the same to you? Can you tell me about what makes them (the same/different)?
Do you have a preference for one question over the other or no preference? Can you tell me about that?
NTEWS Alternative Question Testing_Protocol
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Beck, Jennifer L |
File Modified | 0000-00-00 |
File Created | 2021-01-13 |