Attachment 3 SED Degree History Data Collection Method, Doctorate and

Attachment 3: SED Degree History Data Collection Method

Doctorate and Dissertation Research Questions

Doctorate and Dissertation Research

Test conditions C, D and E will begin with the doctoral degree and dissertation research FOS questions first as in the current SED questionnaire.

Doctoral Degree: Q2 – Q 12

Dissertation Research Field(s): Q13 – Q20

Q1a (PHASE 1 TEST)

Introduction

The National Center for Science and Engineering (NCSES) within the National Science Foundation (NSF) designs, conducts, and sponsors surveys on science, engineering, and technology. In order to produce the best information possible, the NCSES routinely evaluates its surveys.

You have volunteered to take part in a study to improve the education questions on the NCSES’ Survey of Earned Doctorates (SED). This study is being conducted by RTI International, a not-for-profit research firm serving as the contractor on behalf of the NCSES.

This survey will ask about your educational history including any associate’s, bachelor’s, masters’, doctoral, and professional doctoral degrees you may have earned. Please answer the questions on your degrees as best as you can.

We want to understand any issues you may experience as you respond to the questions. Particularly, we want to know if the questions are clear and how easy or difficult the questions are for you to answer.

As you go through the survey, you will see some open-ended questions where we will ask you to describe how you came up with the answers to the question(s). There are no right or wrong answers. Your responses will help us improve the survey questions.

The average time to complete this survey is about 15 minutes. Actual time may vary depending on your circumstances. Your responses will be used for research purposes only and will be kept strictly confidential and safeguarded in accordance with the National Science Foundation Act of 1950, as amended, and the Privacy Act of 1974. This study is authorized by law (42 U.S.C. 1862 Section 3.a.6). The OMB control number for this study is 3145-0174.

If you agree to participate in this study, please click NEXT to begin.

Go to AGE

Q1b (PHASE 2 TEST)

Introduction

The National Center for Science and Engineering (NCSES) within the National Science Foundation (NSF) designs, conducts, and sponsors surveys on science, engineering, and technology. In order to produce the best information possible, the NCSES routinely evaluates its surveys.

You have volunteered to take part in a study to improve the education questions on the NCSES’ Survey of Earned Doctorates (SED). This study is being conducted by RTI International, a not-for-profit research firm serving as the contractor on behalf of the NCSES.

This interview will take approximately one hour to complete. During the interview we will ask you to complete a web survey asking about your education history details. As you review the survey, I’d like you to read the instructions and questions aloud and then “think aloud” as you answer each question. This may feel a little unnatural, but it will help us understand how you think about and answer each question. Here’s an example:

Question: Have you received a bachelor's degree (e.g., BA, BS, AB) or equivalent?

Answer: Well, I graduated in 2006 with Sociology and Anthropology. I had two majors for my BA.

As you go through the survey, there will be screening questions asking you to stop so the interviewer can ask you follow-up questions. Questions will be about how you arrived at your answers and how easy or difficult it was to answer the question. Throughout the interview you can help us by describing anything in the questions you find confusing or difficult to understand. In appreciation for your participation in this survey, you will receive $40 at the end of the interview.

Your interview session will be audio recorded in order to have a complete record of your comments. We plan to use the recording to improve the survey questions. Staff directly involved in this research project will have access to the recording. You may also be asked for permission to allow SED project staff to observe the interview in person.

Your responses will be used for research purposes only and will be kept strictly confidential and safeguarded in accordance with the National Science Foundation Act of 1950, as amended, and the Privacy Act of 1974. This study is authorized by law (42 U.S.C. 1862 Section 3.a.6). The OMB control number for this study is 3145-0174.

If you have any questions about the study you may contact Ms. Jamie Friedman of RTI, at 1-877-256-8167. If you have any questions about your rights as a research participant in this study, you may contact the Office of Research Protection at RTI International at 1-866-214-2043, a toll-free number.

If you agree to participate in this study and consent to be recorded for the purpose stated above, please click NEXT to begin.

Go to AGE

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

(PHASE 2 TEST) Interviewer Notes

• Note how extensively the participants views/reads the questions

• Note any difficulties the participant has viewing/reading the questions

• If participant expresses uncertainty with comprehending any question (e.g. says “I have no idea”), wait to see whether they leave the question blank or guess.

If they do not seem to know what to do, ask: If you were completing this survey on your own and I wasn’t here, what would you do? [IF NEEDED: Would you skip the question, or would you guess?]

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

DEMOGRAPHIC SECTION (PHASE 1 TEST ONLY)

AGE

What is your age?
Under 21	Go to TERM
21–34	Go to HISP
35–54	Go to HISP
55 or older	Go to HISP

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

HISP

Are you of Hispanic, Latino, or Spanish origin?
Yes, of Hispanic, Latino, or Spanish origin
No, not of Hispanic, Latino, or Spanish origin
Go to RACE

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

RACE

What is your race? Mark one or more
American Indian or Alaska Native
Asian
Black or African American
Native Hawaiian or Other Pacific Islander
White
Go to SEX

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

SEX

Are you male or female?
Male
Female
Go to Q2

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

SECTION A1 − DOCTORAL DEGREE

Q2

Do you have or are you pursuing a doctoral degree (e.g. PhD, DSc, EdD)?
Yes	Go to Q3
No	Go to Q21

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q3

Please provide the following information about your doctoral degree.
Doctorate Type (e.g. PhD, DSc, EdD):	[Drop down]
Institution Name	[Drop down]
School or College Name:	[Drop down]
City or Town:	[Text box]
State or Foreign Country:	[Drop down]
Go to Q4

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q4

Which department (or interdisciplinary committee, center, institute, etc.) of the university supervised your doctoral degree? Please use the full department name and avoid acronyms.

Go to Q5

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q5

What was the primary field of study for your doctoral degree? [If Condition A, fill: Please type the primary field of study in the search box below and choose the field name that best matches your degree field.] [If Condition B, fill: Please type the primary field of study in the text box below.]
Field Name (PHDFIELD):	Condition A: Based on text entered, field names that include the text are displayed Condition B: Text entered are auto-coded against the field names in the database
[CONDITION A] IF PHDFIELD IS MISSING, DISPLAY BELOW:
Please specify your primary field of study in the box below.
Field Name (PHDFIELDALT):	[Text box]
Go to Q6 when PHDFIELD is missing Go to Q8 when PHDFIELD is not missing

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Cognitive Test Probe QuestionS

(PHASE 1 TEST) Probe questions will be programmed as an open-ended textbox question.

(PHASE 2 TEST] Instruction page will be programmed to direct the respondent’s attention to the interviewer.

1. [If PHDFIELD is missing and PHDFIELDALT is missing] Just as a reminder, there is no right or wrong answer. Was there a particular reason why you left the field of study blank? Did you have difficulty in providing your doctorate field of study?

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q6

Now we need your help to assign a standardized education code to the primary doctoral degree field that you just reported. Please review the list below and select one broad field of study category that best fits the degree field, [Fill: PHDFIELDALT]
Agricultural, Animal, Plant, Veterinary Science and Related Fields	01
Architecture and Related Services	04
Area, Ethnic, Cultural, Gender, and Group Studies	05
Biological and Biomedical Sciences	26, 41
Business, Management, Marketing, and Related Support Services	52
Communication, Journalism, and Related Programs	09, 10
Computer and Information Sciences and Support Services	11
Construction Trades	46
Education	13
Engineering or Engineering Technologies	14, 15
English Language and Literature, Letters	23
Family and Consumer Sciences, Human Sciences	19
Foreign Languages, Literatures, and Linguistics	16
Health and Medical Professions and Related Programs	51, 60, 61
History	54
Legal Professions and Studies	22
Library Science	25
Mathematics and Statistics	27
Mechanic and Repair Technologies/Technicians	47
Military and Homeland Security Science, Technology and Leadership	28, 29, 43
Multidisciplinary and Interdisciplinary Studies, and Liberal Arts and Sciences	24, 30
Natural Resources and Conservation	03
Parks, Recreation, Leisure, Fitness, And Kinesiology	31
Personal and Culinary Service	12
Philosophy, Religious Studies, Religious Vocations, and Theology	38, 39
Physical Sciences	40, 41
Precision Production	48
Psychology	42
Public Administration and Social Service Professions	44
Social Sciences	45
Transportation and Materials Moving	49
Visual and Performing Arts	50
Other fields not listed above	99
Go to Q7

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q7

Next please select the specific field of study under: [Fill 2-digit CIP code title selected in Q6] that best describes the primary field of your doctoral degree. If this list does not describe your primary degree field, click the "Previous" button and select a different broad field of study category.
List 4-digit CIP code titles under 2-digit CIP code(s) selected in Q6	4-digit CIP
Go to Q8

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q8

Do you have a secondary field of study for your doctoral degree?
Yes	Go to Q9
No	Go to Q12

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q9

What was the secondary field of study for your doctoral degree? [If Condition A, fill: Please type the secondary field in the search box below and choose the field name that best matches that degree field.] [If Condition B, fill: Please type the secondary field of study in the search box below.]
Field Name (PHDFIELD2):	Condition A: Based on text entered, field names that include the text are displayed Condition B: Text entered are auto-coded against the field names in the database
[CONDITION A] IF PHDFIELD2 IS MISSING, DISPLAY BELOW:
Please specify the secondary field of study in the box below.
Field Name (PHDFIELDALT2):	[Text box]
Go to Q10 when PHDFIELD2 is missing Go to Q12 when PHDFIELD2 is not missing

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Cognitive Test Probe Question

2. [If PHDFIELD2 is missing and PHDFIELDALT2 is missing] How would you describe your field of study in your own words?

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q10

Now we need your help to assign a standardized education code to the secondary field of study that you just reported. Please review the list below and select one category that best fits the secondary field of study, [Fill: PHDFIELDALT2].
Display same 2-digit CIP code titles as in Q6.	2-digit CIP
Go to Q11

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q11

Next please select the specific field of study under the broad category: [Fill 2-digit CIP code title selected in Q10] that best describes the secondary field of your doctoral degree. If this broad field of study list does not describe your degree field, click the "Previous" button and select a different broad field category.
List 4-digit CIP code titles under 2-digit CIP code(s) selected in Q10	4-digit CIP
Go to Q12

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Cognitive Test Probe Questions

3. (Phase 2 Test Only) [If R did not do read aloud while answering the survey] Please describe how you selected your answers to the field of study questions.

4. How easy or difficult was it for you to report the field of study for your research doctoral degree?

• Very easy

• Easy

• Neither easy nor difficult

• Difficult

• Very difficult

5. [If Difficult or Very difficult] What made it difficult to answer the question about your doctoral degree?

6. [If Difficult or Very difficult] How could we change the questions to make it easier to select an appropriate answer?

7. [If R was asked Q6 and Q7] Why did you decide to provide specific field of study name rather than choosing from the list of fields in the search box?

8. Are there any other issues you had regarding these field of study questions?

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q12

When did you start your doctoral degree and when was the degree awarded or when is it expected to be awarded?
Month/Year degree started:	Month:	Year:
Month/Year degree awarded or expected:	Month:	Year:
Go to Q13

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Dissertation Research field

Q13

Did you complete a dissertation for your doctoral degree?
Yes	Go to Q14
No	Go to Q21

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q14

What was the primary field of study for your dissertation research? [If Condition A, fill: Please type the primary dissertation research field in the search box below and choose the field name that best matches your research field.] [If Condition B, fill: Please type the primary dissertation research field in the text box below.] If your dissertation research was in more than one field, you can enter a secondary field in a later question.
Field Name (PHDDISS):	Condition A: Based on text entered, field names that include the text are displayed Condition B: Text entered are auto-coded against the field names in the database
[CONDITION A] IF PHDDISS IS MISSING, DISPLAY BELOW:
Please specify your primary dissertation research field in the box below.
Field Name (PHDDISSALT):	[Text box]
Go to Q15 when PHDDISS is missing Go to Q17 when PHDDISS is not missing

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Cognitive Test Probe Questions

9. [If PHDDISS is missing and PHDDISSALT is missing] How would you describe your field of dissertation research in your own words?

10. Please describe how you selected your answers to the field of research questions.

11. How easy or difficult was it for you to report the field of your dissertation research?

• Very easy

• Easy

• Neither easy nor difficult

• Difficult

• Very difficult

12. [If Difficult or Very difficult] What made it difficult to select an appropriate answer?

13. [If Difficult or Very difficult] How could we change the questions to make it easier to select an appropriate answer?

14. What factors did you consider in reporting the field of study for your dissertation research?

15. [If R was asked Q6 and Q7] Why did you decide to provide specific field of study name rather than choosing from the list of fields in the search box?

16. Are there any other issues you would like to raise regarding these field of dissertation research questions?

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q15

Now we need your help to assign a standardized education code to the primary field of dissertation research that you just reported. Please review the list below and select one category that best fits your primary research field, [Fill: PHDDISSALT].
Display same 2-digit CIP code titles as in Q6	2-digit CIP
Go to Q16

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q16

Next please select the specific field of dissertation research under: [Fill 2-digit CIP code title selected in Q15] that best describes your primary research field. If this list does not describe your primary dissertation research field, click the "Previous" button and select a different broad field category.
List 4-digit CIP code titles under 2-digit CIP code(s) selected in Q15	4-digit CIP
Go to Q17

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q17

Do you have a secondary field of study for your dissertation research?
Yes	Go to Q18
No	Go to Q21

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q18

What was the secondary field of study for your dissertation research? [If Condition A, fill: Please type the secondary dissertation research field in the search box below and choose the field name that best matches your research field.] [If Condition B, fill: Please type the secondary dissertation research field in the text box below.]
Field Name (PHDDISS2):	Condition A: Based on text entered, field names that include the text are displayed Condition B: Text entered are auto-coded against the field names in the database
[CONDITION A] IF PHDDISS2 IS MISSING, DISPLAY BELOW:
Please specify the secondary field of research in the box below.
Field Name (PHDDISS2ALT):	[Text box]
Go to Q19 when PHDDISS2 is missing Go to Q21 when PHDDISS2 is not missing

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q19

Please review the list below and select one broad field category that best fits your secondary field of dissertation research.
Display same 2-digit CIP code titles as in Q6	2-digit CIP
Go to Q20

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

Q20

Next please select the specific field of study under: [Fill 2-digit CIP code title selected in Q19] that best describes your secondary research field. If this list does not describe your major field of study, click the "Previous" button and select a different broad field of study category.
List 4-digit CIP code titles under 2-digit CIP code(s) selected in Q19	4-digit CIP
Go to Q21

|-----------------------------------------------------NEXT SCREEN----------------------------------------------------------------|

[PHASE 1 TEST ONLY]

TERM (If AGE = Under 21)

Thank you for completing the screening survey, but you are not eligible to participate in this study.

EXIT

12