Postdoctoral Participant Survey

Appendix C. Postdoctoral Participant Survey

Guidelines for Reviewers

Note, because of the complicated skip patterns that will be programmed, the reviewer version of the survey, by necessity, requires that there be embedded among the questions notes documenting skip patterns, alternate wording of questions, and information about which respondents will receive a particular question. These programming notes appear in a small, blue, sans-serif font. Some questions also contain placeholders for text that varies depending on existing information (e.g., the start and end dates of a grant period) or a respondent’s answer to an earlier item. These placeholders appear as [BROWN CAPITALIZED TEXT] inside brackets.

The online survey will automatically incorporate skip patterns and present the appropriate text for placeholders and question wording to the respondent. Also note that boldface type is used for emphasis, while an (*) asterisk indicates that a roll-over definition is available to online respondents (see Glossary, below). Surveys will employ a variety of response structures and will be programmed to use radio buttons, checkboxes, text boxes, and drop down boxes. Examples of each are shown below.

Radio Buttons – Allow only one answer to a question. Click circle to select option. To change answer, click another button.

Are you currently employed?

	Yes
	No

Checkboxes – Allow multiple answers to a question. Click a box to select a response. Click a checked box to remove the choice.

Which of the following degrees you have completed? Check all that apply.

☐ Doctoral degree

☒ Master’s degree

☐ Post-baccalaureate certificate

☒ Bachelor's degree

Text boxes – Allows respondent to write answer to question within a box. The number inside brackets (i.e., the “2500” in [textbox, 2500]) indicates how many characters the respondent can enter into the textbox.

What is your job title and what do you do in your job? [textbox, 2500]

     

Drop down – Allows respondent to select one answer from a list of specified list of options. Respondents click on box, and then scroll to select option.

In what month and year did you complete your graduate degree?

Month: [Drop box]

Year: [Drop box]

Glossary

Foreign: When referring to individuals, ”foreign” means people who are based primarily in institutions or locations outside the U.S., regardless of their citizenship or country of origin. (In other words, “foreign” could refer to a U.S.-citizen who is primarily based at an institution outside the U.S.) When referring to places, “foreign” means countries or locations outside the 50 United States or the District of Columbia.

Institution: Typically refers to a university, college or other higher educational entity but also includes private or governmental research institutes, museums, laboratories, foundations, non-profit or for-profit businesses, or other organizations where project participants may be employed or affiliated.

Placeholders

SURVEY_DATE / NOVEMBER 15, 2015: The first day that the survey is fielded will serve as a common reference date across respondents. November 15, 2014 is currently filled as a hypothetical survey fielding date. After OMB approval, this date will be replaced with the actual field date of the survey.

PIRE/COMPARISON_PROJECT_NAME: The title of the PI’s or co-PI’s project funded by PIRE or the comparison program.

COMPARISON_PROGRAM, COMPARISON_PROGRAM_ACRONYM: The name (or acronym) of the NSF program from which a PI in the comparison group received an award. For example, NSF’s “Dynamics of Coupled Natural and Human Systems” is one of the programs from which projects in the comparison group are drawn. The program acronym is “CNH.”

ABBREVIATED_PROJECT_NAME: Because project titles are often long, a shortened name will be introduced and substituted for the full title in survey questions.

URL TO AWARD ABSTRACT: Hypertext link to the award abstract posted on nsf.gov

AWARD_START_DATE: Date when the PIRE/COMPARISON award period began, according to NSF records.

AWARD_END_DATE: Date when the PIRE/COMPARISON award period ended (if applicable), according to NSF records. If a project is still active, the SURVEY_DATE will be used as the most recent reference date for questions.

PARTICIPATION_START_DATE: Collected during the survey, the date the respondent reports first engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates begin their participation on the date when the award officially commences.

PARTICIPATION_END_DATE: Collected during the survey, the date the respondent reports last engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates continue participating on the project until its official end date.

PHD_DEGREE_DATE: Collected during the survey, the date when the postdoctoral respondent completed his/her Ph.D.

POSTDOC_START_YEAR: Collected during the survey, the date when the respondent began the postdoctoral appointment during which she/he contributed to PIRE or the COMPARISON project.

POSTDOC_END_YEAR: Collected during the survey, the date when the respondent completed (if applicable) the postdoctoral appointment during which she/he contributed to PIRE or the COMPARISON project.

Collaboration in Science and Engineering: Survey of Postdoctoral Participants in the National Science Foundation’s PIRE and [COMPARISON_PROGRAM] Programs

This survey is about your current or former participation as a postdoctoral researcher in a National Science Foundation (NSF) award, “[PIRE/COMPARISON_PROJECT_NAME].” You can view a description of this award by clicking <URL TO AWARD ABSTRACT>.

Researchers at Abt Associates, an independent research firm with over 40 years of experience in higher education, are conducting this survey as part of an evaluation of NSF’s Partnerships for International Research and Education (PIRE) program. None of the survey questions are of a sensitive nature, but you are free to skip any question you prefer not to answer.

For the survey to be useful, we need postdoctoral researchers who took part in activities funded through a PIRE award [for comparison group respondents only: or through other NSF award programs such as [COMPARISON_PROGRAM] to participate. Even if you have not participated in any international activities, we still need you to participate in this survey.

Participation is voluntary. Choosing to participate or not will have no effect on your current or future receipt of NSF funding (we will not reveal to NSF whether or not you have participated). We will protect your privacy to the extent permissible by law by separating the responses you provide from your name, contact information and other identifiers (e.g., your computer’s IP address, your institution’s name). Your survey results will be summarized along with the responses of other PIs in aggregate statistical form only. We will give NSF data from survey respondents only after we have removed personally identifiable information about you.

Questions? See the Frequently Asked Questions page <FAQs>; or contact the study director, Carter Epstein of Abt Associates Inc. (toll-free: 1-800-XXX-XXX; email: NSF_PIRE_Abt@abtassoc.com) or contact the John Tsapogas at NSF, (jtsapoga@nsf.gov). For questions about participating in this research study, contact Abt’s Institutional Review Board (XXX-XXX-XXXX; email: irb@abtassoc.com. This study’s IRB approval number is #XXXX.

OMB Clearance Number: xxxx-xxxx

Expiration Date: xx/xx/xxxx

Estimates of Burden for the Collection of Information. According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this collection is xxxx-xxxx. The time required to complete this information collection is estimated to average 25 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, and complete and review the information collected.

[CONTINUE]

MODULE A: YOUR ROLE IN THE [PIRE/COMPARISON] PROJECT

You have been listed as a current or former postdoctoral researcher on an NSF award called “[PIRE/COMPARISON_PROJECT_NAME]” by a Principal or co-Principal Investigator (PI or co-PI). PIs and co-PIs who receive an award from NSF must submit reports in which they list people affiliated with activities supported by the award. Even if you do not recognize the official name of this award, it is likely that you were affiliated in some way with this award. (You can review an abstract of this project here: [URL to award abstract])

A1. To confirm that we’ve reached the right person, we’d like to begin with a few questions about you.

Is your name [First Name, Middle Name/Initial, Last Name]?

 Yes, this is correct.

 No, my name has changed or my name is misspelled above. My name is: [textbox, 75]

 No, I’m not the person named above.

If A1= yes, AND PIRE/COMPARISON project is active, go to A2.

If A1= yes AND PIRE/COMPARISON project is no longer active, go to A3.

If A1= my name has changed or my name is misspelled above, AND PIRE/COMPARISON project is active, go to A2.

If A1= my name has changed or … misspelled, AND PIRE/COMPARISON project is no longer active, go to A3.

If A1= no, I’m not the person named above, go to Exit Screen and Flag for follow-up.

A2 is shown if the PIRE/COMPARISON project is active AND (A1 = yes OR A1= my name has changed/misspelled).

If PIRE/COMPARISON project is no longer active, respondent skips to Item A3.

A2. Are you a current or former postdoctoral researcher who has contributed to a project called “[PIRE/COMPARISON_PROJECT_NAME]”? (You can review an abstract of this project here: [URL to award abstract])

 I am currently a postdoc who has contributed to the project

 I am a former postdoc who has contributed to the project

 I have never contributed to this project.

 I have never held a postdoctoral appointment

If A2= Current, go to A5 (when did you begin your PIRE/COMPARISON postdoc?)

If A2= Former, go to A4 (when did your PIRE/COMPARISON postdoc end?)

If A2= I have never contributed to this project OR if A2= I have never held a postdoc, flag for follow-up and go to EXIT SCREEN.

A3 is shown if the PIRE/COMPARISON project is no longer active AND (A1 = yes OR A1= my name has changed/misspelled)

A3. Are you a former postdoctoral researcher who has contributed to a project called “[PIRE/COMPARISON_PROJECT_NAME]”? (You can review an abstract of this project here: [URL to award abstract])

 I am a former postdoctoral researcher who contributed to this project.

 I have never contributed to this project.

 I have never held a postdoctoral appointment

If A3=no, never contributed to project OR if A3=no, never held a postdoc, flag for follow-up and go to EXIT SCREEN.

If A3=yes, go to A4 (when did your PIRE/COMPARISON postdoc end?)

A4 is shown only if PIRE/COMPARISON postdoc has ended (A2=former or A3=Yes).

Note: For the remainder of the survey, we will refer to the “[PIRE/COMPARISON_PROJECT_NAME]” project as the “[ABBREVIATED_PROJECT_NAME] project.” We will refer to the postdoctoral appointment during which you participated in this project as your [ABBREVIATED_PROJECT NAME] postdoc – even if your postdoctoral appointment was funded by other sources.

A4. In what month and year did your postdoctoral appointment (during which you participated in the [ABBREVIATED_PROJECT NAME] project) end?

Month: <dropdown from January to December>

Year: <dropdown from 2004 to 2014>

Let [POSTDOC_END_DATE] = A4_Month, A4_Year

Note: For the remainder of the survey, we will refer to the “[PIRE/COMPARISON_PROJECT_NAME project as the “[ABBREVIATED_PROJECT NAME] project.” We will refer to the postdoctoral appointment during which you participated in this project as your [ABBREVIATED_PROJECT NAME] postdoc– even if your postdoctoral appointment was funded by other sources.

If project is active and respondent is a current postdoc: have contributed

If project is active and respondent is a former postdoc, or if project not active: contributed

A5. In what month and year did your postdoctoral appointment (during which you [have contributed/contributed] to the [ABBREVIATED_PROJECT NAME] project) begin?

Month: <dropdown from January to December>

Year: <dropdown from 2000 to 2014>

• If MONTH is selected AND YEAR is selected let [POSTDOC_START_DATE] =A5_MONTH, A5_YEAR. Go to A6.

• If MONTH is missing AND YEAR is selected, go to A5a (did you begin before or after July 1 of A5_YEAR?)

• If MONTH is missing AND YEAR is missing, let [POSTDOC_START_DATE] =“the date you began your [ABBREVIATED_PROJECT NAME] postdoctoral appointment.” Set A5_MONTH=missing and set A5_YEAR =missing. Go to A6.

• If MONTH is selected AND YEAR is missing, let [POSTDOC_START_DATE] = “the date you began your [ABBREVIATED_PROJECT NAME] postdoctoral appointment” and set internal variable A5_YEAR =missing. Go to A6.

A5a is only shown if month of PIRE/COMPARISON postdoc start date not selected, but year selected (A5_Month=missing).

A5a. Did you begin your postdoctoral appointment before or after July 1^st of [POSTDOC_START_YEAR]:

 Before July 1^st, [POSTDOC_START_YEAR]

 After July 1^st, [POSTDOC_START_YEAR]

• If A5a = before, let [POSTDOC_START_DATE] = “Winter/Spring, [A5_YEAR]” in subsequent items.

• If A5a = after, let [POSTDOC_START_DATE] = “Summer/Fall, [A5_YEAR]” in subsequent items.

• If A5a = missing, let [POSTDOC_START_DATE] =“the date you began your [ABBREVIATED_PROJECT NAME] postdoctoral appointment in [POSTDOC_START_DATE_YEAR]” in subsequent items. Set internal variable A5_MONTH = missing.

A6. The [ABBREVIATED_PROJECT NAME] project officially began in [AWARD_START_DATE]. When did you first contribute to research or educational activities associated with this project? If you are unsure of the month, please enter your best approximation. Please enter the month and year.

Month: <dropdown from January to December>

Year: <dropdown from AWARD_YEAR to 2014>

Let PARTICIPATION_START_DATE = “Month, Year” entered.

if date entered ([PARTICIPATION_START_DATE]) is earlier than [AWARD_START_DATE], display the following note: 

  Note:  You participated in activities for this project prior to its official starting date ([AWARD_START_DATE]). We recognize that activities related to a project may begin before the project’s official start date.   However, please read survey items carefully because some items may ask you to exclude activities that occurred before the project’s official start date of [AWARD_START_DATE]. 

If PIRE/COMPARISON award is still active, go to A7 (completed your contributions or still contributing to PIRE/COMPARISON?)

If PIRE/COMPARISON not active, skip to A8 (were you contributing in last month of award?)

A7 is shown only if PIRE/COMPARISON award is still active.

A7. As of [November 15, 2014], have you completed your contributions to the PIRE project? If you will be engaging in research or educational activities that are part of this project in the future, please answer “No, I am still contributing – or I will be contributing in the future—to this project”

• Yes, I have completed my contributions to this project.

• No, I am still contributing – or I will be contributing in the future—to this project.

If A7=yes, go to A9 (to get PARTICIPATION_END_DATE)

If A7=no, let PARTICIPATION_END_DATE = November 15, 2014. Go to Module B.

If A7=missing, let PARTICIPATION_END_DATE = November 15, 2014 (i.e., classified as a still-active contributor). Go to Module B.

A8 is shown only if PIRE/COMPARISON award is not active.

A8. The official award period for the [PIRE/COMPARISON] project, [ABBREVIATED_PROJECT_NAME], ended in [AWARD_END_DATE]. Were you still contributing to this project in the month that the award period ended?

 Yes

 No

If A8=yes, let PARTICIPATION_END_DATE =AWARD_END_DATE. Go to Module B.

If A8=no, go to A9 (to get PARTICIPATION_END_DATE).

If A8=missing, go to A9 (to get PARTICIPATION_END_DATE).

A8b is shown only if PIRE/COMPARISON award is not active AND IF A8=YES.

A8b.

We recognize that you may have conducted research or engaged in educational activities associated with the [ABBREVIATED_PROJECT_NAME] project after its official end date ([AWARD_END_DATE]), but please read survey items carefully because some items ask you to distinguish between activities that occurred before and activities that occurred after the official end date of [AWARD_END_DATE].

Go to Module B.

A9 is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR respondent did not contribute to PIRE/COMPARISON project in last month of award (A8=no).

A9. When did you last contribute to research or other activities associated with the [ABBREVIATED_PROJECT_NAME] project? Please enter the month and year.

Month: <dropdown from January to December>

Year: <dropdown from AWARD_START_YEAR to 2014>

LET [PARTICIPATION_END_DATE] = A9_MONTH, A9_YEAR

MODULE B: COLLABORATIONS

If still contributing to PIRE/COMPARISON project (A7=no): have you collaborated

If PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active: were you collaborating

To the best of your ability, please distinguish between activities that were associated with the [ABBREVIATED_PROJECT_NAME] project, and activities that were associated with other projects.

B1a. While conducting research for the [ABBREVIATED_PROJECT_NAME] as a postdoc, [have you collaborated/were you collaborating] with any of the following types of individuals? Select Yes or No in each row.

Row		Yes	No
A	Faculty or other senior-level researchers based primarily at an institution or location in the U.S.?		
B	Postdoctoral-level researchers who based primarily at an institution or location in the U.S.?		
C	Graduate or undergraduate students based primarily at an institution or location in the U.S.?		
D	Faculty or other senior-level researchers based primarily at an institution or location outside the U.S.?		
E	Postdoctoral-level researchers primarily at an institution or location outside the U.S.?		
F	Graduate or undergraduate students based primarily at an institution or location outside the U.S.?		

If all rows in B1a=no, go to B2 (traveled abroad for PIRE/COMPARISON postdoc?).

If any rows in B1a=yes AND still contributing to PIRE/COMPARISON project (A7=no), go to B2 (traveled abroad for PIRE/COMP postdoc?).

If any rows in B1a=yes, AND PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active, go to B1b (collaborated with PIRE/COMPARISON researchers post-participation?)

.

B1b is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active.

B1b. Between (PARTICIPATION_END_DATE) and [November 15, 2014], have you collaborated with any U.S. or foreign* member of the [ABBREVIATED_PROJECT_NAME] project team? Please answer Yes or No for each row below.

Row	Since my participation in the project ended, I have collaborated with:	Yes	No
A	One or more project members who were—and are still—based primarily in the U.S.		
B	One or more project members who were —and are still—based primarily outside the U.S.		
C	One or more project members who were based primarily in the U.S. but who are now based primarily outside the U.S.		
D	One or more project members who were based primarily outside the U.S. but who are now based primarily in the U.S.		

Rollover definition:

By foreign partner, we mean a person based primarily in an institution or location outside the U.S. (regardless of his or her citizenship or country of origin).

If any row=yes, go to B1c.

If all rows=no, go to B1e (collaborated with non-PIRE/COMPARISON foreign partners?)

B1c is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE/COMPARISON award not active AND respondent collaborated with any members of the PIRE/COMPARISON project team post-PIRE/COMPARISON (any rows in B1b=yes).

B1c. When was the most recent time you have collaborated with a member of the [ABBREVIATED_PROJECT_NAME] project team?

Row	Most recent collaboration with. . .	Within the past 6 months	6 months to less than 1 year ago	1 year to less than 2 years ago	2 years to less than 4 years ago	4 or more years ago
A	Display if B1b_RowA=yes One or more project members who were—and are still—based primarily in the U.S.					
B	Display if B1b_RowB=yes One or more project members who were —and are still—based primarily outside the U.S.					
C	Display if B1b_RowC=yes One or more project members who were based primarily in the U.S. but who are now based primarily outside the U.S.					
D	Display if B1b_RowD=yes One or more project members who were based primarily outside the U.S. but who are now based primarily in the U.S.					

If B1b_RowB=no and B1b_RowC=no and B1b_RowD=no, go to B1e (collaborated with non- PIRE/COMPARISON foreign partners?)

If B1b_RowB=yes or B1b_RowC=yes or B1b_RowD=yes, go to B1d (description of PIRE/COMPARISON collaboration with foreign partner).

B1d is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active.

B1d. Which of the following describe your collaboration(s) with someone from the [ABBREVIATED_PROJECT_NAME] project team who was—or who is now—based primarily outside the U.S. (that is, with a foreign* partner)? Check all that apply.

 I have traveled outside the U.S. to work with one or more foreign partners

 I have met with one or more foreign partners at conferences outside the U.S.

 I have (or have had) a position at an institution outside the U.S.

 A foreign partner has traveled to the US to work with me

 A former foreign partner has (or has had) a position at an institution in the U.S.

 A former U.S.-based partner has (or has had) a position at an institution outside the U.S.

 I have planned one or more research projects with a foreign partner

 I have conducted one or more research projects with a foreign partner

 I have discussed developments in our research field(s) with a foreign partner

 I have shared data or other resources with a foreign partner

 None of the above

Rollover definition:

By foreign partner, we mean a person based primarily in an institution or location outside the U.S. (regardless of his or her citizenship or country of origin).

B1e is shown only if PIRE/COMPARISON contributions completed (A7=yes) OR PIRE award not active.

B1e. Between [PARTICIPATION_END_DATE] and [November 15, 2014], have you collaborated with any foreign* partner (i.e., someone based primarily at an institution or location outside the U.S.) who was not affiliated with the [ABBREVIATED_PROJECT_NAME] project?

If a partner was based primarily at an institution outside the U.S. during some part of the collaboration, please answer yes. Otherwise, answer no.

 Yes

 No

Rollover definition:

By foreign partner, we mean a person based primarily in an institution or location outside the U.S. (regardless of his or her citizenship or country of origin).

If B1e=yes, go to B1f (number of foreign partners)

If B1e=no AND collaborated with foreign PIRE/COMPARISON partner (B1b_RowB=yes or B1Bb_RowC=yes or B1b_RowD=yes), go to B1f (number of foreign partners).

If B1e=no AND not collaborated with foreign PIRE/COMPARISON partners (B1b_RowB=no and B1b_Row C=no and B1b_RowD=no), go to B2 (traveled abroad for PIRE/COMPARISON?)

B1f is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active.

B1f. Between (PARTICIPATION_END_DATE) and [November 15, 2014], how many foreign* partners have you collaborated with?

Rollover definition:

By “foreign” partner, we mean someone who was, or who is now, based primarily at an institution or location outside the U.S. regardless of this person’s citizenship or country of origin.

• 1

• 2

• 3

• 4 or more

B1g is shown only if PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active.

B1g. Please think about the one foreign partner—that is, someone based primarily outside the U.S—with whom you have collaborated the longest.

(i) As of [November 15, 2014], how long have you been collaborating with this person? You may enter months, years, or any combination:

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>

(ii) Is this person currently based primarily at an institution:

• Outside the U.S.

• Within the U.S.

(iii) As of [November 15, 2014], how long [has this person been/was this person] based primarily at an institution outside the U.S.? If you are unsure please select your best guess.

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>

For items B2-B6c:

The first phrase in brackets (i.e., before the “/” mark) is used if respondent is a current PIRE/COMPARISON postdoc. An alternate item wording appears if PIRE/COMPARISON respondent is a former PIRE/COMPARISON postdoc.

B2. As part of your postdoctoral appointment , [have you traveled/did you travel] outside the U.S. for research or educational activities related to the [ABBREVIATED_PROJECT_NAME] project (other than travel that was only for the purpose of attending a professional conference)?

Please answer yes, if :

• This foreign travel was related to the [ABBREVIATED_PROJECT_NAME] project; and

• This foreign travel was not solely to attend a professional conference.

Please answer no if your only reason for foreign travel related to this project was to attend a professional conference.

 Yes

 No

If B2= yes, went abroad go to B3 (where did you travel?)

If B2= no, go to MODULE C.

An Important Note about the Next Questions

The next several questions are intended to learn about research and educational activities that occurred outside the U.S. and were associated with the project, “[ABBREVIATED_PROJECT_NAME]”.

When answering the next set of questions, please focus on your participation in activities that occurred outside the U.S. and were related to the [ABBREVIATED_PROJECT_NAME] during the term of your postdoctoral appointment.

[CONTINUE]

B3 is shown only if respondent traveled outside U.S for PIRE/COMPARISON postdoc (B2=yes).

B3. Where outside the U.S. [have you traveled/did you travel] during your postdoctoral appointment for activities related to the [ABBREVIATED_PROJECT_NAME] project? Do not include brief stops due to travel layovers or delays or stays lasting less than 24 hours. You may indicate up to five different countries.

[if former postdoc (Item A2):

Please exclude any trips for which you departed the U.S. after your postdoc ended.

[if currently enrolled a postdoc (Item A2):

Please exclude a trip for which you departed the U.S. after [NOVEMBER 15, 2014]

1st country
Select the first letter of the country to see a list
[Populated with drop-down list of countries. See APPENDIX H.2]
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
2nd country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
3rd country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
4th country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
5th country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z

B4 is only shown to respondents who traveled outside the U.S. for PIRE/COMPARISON postdoc (B2=yes).

B4. For which of the following purposes did you go abroad for activities related to the [ABBREVIATED_PROJECT_NAME] project during your postdoctoral appointment? Check all that apply.

 Conduct research

 Take classes at a university or other educational institution

 Teach and/or prepare curriculum for a course

 Attend planning meetings or workshops for upcoming research

 Other – specify [textbox, 300]

 None of the above [if None selected, no other option can be selected]

If B4= research, go to Item B5 (while abroad, did you interact with foreign partners…?)

If B4 =take Classes OR B4=teach OR B4=attend planning OR B4=attend conference OR B4=other OR B4= none, go to B6a (how many times have you traveled outside the U.S.?)

B5 is shown only to respondents who conducted research abroad (B4= research)

B5. While conducting research related to the [ABBREVIATED_PROJECT_NAME] project outside the U.S. during your postdoctoral appointment, [have you interacted/were you interacting] directly with any foreign* project members? Select Yes or No in each row.

While I was outside the U.S. for the project, I interacted directly with:	Yes	No
Senior-level partners based primarily outside the U.S.		
Postdoctoral-level partners based primarily outside the U.S.		
Graduate or undergraduate students based primarily outside the U.S.		

Rollover definition:

By “foreign” partner, we mean someone who was based primarily at an institution or location outside the U.S. regardless of this person’s citizenship or country of origin. When referring to places, “foreign” means countries or locations outside the 50 United States or the District of Columbia.

B6a is shown only to respondents who traveled outside the U.S. for PIRE/COMPARISON postdoc (B2=yes)

B6a. During your postdoctoral appointment, how many times [have you traveled/did you travel] outside the U.S. for activities related to the [ABBREVIATED_PROJECT_NAME] project? Exclude any trip you took only to attend a professional conference.

[if currently a postdoc (see item A2), display note:

Please exclude a trip for which you departed the U.S. after [NOVEMBER 15, 2014]

if former postdoc (see item A4), display note:

Please exclude any trip for which you departed the U.S. after [POSTDOC_END_DATE]

• Once

• More than once: Please enter the total number of trips: __

If B6a=once, go to B6c (how long were you abroad?)

If B6a=more than once, go to B6b (how long were you abroad on your longest trip?)

B6b is shown only to respondents who traveled outside the U.S. for PIRE/COMPARISON postdoc more than once (B6a=more than once)

B6b. Thinking about these [NUMBER OF TRIPS FROM B6a] trips outside the U.S. during your postdoctoral appointment, how many consecutive days, weeks or months were you outside the U.S. for activities related to the “[ABBREVIATED_PROJECT_NAME]” project? Please indicate the number of consecutive days, weeks or months on average, and the number of consecutive days, weeks or months for the single longest such trip?

On average, a trip outside the U.S. for activities related to the project lasted how many consecutive days/weeks/months?	__	<select days, weeks or months>
Single longest trip outside the U.S. for activities related to the project lasted how many consecutive days/weeks/months?	__	<select days, weeks or months>

Go to MODULE C.

B6c is shown only to respondents who traveled outside the U.S. for PIRE/COMPARISON postdoc once (B6a=once)

B6c. How many consecutive days, weeks or months were you outside the U.S. during your postdoctoral appointment for activities related to the [ABBREVIATED_PROJECT_NAME] project?

How many consecutive days/weeks/months did this trip outside the U.S. (for activities related to the [ABBREVIATED_PROJECT_NAME] project) last?

<select days, weeks or months>

MODULE C: PROJECT EXPERIENCES AND RESULTS

If still contributing to PIRE/COMPARISON project (A7=no): have you been

If PIRE/COMPARISON project contributions completed (A7=yes) OR PIRE award not active: were you

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2.

VERSION 1:

C1. Between [PARTICIPATION_START_DATE] and [PARTICIPATION_END_DATE], how many weeks, months, or years [have you been/were you] conducting research associated with the project: [ABBREVIATED_PROJECT_NAME]? If you are unsure, please enter your best approximation.

If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item A9), display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project after [AWARD_END_DATE]}, but please do not include those months in your total.

VERSION 2:

C1. Between [AWARD_START_DATE] (the official start date) and [PARTICIPATION_END_DATE], how many weeks, months (or years) [have you been/were you] conducting research associated with the project: [ABBREVIATED_PROJECT_NAME]? If you are unsure, please enter your best approximation.

Display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project before [AWARD_START_DATE]} {(If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item A9)}: or after [AWARD_END_DATE]}, but please do not include those months in your total.

Number of weeks/months/years: <weeks> < months> < years>

C2a is shown to both PIRE and COMP respondents.

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2

Version 1:

C2a. Between [PARTICIPATION_START_DATE] and [NOVEMBER 15, 2014], how many of the following works related to the [ABBREVIATED_PROJECT_NAME] project have you produced as an author, co-author, inventor, co-inventor, developer, or co-developer? Make your best approximation if you do not know the exact number.

Version 2:

C2a. Between [AWARD_START_DATE] and [NOVEMBER 15, 2014], how many of the following works related to the [ABBREVIATED_PROJECT_NAME] project have you produced as an author, co-author, inventor, co-inventor, developer, or co-developer? Make your best approximation if you do not know the exact number.

	None	Total	How many of these include a foreign* co-author, co-inventor, co-developer?
Conference abstracts, posters or presentations (including any published in conference proceedings	
Patents, registered or pending, provisional or non-provisional	
Other products that have been disseminated to the scholarly community or public (e.g., educational material, software application, dataset, database)	

Roll-over definition:

By foreign co-author, co-inventor, or co-developer, we mean a person who is based primarily at an institution outside the U.S.

C2b is shown to both PIRE and COMP respondents.

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2

Version 1:

C2b. Between [PARTICIPATION_START_DATE] and [NOVEMBER 15, 2014], how many invited talks, presentations or seminars have you given on research conducted as part of your participation in the [ABBREVIATED_PROJECT_NAME] project? Have any of these invited talks included a foreign* co-presenter?

Version 2:

C2b. Between [AWARD_START_DATE] and [NOVEMBER 15, 2014], how many invited talks, presentations or seminars have you given on research conducted as part of your participation in the [ABBREVIATED_PROJECT_NAME] project? Have any of these invited talks included a foreign* co-presenter?

None	Total # of invited talks	How many of these included a foreign* co-presenter?


Roll-over definition:

By foreign co-presenter, we mean a person who is based primarily at an institution or location outside the U.S.

C3 is shown to both PIRE and COMPARISON respondents.

C3. As of [November 15, 2014], how many of the following not yet published works related to the [ABBREVIATED_PROJECT_NAME] project have you produced as an author or co-author? For this question, only include works that were in press, under review, in preparation, or otherwise not yet published, posted or disseminated either in print or electronically as of [November 15, 2014].

Do not include already published works. The study includes a separate data collection of already published works on which you are an author or co-author.

Make your best approximation if you do not know the exact number.

As of [November 15, 2014]:	None	Total	How many of these include a foreign* co-author?
Peer-reviewed research reports, articles or papers IN PRESS	
Research reports, articles or papers UNDER REVIEW	
Manuscripts IN PREPARATION	

Roll-over definition:

By foreign co-author, we mean a person based primarily at an institution or location outside the U.S.

If PIRE respondent, go to C4 (benefits of collaborating with foreign partners).

If COMPARISON respondent, go to Module D.

C4 is shown only if PIRE respondent AND collaborated with foreign partners (B1a_RowD=yes OR B1a_RowE=yes OR B1a_RowF=yes)

C4. For each of the following statements please indicate whether you strongly agree, agree, disagree or strongly disagree:

	Strongly Agree	Agree	Disagree	Strongly Disagree	Not applicable
My research benefited from access to expertise of foreign* partners in my field					
My research benefited from access to data acquired in foreign locations					
My research benefited from access to equipment or facilities in foreign locations					
My research benefited from access to place-based phenomena that occur outside the U.S. (e.g., biological, geological, cultural phenomena)					
Regulatory, bureaucratic or administrative procedures in a foreign country [have hindered/hindered] the progress of the research*					
Different cultural perspectives [have improved/improved] the quality of the research					
Language differences [have hindered/hindered] the progress of the research.*					

Rollover definition:

A foreign partner is someone based primarily in an institution or location outside the U.S. (regardless of his or her citizenship or country of origin). A foreign location is a place outside the 50 United States and the District of Columbia.

Items marked with an asterisk are reverse-scored.

C5 is shown only if PIRE respondent AND went abroad for PIRE postdoc (B2=yes) AND conducted research abroad for PIRE postdoc (B4=research).

If still contributing to PIRE project (A7=no): Have you…

If PIRE contributions completed (A7=yes) OR PIRE award not active: Did you…

C5. [Have you experienced/Did you experience] any of the following challenges during the [ABBREVIATED_PROJECT_NAME] project? Check all that apply.

 Inadequate access to data, specimens, facilities, equipment, other resources

 Conflicts over authorship or credit for contributions to the research

 Delays in getting publications written due to the cross-cultural nature of the team

 Not have enough information or guidance to prepare for the foreign component of the research

 Bias from foreign* partners based on my nationality, gender, race, ethnicity, religion, disability or sexual orientation

 Delays pursuing/completing goals of my postdoctoral appointment

 Unexpected financial burdens

 Other – specify [textbox, 300]

 None of the above

Rollover definition:

By foreign partner, we mean a person based primarily in an institution or location outside the U.S. (regardless of his or her citizenship or country of origin). A foreign location is a place outside the 50 United States and the District of Columbia.

MODULE D: ABOUT YOU PRIOR TO THE PROJECT

Both PIRE and COMP respondents receive all items in Module D unless otherwise indicated

D1. In what month and year did you receive your doctoral degree? If you completed more than one doctorate, please enter the year that you received your most recent doctorate.

Dropdown menu: <January to December>

Dropdown menu: <1980 to 2014>

Let PHD_DEGREE_DATE = entered D1_month, D1_year

D2. What discipline best characterizes your primary field of research? Check one only

First select the general area; then select the field or discipline best describes the field in which you primarily conduct research.

Dropdown menus: <select general area> <select field>

SEE APPENDIX H.1 for areas and fields

D3. Did you receive any of the following degrees from a college or university outside the U.S.?

	Yes	No
Doctoral degree or professional degree		
Master’s degree or certificate		
Bachelor’s degree (or its equivalent)		

D4. How many postdoctoral appointments have you held (as of [November 15, 2014])? If you have held just one postdoc (during which you participated in the [ABBREVIATED_PROJECT_NAME] project), check here: 

Row	Number of postdoctoral appointments	Enter number
A	Postdoctoral appointment during which you participated in [ABBREVIATED_PROJECT_NAME] project	1
B	After completing your doctorate [PHD_DEGREE_DATE] and before the start of the postdoctoral appointment during which you participated in [ABBREVIATED_PROJECT_NAME] project ([POSTDOC_START_DATE])?	__
C	If A3=no, postdoc has ended display Row C: Between the end of the postdoctoral appointment during which you participated in [ABBREVIATED_PROJECT_NAME] project ([POSTDOC_END_DATE]) and [November 15, 2014]?	__
	TOTAL # of postdocs	<autosum>

If checkbox is marked, survey will automatically fill 0 in rows B and C and skip to D7

If D4_rowB >0 OR if D4_rowC>0, go to D5

D5. Prior to the start of the postdoctoral appointment during which you participated in the [ABBREVIATED_PROJECT_NAME] project, had you ever held any postdoctoral appointments outside the U.S.? Select Yes or No.

 Yes

 No

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2

Version 1:

D6. After completing your bachelor’s degree and before [PARTICIPATION_START_DATE], had you collaborated on research or education with any someone who was based primarily at an institution outside the U.S.?

Version 2:

D6. After completing your bachelor’s degree and before [AWARD_START_DATE], had you collaborated on research or education with any someone who was based primarily at an institution outside the U.S.?

 Yes

 No

D7. While you were a graduate student, did you participate in a study abroad program or spend a semester (or more) pursuing graduate research or education outside the United States?

 Yes

 No

D8. While you were an undergraduate, did you participate in a study abroad program or did you spend a semester (or more) pursuing undergraduate research or education outside the United States?

 Yes

 No

MODULE E: CAREER OUTCOMES

Items in Module E are shown only to respondents whose PIRE/COMPARISON postdoctoral appointments have ended (A3=no)

E1. Were you working for pay or profit, during the week of [November 15, 2014]? Work includes being self-employed, on a postdoctoral appointment, or on any type of paid or unpaid leave, including vacation.

 Yes

 No

If working for pay (E1=yes), go to E2a.

If not working for pay (E1=no), go to E5 (did you work abroad after your postdoc ended?)

E2 is shown only to respondents who were working for pay at the time of the survey (E1=yes).

These items refer to the principal job you held during the week of [November 15, 2014].

E2. Did your duties on this job require the technical expertise of a bachelor’s degree or higher in:

	Yes	No
Engineering, computer science, math or the natural sciences		
The social sciences		
Some other field (e.g. health, business, or education)		

E3 is shown only to respondents who were working for pay at the time of the survey (E1=yes).

E3. Was this job a “postdoc”?

 Yes

 No

E4 is shown only to respondents who were working for pay at the time of the survey (E1=yes).

E4. Was your principal employer during the week of [November 15, 2014] an educational institution?

 Yes

 No

If E4=yes, go to E4a (what was the type of educational institution?)

If E4=no, go to E5 (did you work abroad after your postdoc ended?)

E4a is shown only to respondents who were working at an educational institution for pay at the time of the survey (E4=yes AND E1=yes)

E4a. Was the educational institution where you worked a . . .

 Preschool, elementary, middle, or secondary school or system

 Two-year college, community college or technical institute

 Four-year college or university, other than a medical school

 Medical school (including university-affiliated hospital or medical center)

 University-affiliated research institute

 Other educational institution [please specify]: [textbox, 150]

If E4a = Preschool, elementary, middle, or secondary, go to E5 (other outcomes of postdoc?)

If E4a= Two-year OR Four-year OR Medical OR Research Institute OR Other, go to E4b.

E4b is shown only to respondents who were working at an educational institution for pay at the time of the survey (E4=yes AND E1=yes)

E4b. During the week of [November 15, 2014] what was your faculty rank?

 Not applicable: no ranks designated at this institution

 Not applicable: no ranks designated for my position

 Professor/Full Professor

 Associate Professor

 Assistant Professor

 Instructor

 Lecturer

 Other: [textbox, 75]

E4c is shown only to respondents who were working at an educational institution for pay at the time of the survey (E4=yes AND E1=yes)

E4c. What was your tenure status?

 Not applicable: no tenure system at this institution

 Not applicable: no tenure system for my position

 Tenured  Year Tenured [textbox]

 On tenure track but not tenured

 Not on tenure track

E5 is shown only to PIRE and COMP respondents whose postdoctoral appointment has ended (A3=no).

E5. Have your experiences with the [ABBREVIATED_PROJECT_NAME] project resulted in any of the following career outcomes? Check yes or no in each row.

Yes	No	This postdoctoral appointment:
		Helped me receive a full-time position that was my top choice.
		Helped me win grant funding to support my research

E6 is shown only if PIRE respondent AND traveled abroad for PIRE postdoc (B2=yes).

E6. Would you recommend or not recommend to other postdoctoral researchers that they participate in international research or educational activities?

 Strongly recommend

 Recommend

 Recommend with reservations

 Not recommend

E6a is shown only if PIRE respondent.

E6a. Why would you [strongly recommend/recommend/recommend but with reservations/not recommend] that other postdoctoral researchers participate in international research or educational activities?

Textbox 3500

E6b is shown only if PIRE respondent.

E6b. What aspects of your participation as a postdoc in the PIRE project have been most beneficial? What aspects have been (or were) the most challenging?

Textbox 3500

MODULE F: DEMOGRAPHIC INFORMATION

We’d like to remind you that information collected in this survey will be reported only in summary form. We will not provide individual information about you that could be linked to your identity to the National Science Foundation, any other government agency, business, or persons outside the research team.

F1. Did you ever attend elementary or secondary school outside the United States? (If you ever attended elementary or secondary school in Puerto Rico, American Samoa, Guam, Micronesia, the Marshall Islands, the Northern Mariana Islands, Palau, or the Virgin Islands, please answer YES)

 Yes

 No

F2. When you were growing up, was English the language you spoke most often at home?

 Yes

 No

F3. What is your gender?

 Female

 Male

F4. What is your ethnicity? Check one only.

 Hispanic or Latino

 Not Hispanic or Latino

F5. What is your race? Check one or more.

 American Indian or Alaska native

 Asian

 Black or African American

 Native Hawaiian or other Pacific Islander

 White

F6. Were you born in the United States?

 Yes

 No

If F6=Yes, go to F7a (usual degree of difficulty with seeing, hearing, walking, lifting?)

If F6=No, go to F6a

F6a. Are you a U.S. citizen?

 U.S. citizen

 Permanent resident (“green card”)

 Student visa or exchange visitor visa (F1 or F2, J1 or J2 visa)

 Other temporary visa (e.g., H-1B, K, L, O or other visa)

Go to F7a (usual degree of difficulty with seeing, hearing, walking, lifting?)

The next question is designed to help us better understand the career paths of individuals with different physical disabilities:

F7a.

What is the USUAL degree of difficulty you have with: Mark one answer for each item.		None	Slight	Moderate	Severe	Unable to do
1	SEEING words or letters in ordinary newsprint (with glasses/contact lenses, if you usually wear them)	1	2	3	4	5
2	HEARING what is normally said in conversation with another person (with hearing aid, if you usually wear one)	1	2	3	4	5
3	WALKING without human or mechanical assistance or using stairs	1	2	3	4	5
4	LIFTING or carrying something as heavy as 10 pounds, such as a bag of groceries	1	2	3	4	5

If all 4 rows in F7a are marked “None,” Go to Thank you screen. Otherwise go to F7b.

F7a and F7b will appear on the same page of the online survey.

F7b. What is the earliest age at which you first began experiencing any difficulties in any of these areas?

 Since birth; or Enter age in years: valid data range is 0 to 99 years

CONCLUSION

Thank you! Your responses are very important to the National Science Foundation in understanding the research and career outcomes of NSF program participants. We appreciate the time you have taken to complete the survey. Your responses will be used to improve NSF programs and to provide a better understanding of support for talented STEM faculty, postdoctoral fellows, and graduate students.

The survey is now complete. You may close your internet browser or click Exit. <EXIT >

If you would like to send NSF any comments about the survey please contact:

Suzanne Plimpton at NSF (splimpto@nsf.gov) and include the OMB Control No. = xxxx-xxxx

EXIT SCREEN

If we have identified the wrong respondent or have erroneous information, display this screen and FLAG this respondent for Abt follow-up (weekly basis)

Please accept our apology.

The information you supplied suggests that you are not eligible to participate in this study or that we have reached you in error. We regret any inconvenience to you. If you have any questions about this study or you would like to make a comment, please contact one of the following individuals and include the OMB Control No. = xxxx-xxxx:

• Dr. Carter Epstein, Study Director at Abt Associates: 1-800-XXX-XXXX or PIRE_Study@abtassoc.com

• John Tsapogas, PIRE Program Evaluation Officer at the National Science Foundation: jtsapoga@nsf.gov

• Suzanne Plimpton at NSF (splimpto@nsf.gov)

May we have permission to contact you by email in order to clarify your responses here? Answering “yes” does not obligate you to answer any questions.

 1=Yes, you may contact me. My preferred email address is: [textbox 150]

• 0=No, please do not contact me to clarify.

Thank you very much.

Appendix C: Postdoctoral Survey 3