Foreign Investigator Survey

Appendix F. Foreign Investigator Survey

Guidelines for Reviewers

Note, because of the complicated skip patterns that will be programmed, the reviewer version of the survey, by necessity, requires that there be embedded among the questions notes documenting skip patterns, alternate wording of questions, and information about which respondents will receive a particular question. These programming notes appear in a small, blue, sans-serif font. Some questions also contain placeholders for text that varies depending on existing information (e.g., the start and end dates of a grant period) or a respondent’s answer to an earlier item. These placeholders appear as [BROWN CAPITALIZED TEXT] inside brackets.

The online survey will automatically incorporate skip patterns and present the appropriate text for placeholders and question wording to the respondent. Also note that boldface type is used for emphasis, while an asterisk (*) indicates that a roll-over definition is available to online respondents (see Glossary, below). Surveys will employ a variety of response structures and will be programmed to use radio buttons, checkboxes, text boxes, and drop down boxes. Examples of each are shown below.

Radio Buttons – Allow only one answer to a question. Click circle to select option. To change answer, click another button.

Are you currently employed?

	Yes
	No

Checkboxes – Allow multiple answers to a question. Click a box to select a response. Click a checked box to remove the choice.

Which of the following degrees you have completed? Check all that apply.

☐ Doctoral degree

☒ Master’s degree

☐ Post-baccalaureate certificate

☒ Bachelor's degree

Text boxes – Allows respondent to write answer to question within a box. The number inside brackets (i.e., the “2500” in [textbox, 2500]) indicates how many characters the respondent can enter into the textbox.

What is your job title and what do you do in your job? [textbox, 2500]

     

Drop down – Allows respondent to select one answer from a list of specified list of options. Respondents click on box, and then scroll to select option.

In what month and year did you complete your graduate degree?

Month: [Drop box]

Year: [Drop box]

Glossary

U.S.-based: “U.S.-based” means people who are based primarily in institutions or locations within the U.S., regardless of their citizenship or country of origin. (In other words, “U.S.-based” could refer to someone who is not a U.S.-citizen but who is primarily based at an institution within the U.S.) When referring to places, “U.S.” means countries or locations outside the 50 United States or the District of Columbia.

Institution: Typically refers to a university, college or other higher educational entity but may include a museum, private or governmental research institute, laboratory, foundation, non-profit or for-profit business, or other organization.

Placeholders

SURVEY_DATE / NOVEMBER 15, 2015: The first day that the survey is fielded will serve as a common reference date across respondents. November 15, 2014 is currently filled as a hypothetical survey fielding date. After OMB approval, this date will be replaced with the actual field date of the survey.

PIRE _PROJECT_NAME: The title of the PI’s or co-PI’s project funded by PIRE or the comparison program.

ABBREVIATED_PROJECT_NAME: Because project titles are often long, a shortened name will be introduced and substituted for the full title in survey questions.

LEAD_PI_NAME: The first and last name of the U.S.-based Lead Principal Investigator of the PIRE award.

AWARD_START_DATE: Date when the PIRE award period began, according to NSF records.

AWARD_END_DATE: Date when the PIRE award period ended (if applicable), according to NSF records. If a project is still active, the SURVEY_DATE will be used as the most recent reference date for questions.

PARTICIPATION_START_DATE: Collected during the survey, the date the respondent reports first engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates begin their participation on the date when the award officially commences.

PARTICIPATION_END_DATE: Collected during the survey, the date the respondent reports last engaging in project activities. Not all co-PIs, postdocs, graduate students or undergraduates continue participating on the project until its official end date.

URL TO AWARD ABSTRACT: Hypertext link to the award abstract posted on nsf.gov

HIGHEST_DEGREE: Collected during the survey, the highest post-secondary degree the respondent has completed.

Survey of International Research Partners in the U.S. National Science Foundation’s Partnerships in International Research and Education (PIRE) program

We are contacting you on behalf of the National Science Foundation (NSF) of the United States. We would like you to take part in a survey. We are inviting you to take part in the following survey because NSF records indicate that you are a current or former participant in research funded, in part, by an NSF award to [LEAD_PI_NAME] for the “PIRE_PROJECT_NAME.” (You may have obtained other funding to participate in research associated with this project.) You can view a description of this award by clicking <URL TO AWARD ABSTRACT>.

The survey asks about your research collaborations with U.S. investigators supported by this National Science Foundation PIRE project. Participation is voluntary. You are free to skip any question you prefer not to answer. This survey is part of an evaluation of the NSF’s Partnerships for International Research and Education (PIRE) program. Researchers at Abt Associates, a private company in Cambridge, Massachusetts, are conducting this evaluation under contract to the NSF. Abt Associates is an independent, non-partisan research firm with over 40 years’ experience in higher education and we have conducted several similar studies for the NSF.

Your responses will not be linked with your name or other identifying characteristics. Data from the survey will be summarized in reports for NSF; these reports will never include your name or other personal information about you.

Questions? See the Frequently Asked Questions page <FAQs>; or contact the study director, Carter Epstein of Abt Associates Inc. (email: NSF_PIRE_Abt@abtassoc.com) or contact John Tsapogas at NSF (jtsapoga@nsf.gov). For questions about participating in this research study, contact Abt’s Institutional Review Board (email: irb@abtassoc.com). This study’s IRB approval number is #XXXX.

OMB Clearance Number: xxxx-xxxx

Expiration Date: xx/xx/xxxx

Estimates of Burden for the Collection of Information. According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this collection is xxxx-xxxx. The time required to complete this information collection is estimated to average 30 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, and complete and review the information collected.

[CONTINUE]

MODULE A: INTRODUCTION: CONFIRMING YOUR PARTICIPATION IN PIRE

A1. Information from the National Science Foundation in the United States lists you as a collaborating investigator on a project called “[PIRE_PROJECT_NAME]”? The U.S.-based principal investigators for this project are:

<Lead PI Name>

<Co-PI #1 Name>

<Co-PI #2 Name>

<Co-PI #3 Name>

<Co-PI #4 Name>

Are you affiliated with this project?

 Yes

 No

If A1= yes, go to A2.

If A1= no, go to Exit Screen and Flag for follow-up.

A2. Is your name [First Name, Last Name]?

 Yes, this is correct.

 No, my name has changed or my name is misspelled above. My name is: [textbox, 75]

 No, I’m not the person named above.

If A2= YES, go to A2a.

If A2= NO, my name has changed or my name is misspelled above, and I have corrected it in the textbox, go to A2b.

If A2= NO, I’m not the person named above, go to Exit Screen and Flag for follow-up.

A2a. For remaining items in the survey, when we ask about the [PIRE_PROJECT_NAME] project, we will shorten this project name to “[ABBREVIATED_PROJECT_NAME].” [ABBREVIATED_PROJECT_NAME] is the same project as the [PIRE_PROJECT_NAME].

Go to A3.

A3. The [ABBREVIATED_PROJECT_NAME] officially began in [AWARD_MONTH, AWARD_YEAR]. When did you first participate in this project? Please enter the month and year.

 I have not yet begun participating in the PIRE project

Month: <dropdown from January to December>

Year: <dropdown from AWARD_YEAR to 2015>

Let PARTICIPATION_START_DATE = “Month, Year” entered.

if date entered ([PARTICIPATION_START_DATE]) is earlier than [AWARD_START_DATE], display the following note:

Note:  You participated in activities for this project prior to its official starting date ([AWARD_START_DATE]). We recognize that activities related to a project may begin before the project’s official start date.   However, please read survey items carefully because some items may ask you to exclude activities that occurred before the project’s official start date of [AWARD_START_DATE].

Let PARTICIPATION_START_DATE = A3_Month, A3_Year.

If A3=Not yet begun participating, go to A3a (when will you start participating?).

If A3=missing, use the text “the date you first participated in the PIRE project” in subsequent items referring to [PARTICIPATION_START_DATE].

If PIRE award is no longer active, go to A5 (contributing to PIRE in award end month?).

If PIRE award still active, go to A4 (completed contributions to PIRE?)

A3a. When do you expect to begin participating in the PIRE project?

Month: <dropdown from January to December>

Year: <dropdown from 2014 to 2020>

Let PARTICIPATION_START_DATE =A3a_Month, A3a_Year and EXIT THE SURVEY.

A4 is shown only if PIRE award still active.

A4. As of [November 15, 2014], have you completed your contributions to the PIRE project? Please mark Yes or No.

If you will be engaging in research or educational activities that are part of this project in the future, please answer “No, I am still contributing – or I will be contributing in the future—to this project.”

• Yes, I have completed my contributions to this project.

• No, I am still contributing – or I will be contributing in the future—to this project.

If A4=YES, go to A6 (to get participation end date).

If A4=NO, let PARTICIPATION_END_DATE = November 15, 2014. Go to A7 (duration of PIRE participation).

A5 is shown only if PIRE award no longer active.

A5. The official award period for the [ABBREVIATED_PROJECT_NAME] project ended in [AWARD_END_DATE]. Were you still contributing to this project in the month that the award period ended?

 Yes

 No

If A5=YES, let PARTICIPATION_END_DATE =AWARD_END_DATE). Go to A7 (duration of PIRE participation).

If A5=NO, go to A6 (to get PARTICIPATION_END_DATE).

A5a is shown only if PIRE/COMPARISON award is not active AND IF A5=YES.

A5a.

We recognize that you may have conducted research or engaged in educational activities associated with the [ABBREVIATED_PROJECT_NAME] project after its official end date ([AWARD_END_DATE]), but please read survey items carefully because some items ask you to distinguish between activities that occurred before and activities that occurred after the official end date of [AWARD_END_DATE].

Go to A7.

A6 is shown only if PIRE contributions completed (A4=yes) AND respondent not participating in PIRE in last month of award period (A5=no).

A6. When did you last contribute to research or other activities associated with the [ABBREVIATED_PROJECT_NAME] project? Please enter the month and year.

Month: <dropdown from January to December>

Year: <dropdown from AWARD_START_YEAR to AWARD_END_ YEAR>

Let PARTICIPATION_END_DATE =A6_MONTH, A6_YEAR.

The first phrase in brackets (i.e., before the “/” mark) is used if PIRE participation has NOT ended;

The second phrase in brackets (after the “/” mark) is used if PIRE participation has ended (A4=yes) OR the PIRE award period is no longer active.

If still contributing to PIRE (A4=no): have you been

If completed PIRE contributions (A4=yes) OR PIRE award not active: were you

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2.

VERSION 1:

A7. Between [PARTICIPATION_START_DATE] and [PARTICIPATION_END_DATE], about what percent time, on average, [have you been/were you] participating in research or other activities associated with the PIRE project: ([ABBREVIATED_PROJECT_NAME])? For example, if you devoted an average of 3 months per year to the project, you would answer 25 percent. If you are unsure, please enter your best approximation.

If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item A5), display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project after [AWARD_END_DATE], but please do not include that time in your estimate.

VERSION 2:

A7. Between [AWARD_START_DATE] (the official start date of the project) and [PARTICIPATION_END_DATE], about what percent time, on average, [have you been/were you] participating in research or other activities associated with the PIRE project: ([ABBREVIATED_PROJECT_NAME])? For example, if you devoted an average of 3 months per year to the project, you would answer 25 percent. If you are unsure, please enter your best approximation.

Display the following warning:

We recognize that you may have conducted research (or engaged in educational activities) related to the project before [AWARD_START_DATE]} {(If PIRE/COMPARISON award not active AND respondent was still contributing to the project in the final month of the award period (see Item A5)}: or after [AWARD_END_DATE]}, but please do not include that time in your estimate.

Percent time: %

A8. What is the highest degree you have completed? Mark one response.

 Doctoral degree (PhD, D.Phil, D.Sc., D.Eng)

 Master’s degree (M.S., M.A., M.Sc., M.Eng)

 A different degree—(please enter the degree here): [textbox, 50]

Let HIGHEST_DEGREE=A8 selection

A9. In what year did you complete this degree?

Dropdown menu:

<select year>	if before 1980:	If before 1970:	If before 1950:
before 1980	before 1970	before 1950	1940
1981	1970	1950	1941
1982	1971	1951	…
…	…	…
1991	1980	1969	1949
1992
…
2001
2002
…
2014

A10. Where did you receive this degree?

• In the U.S.

• In another country

A11. As of [NOVEMBER 15, 2014], where were you primarily based (that is, where is the institution in which you work or where you are affiliated)?

Select the first letter of the country to see a list:

[populated with drop-down list of countries. See APPENDIX H.2]
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z

A12. What discipline best characterizes your primary field of research?

First select the general area; then select the field or discipline that best describes the field in which you primarily conduct research.

Dropdown menus: <select general area> <select field>

SEE APPENDIX H.1 for areas and fields

MODULE B: COLLABORATIONS

If still contributing to PIRE (A4=no): have you

If PIRE contributions completed (A4=yes) OR PIRE award not active: did you

B1a. While conducting research for the PIRE project, [have you collaborated/did you collaborate] with any of the following? Select Yes or No in each row.

Row	Collaborations with participants in the PIRE project:	Yes	No
A	Senior-level researchers based primarily in the U.S.		
B	Postdoctoral researchers based primarily in the U.S.		
C	Graduate or undergraduate students based primarily in the U.S.		

If all rows in B1a=no, go to Module C.

If any rows in B1a=yes, AND PIRE contributions completed (A4=yes) or PIRE award not active, go to B1b.

If any rows in B1a=yes, AND PIRE contributions not completed (A4=no), go to Module C.

B1b is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active.

B1b. Between [PARTICIPATION_END_DATE] and [NOVEMBER 15, 2014], have you collaborated with any U.S.-based* member of the PIRE project team? Please answer Yes or No for each row below.

Since my participation in the project ended I have collaborated with:	Yes	No
One or more project members who were—and are still**—based primarily in the U.S.		
One or more project members who were based primarily in the U.S. but who are now** based primarily outside the U.S.		
One or more project members who were based primarily outside the U.S. but who are now*** based primarily in the U.S.		

Rollover definition:

By “U.S.-based” member of the project team, we mean someone based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

^** If you do not know where a project member is currently based: check YES if this project member was based primarily in the U.S. at the time you collaborated with him or her.

^*** If have collaborated with a project member while that person has been based primarily in the U.S., check YES, even if you know (or think) that this person used to be based outside the U.S.

If all rows in B1b= NO, go to B1e (collaborated with non-PIRE U.S. researchers?).

If any rows B1b = YES, go to B1c.

B1c is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active AND B1b_RowA=yes OR B1b_RowB=yes OR B1b_RowC=yes.

B1c. When was the most recent time you have collaborated with a U.S.-based member of the PIRE project team?

Row	Most recent collaboration with. . .	Within the past 6 months	6 months to less than 1 year ago	1 year to less than 2 years ago	2 years to less than 4 years ago	4 or more years ago
A	Display row A if B1b_Row(A) =yes: One or more project members who were—and are still—based primarily in the U.S.					
B	Display row B if B1b_Row(B)=yes: One or more project members who were based primarily outside the U.S.—but who are now based primarily in the U.S.					
C	Display row C if B1b_Row(C)=yes One or more project members who were based primarily in the U.S. --but who are now based primarily outside the U.S.					

Rollover definition:

By “U.S.-based” member of the project team, we mean someone based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

If any row in B1b=YES, go to B1d (describe this most recent collaboration w/U.S. colleague).

B1d is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active AND collaborated with U.S. PIRE researchers post-PIRE participation (B1b_RowA=yes OR B1b_RowB=yes OR B1b_RowC=yes).

B1d. Which of the following describe your collaboration(s) with a U.S.-based member of the PIRE project team? Check all that apply.

 I have traveled to the U.S. to work with one or more U.S.-based partners

 I have met with one or more U.S.-based partners at conferences in the U.S.

 I have (or have had) a position at an institution within the U.S.

 A U.S.-based partner has worked with me at location(s) outside the U.S.

 A U.S.-based partner has (or has had) a position at an institution outside the U.S.

 I have planned one or more research projects with a U.S.-based partner

 I have conducted one or more research projects with a U.S.-based partner

 I have discussed developments in our research field(s) with a U.S.-based partner

 I have shared/am sharing data or other resources with a U.S.-based partner

 None of the above

Rollover definition:

By “U.S.-based” member of the project team, we mean someone who was, or who is now, based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

B1e is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active.

B1e. Between [PARTICIPATION_END_DATE] and [November 15, 2014], have you collaborated with any U.S.-based partners (i.e., based primarily at an institution in the U.S.) who were not affiliated with the PIRE project? Check one only

 Yes

 No

Rollover definition:

By “U.S.-based” partner, we mean someone who was, or who is now, based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

If B1e=YES, go to B1f (how many partners…?).

If B1e=NO AND has collaborated with U.S. PIRE partner (any rows in B1b =yes), go to B1f (how many partners…?).

If B1e=NO AND has not collaborated with U.S. PIRE partner (all rows in B1b =no), go to Module C.

B1f is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active.

B1f. Between [PARTICIPATION_END_DATE] and [November 15, 2014], how many U.S.-based partners have you collaborated with?

• 1

• 2

• 3

• 4 or more

Rollover definition:

By “U.S.-based” partner, we mean someone who was, or who is now, based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

B1g is shown only if PIRE contributions completed (A4=yes) OR PIRE award not active.

B1g. Please think about the one U.S.-based partner—that is, someone based primarily at an institution within the U.S.—with whom you have collaborated the longest.

(i) As of SURVEY_DATE, how long have you been collaborating with this person? You may enter months, years, or any combination:

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>

(ii) Is this person currently based primarily at an institution:

• Within the U.S.

• Outside the U.S.

(iii) As of SURVEY_DATE, how long [has this person been/was this person] based primarily at an institution within the U.S.? If you are unsure please select your best guess.

Years: <0 years to 30 or more years> and Months: <1 month to 11 months>

MODULE C: PIRE PROJECT EXPERIENCES

The next questions ask about the funding, planning and design of the research.

For items C1-C12:

The first phrase in brackets (i.e., before the “/” mark) is used if still contributing to PIRE (A4=no);

The second phrase in brackets (after the “/” mark) is used if PIRE contributions completed (A4=yes) OR the PIRE award period is no longer active.

C1. [Have you obtained/Did you obtain] funding to support participation in the [ABBREVIATED_PROJECT_NAME] project from any of the following? Check all that apply.

 U.K. Engineering and Physical Sciences Research Council (EPSRC)

 U.K. Economic and Social Research Council (ESRC)

 Ministry of Education and Science (MES) of the Russian Federation (R.F.)

 Japan Science and Technology Agency (JST)

 Inter-American Institute for Global Change Research (IAI)

 U.S. Environmental Protection Agency (US EPA)

 U.S. Agency for International Development (USAID)

 An international institution

 A government or national institution in my country (not listed above)

 A foundation or philanthropic organization (e.g., Gates Foundation)

 My institution or employer

 Private industry (domestic, foreign, or multinational company)

 Other (please specify: [textbox, 200])

 None of the above

C2. [How has this funding been used/How was this funding used]? You may check more than one response.

 To support my work on the project

 To support one or more postdoctoral researchers working on the project

 To support one or more graduate students working on the project

 For travel outside my country that was necessary to conduct the research

 For travel within my country that was necessary to conduct the research

 For travel to professional conferences (either outside my country or within my country)

 To pay for equipment, supplies, resources or facilities, or for access to such resources

 To support educational activities such as courses, lecture series, seminars

 For expenses related to hosting international guests (e.g., housing, meals, etc.)

 None of the above

C3. Please estimate the total amount of funding that you received to support research or educational activities for the [ABBREVIATED_PROJECT_NAME] project.

C3a. First, please indicate which currency you will use to estimate this funding:

• U.S. dollars

• Another currency

If C3a=U.S. dollars, go to C3b. If C3a=Another currency, go to C3c.

C3b. Please respond in terms of US dollars (USD). For help converting other currencies, see: http://www.oanda.com/currency/converter/

Please mark one response:

I don’t know
Less than $50,000 USD	$500,001 to $550,000 USD	1,000,001 to 1,050,000 USD
$50,001 to $100,000 USD	$550,001 to $600,000 USD	1,050,001 to 1,100,000 USD
$100,001 to $150,000 USD	$600,001 to $650,000 USD	1,100,001 to 1,150,000 USD
$150,001 to $200,000 USD	$650,001 to $700,000 USD	1,150,001 to 1,200,000 USD
$200,001 to $250,000 USD	$700,001 to $750,000 USD	1,200,001 to 1,250,000 USD
$250,001 to $300,000 USD	$750,001 to $800,000 USD	1,250,001 to 1,300,000 USD
$300,001 to $350,000 USD	$800,001 to $850,000 USD	1,300,001 to 1,350,000 USD
$350,001 to $400,000 USD	$850,001 to $900,000 USD	1,350,001 to 1,400,000 USD
$400,001 to $450,000 USD	$900,001 to $950,000 USD	1,400,001 to 1,450,000 USD
$450,001 to $500,000 USD	$950,001 to $1,000,000 USD	1,450,000 to 1,500,000 USD
		More than 1,500,000 USD

C3c. Please enter the estimated amount, the year in which you received each amount, and the type of currency (e.g., Japanese yen, Brazilian real, Indian rupee, etc.)

Amount: Year received: __ __ __ __ Currency: [textbox, 100]

Amount: Year received: __ __ __ __ Currency: [textbox, 100]

Amount: Year received: __ __ __ __ Currency: [textbox, 100]

Amount: Year received: __ __ __ __ Currency: [textbox, 100]

Amount: Year received: __ __ __ __ Currency: [textbox, 100]

C4. [Have you been/were you] involved in planning, designing or conceptualizing the research or educational activities for the [ABBREVIATED_PROJECT_NAME] project?

 Yes

 No

If C4= NO, go to C5.

If C4 = YES, go to An Important Note.

C5 is shown only if respondent not was not involved in planning (C4=no).

C54. [Have there been/were there] any difficulties because you were not involved in planning the research or educational activities? Please select one response only.

 Yes, many difficulties

 Yes, a few difficulties

 No difficulties or only minor ones that were easily overcome.

Go to Item C6 (number of researchers at your institution that participated in PIRE).

Note shown only if respondent was involved in planning (C4= YES)

An Important Note:

In the next few questions we ask about members of the [ABBREVIATED_PROJECT_NAME] “project team.” When we refer to the “project team” we mean principal or co-principal investigators (PIs or co-PIs), other senior-level researchers, postdoctoral-level researchers and any graduate students who have participated in this project, whether from the U.S., your country, or another country.

Go to Item C5.

C65 is shown only if respondent was involved in planning (C3= YES).

C65. During the planning of the research, did you meet in person (face-to-face) with members of the project team (PIs, co-PIs, other senior-level researchers, postdocs and graduate students) who were primary based in countries other than your own? Please mark yes or no.

 Yes

 No

The next questions are about the types of people and activities associated with the PIRE project.

C76. Approximately how many individuals based primarily at your institution have participated in the PIRE project as of [November 15, 2014]? Please enter a number for each type of person in each column:

Type of PIRE participant	Number who have participated in the PIRE project
Undergraduate students
Graduate students
Postdoctoral researchers
Senior researchers –above the postdoctoral level (for example, professor, lecturer, faculty, research scientist, research associate, senior fellow)

C87. As part of your participation in the [ABBREVIATED_PROJECT_NAME] project, [have you traveled/did you travel] internationally (that is, outside your country) to conduct research or educational activities? If your only foreign travel for this project was for the sole purpose of attending a professional conference, please answer “no.”

 Yes

 No

If C87= YES, go to C98 (locations visited).

If C87=NO, go to C110 (have others at your institution traveled abroad for PIRE?).

C98. Where [have you traveled/did you travel] for activities related to the [ABBREVIATED_PROJECT_NAME] project? Do not include brief stops due to travel layovers or delays or stays lasting less than 24 hours. You may indicate up to five different countries.

If project is not active:

Please exclude any trips for which you departed your country after [AWARD_END_DATE].

If project is active:

Please exclude any trips for which you departed your country after [SURVEY_DATE].

1st country
Select the first letter of the country to see a list
[populated with drop-down list of countries. See APPENDIX H.2]
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
2nd country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
3rd country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
4th country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z
5th country
A	B	C	D	E	F	G	H	I-J	K
L	M	N	O	P	Q-R	S	T	U-V	W-Z

C109a. As of [SURVEY_DATE], how many times [have you traveled/did you travel] internationally for activities related to the [ABBREVIATED_PROJECT_NAME] project? Exclude any trip you took only to attend a professional conference.

[if award is active display note:

Please exclude any foreign trip for which you departed after [SURVEY_DATE]

[if award is no longer active display note:

Please exclude any foreign trip for which you departed after [AWARD_END_DATE]

• Once

• More than once: Please enter the total number of trips as of: __

If C109a= “Once,” skip to C109c. If C9a= “More than once,” go to C109b.

C109b is shown only if C109a= “More than once.”

C109b. Thinking about these [NUMBER OF TRIPS FROM C9a] international trips, how many consecutive days, weeks or months were you outside your country for activities related to the [ABBREVIATED_PROJECT_NAME] project? Please indicate the number of consecutive days, weeks or months on average, and the number of consecutive days, weeks or months for the single longest such trip?

On average, a foreign trip for activities related to the project lasted how many consecutive days/weeks/months?	__	<select days, weeks or months>
Single longest foreign trip for activities related to the project lasted how many consecutive days/weeks/months?	__	<select days, weeks or months>

After C109b, skip to C110

C109c is shown only if C109a= “Once.”

C109c. How many consecutive days, weeks or months were you outside your country for activities related to the [ABBREVIATED_PROJECT_NAME] project?

How many consecutive days/weeks/months did this trip outside your country (for activities related to the project) last?

__

<select days, weeks or months>

C110. Have any members of your institution traveled internationally (that is, outside your country) to participate in research or educational activities for the [ABBREVIATED_PROJECT_NAME] project? If the only reason these individuals traveled internationally was to attend a professional conference, please answer “no.”

 Yes

 No

If C110= YES, go to C121.

If C110= NO, go to C132 (which researchers responsible for different aspects of PIRE?).

C121 is shown only if respondent’s colleagues traveled abroad for PIRE (C110= YES).

C121. What types of individuals from your institution have traveled internationally for the PIRE project? Have any of these individuals visited the United States for the PIRE project?

Please do not include visits to another country solely to attend a professional conference.

	Traveled internationally for PIRE project?		Visited the United States for the PIRE project
Members of my institution	Yes	No	Yes	No
Undergraduate students				
Graduate students				
Postdoctoral researchers				
Senior researchers				

C132. Who [has been/was] primarily responsible for conducting the following aspects of research for the [ABBREVIATED_PROJECT_NAME] project? Select one answer in each row.

If you were not engaged in any of the research associated with this project, please check here and go to the next item in the survey: 

Rollover definition:

By “U.S.-based” partner, we mean someone based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

Aspects of the PIRE research:	U.S.-based partners had primary responsibility	U.S.-based and Non-U.S.-based partners shared responsibility about equally	Non-U.S.-based partners had primary responsibility	Not applicable (this activity was not part of the research)
Developing the ideas, hypotheses, or vision for the research project				
Coordinating the multi-national team of researchers				
Developing instrumentation, software, equipment, or data collection approaches				
Collecting data				
Preparing samples or specimens				
Synthesizing or fabricating materials				
Analyzing data				
Interpreting results				
Disseminating results through publications and presentations				

MODULE D. PRE-PIRE INTERNATIONAL RESEARCH COLLABORATIONS

If PARTICIPATION_START_DATE equal to or later than AWARD_START_DATE, display version 1.

If PARTICIPATION_START_DATE earlier than AWARD_START_DATE, display version 2

Version 1:

D1. Between the year you completed your [HIGHEST_DEGREE] (in [HIGHEST_DEGREE_YEAR]) and the start of your participation in the [ABBREVIATED_PROJECT_NAME] project (in [PARTICIPATION_START_DATE]), had you ever before collaborated on any research or education with someone who was based primarily at an institution in the U.S.?

Version 2:

D1. Between the year you completed your [HIGHEST_DEGREE] (in [HIGHEST_DEGREE_YEAR]) and the start of your participation in the [ABBREVIATED_PROJECT_NAME] project (in [AWARD_START_DATE]), had you ever collaborated on any research or education with someone who was based primarily at an institution in the U.S.?

 Yes

 No

If D1=Yes go to D2.

If D1=No, go to Module E.

If PIRE/COMPARISON award is active: who are currently

If PIRE/COMPARISON award is no longer active: who were

D2. Are/were any of these US-based* partners with whom you collaborated (before the start of your participation in the [ABBREVIATED_PROJECT_NAME] project) also participants in the PIRE project?

• Yes

• No

Rollover definition:

By “US-based” partner, we mean someone who was, or who is now, based primarily at an institution or location within the U.S., regardless of this person’s citizenship or country of origin.

D3 is shown only if respondent collaborated with U.S. researchers pre-PIRE (D1=yes).

D3. For how many months or years had you been collaborating with these individuals prior to the start of the [ABBREVIATED_PROJECT_NAME] project (in [AWARD_START_DATE])? Do not include time you spent preparing the [ABBREVIATED_PROJECT_NAME] proposal. Check one response.

If you were collaborating with multiple individuals for different durations, pick the longest duration that applies.

 Less than 1 month

 1-12 months

 More than 12 months

MODULE E: BENEFITS AND CHALLENGES OF THE PIRE PROJECT

If still contributing to PIRE (A4=no): have hindered

If PIRE contributions completed (A4=yes) OR the PIRE award period is no longer active: hindered.

E1. For each of the following statements please indicate whether you strongly agree, agree, disagree or strongly disagree:

	Strongly Agree	Agree	Disagree	Strongly Disagree
My research benefited from access to expertise of foreign researchers in my field				
My research benefited from access to data acquired in foreign locations				
My research benefited from access to equipment or facilities in foreign locations				
My research benefited from access to place-based phenomena that occur outside my country (e.g., biological, geological, cultural phenomena)				
Different cultural perspectives [have improved/improved] the quality of the research				
Regulatory, bureaucratic or administrative procedures in a foreign country [have hindered/hindered] the progress of the research*				
Language differences [have hindered/hindered] the progress of the research				

Items marked with an * are reverse-scored.

E2. For each of the following statements please indicate whether you strongly agree, agree, disagree or strongly disagree. Select one answer per row.

	Strongly disagree	Disagree	Agree	Strongly agree	Not applicable
U.S.-based partners integrated well with members of my group					
U.S.-based partners showed interest in learning about the history, culture, and customs of my country					
Senior U.S.-based partners had sufficient knowledge and expertise to be a full participant in a research collaboration					
U.S.-based partners showed interest in scientific culture and organization, and how it is organized and funded in my country					

Rollover definition:

By “U.S.-based” partner, we mean someone who was based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

E3. Did you experience any of the following challenges during the [ABBREVIATED_PROJECT_NAME] project? Check all that apply

	Inadequate access to data, specimens, facilities, equipment, other resources
	Conflicts over authorship or credit for contributions to the research
	Funding expected was not obtained, was reduced or withdrawn
	Delays in getting publications written due to the cross-cultural nature of the team
	Bias from U.S.-based researchers based on my nationality, gender, race, ethnicity, religion, disability, nationality, or sexual orientation
	Key U.S.-based researchers were not as available as I expected or did not contribute enough to the project
	Other (please specify): [textbox, 300]
	None of the above

Rollover definition:

By “U.S.-based” partner, we mean someone who was based primarily at an institution or location in the U.S., regardless of this person’s citizenship or country of origin.

E4. Aside from any benefits that the [ABBREVIATED_PROJECT_NAME] project has had (or will have) for those participating directly in the project, what are the benefits of the PIRE project for society at large, or for those who have not participated directly in the project?

[textbox, 3000]

E5. How might society implement (or how has society implemented) some of the research findings that the PIRE project [ABBREVIATED_PROJECT_NAME] has produced, or that you anticipate it will produce, to help address challenges of global significance or problems that exist on a global scale?

[textbox, 3000]

E6. The U.S. National Academies of Science and Engineering (with their partners, the Institute of Medicine and the National Research Council) have identified a set of “global challenges” out of recognition that “Many of the world’s greatest health, environmental, and security threats are beyond the ability of any one nation to confront by itself.” Examples of areas where internationally-coordinated responses are needed include:

• Meet increased global demand for energy without causing irrevocable harm to the environment;

• Reduce the human forcing of climate change, and develop and implement economically viable low carbon energy technologies;

• Improve access to clean water that is threatened by rapid human population growth, increasing urbanization and poor water management;

• Address reduced agricultural output and increased food insecurity due to poor soil, lack of high quality seeds, and inefficient use of water or fuel;

• Minimize risks of dual-use technologies in the life and nuclear sciences that can be used to improve lives but also to manufacture weapons;

• Promote and protect innovation with appropriate protection that does not stifle further advances;

• Build resilience to hazards from natural and technological disasters

• Address demographic challenges from population growth, aging and urban population dynamics in developing countries

Has the [ABBREVIATED_PROJECT_NAME] project advanced knowledge or led to discoveries that might help address global challenges such as those listed above, or in another area in which solutions are unlikely to emerge from the efforts of one nation acting alone?

• Yes

• No

If Yes, please describe. [textbox, 3000]

Citation: http://sites.nationalacademies.org/International/international_052200; also see the statements posted at http://sites.nationalacademies.org/International/International_080840

E6 is shown only if 2012 PIRE respondent.

E6. In its 2011 solicitation for proposals to the PIRE program, the National Science Foundation asked for research that would “advance sustainability science, engineering and education as an integrative approach to the challenges of adapting to environmental, social and cultural changes associated with growth and development of human populations, and attaining a sustainable energy future.”

Although the PIRE project is still underway, has the project resulted in any contributions to “the challenges of adapting to environmental, social and cultural changes associated with growth and development of human populations, and attaining a sustainable energy future.”? How can society implement some of the research findings that PIRE is producing to address sustainability challenges? Please describe separately any contributions that your project has already made and any contributions that you anticipate as the project progresses:

Contributions made to date (as of November 15, 2014): [textbox, 3000]

Anticipated contributions: [textbox, 3000]

MODULE F: PIRE AND YOUR INSTITUTION

In this section, we’d like to ask about any effects of PIRE on your institution.

F1. [Has/Did] participation in the [ABBREVIATED_PROJECT_NAME]project resulted/result in any changes in policies or practices related to undergraduate and/or graduate education in the sciences, engineering or other fields at your institution, or within your department? Please check one or more responses.

• Yes, within my department

• Yes, within my institution

• No [if marked, no other response can be marked]

• Not applicable: I am not at an institution of higher education [if marked, no other response can be marked]

If F1=Yes, within department and/or institution, go to F1a.

If F1=No, skip to F2 (benefits and/or challenges of undergrads studying abroad?)

If F1=Not applicable, skip to F3.

F1a. Please describe these changes. [textbox, 3000]

F2. At your institution, are there policies or practices that either facilitate or hinder participation of undergraduate or graduate students in research or education abroad?

	Yes	No	Not applicable
Undergraduate majors in sciences, mathematics or engineering			
Graduate students in sciences, mathematics or engineering			

If F2=Yes, go to F2a.

If F2=No or Not applicable, skip to F3 (has your institution done any of the following to assist/support PIRE?)

F2a. Please describe how your institution’s policies or practices facilitate or hinder the participation of undergraduate or graduate students in research/education abroad. [textbox, 3000]

If PIRE award is active: Has your institution done; options 6 & 7: My institution has

If PIRE award is no longer active: Did your institution do; options 6 & 7: My institution had

F3. Has your institution done/Did your institution do any of the following to facilitate or support international research or education initiatives for the [ABBREVIATED_PROJECT_NAME] project? Check all that apply.

• Provided individuals planning international research/educational collaborations with seed money

• Provided individuals writing grant proposals with assistance developing the international components of a proposal

• Assisted students with arrangements for research/education abroad

• Assisted faculty/employees with arrangements for international research/education abroad

• Helped participants in international activities coordinate with a partner institution in one or more foreign countries

• My institution has/had an existing exchange program with one or more countries involved in the PIRE project

• My institution has/had a campus in a country involved in the PIRE project

• Other. Please describe: [textbox, 2,500]

• None of the above

Go to Module G.

MODULE G: EDUCATION OR EMPLOYMENT IN THE U.S.

G1. Did you ever attend elementary or secondary school in the United States?

 Yes

 No

G2. Did you receive any of the following degrees from a college or university within the U.S.?

	Yes	No
Doctoral degree or professional degree		
Master’s degree or certificate		
Bachelor’s degree (or its equivalent)		

G3. Have you ever been employed in the United States for a period of 30 days or longer?

 Yes

 No

G4. What is your gender? Select one response.

 Female

 Male

Go to Thank You screen and Exit.

CONCLUSION

Thank you! Your responses are very important to the National Science Foundation in understanding the research and career outcomes of NSF program participants. We appreciate the time you have taken to complete the survey. Your responses will be used to improve NSF programs and to provide a better understanding of support for talented STEM faculty, postdoctoral fellows, and graduate students.

The survey is now complete. You may close your internet browser or click Exit. <EXIT >

EXIT SCREEN

If we have identified the wrong respondent or have erroneous information, display this screen and FLAG this respondent for Abt follow-up (weekly basis)

Please accept our apology.

The information you supplied suggests that you are not eligible to participate in this study or that we have reached you in error. We regret any inconvenience to you. If you have any questions about this study or you would like to make a comment, please contact one of the following individuals:

• Dr. Carter Epstein, Study Director at Abt Associates: NSF_PIRE_Abt@abtassoc.com

• John Tsapogas, PIRE Program Evaluation Officer at the National Science Foundation: jtsapoga@nsf.gov

May we have permission to contact you by email in order to clarify your responses here? Answering “yes” does not obligate you to answer any questions.

 1=Yes, you may contact me. My preferred email address is: [textbox 150]

• 0=No, please do not contact me to clarify.

Thank you very much.

Appendix F: Foreign Investigator Survey 2