31450164 Supporting Statement Part B

3145-0164

Section B

Introduction

 B.1. Respondent Universe and Sampling Methods

The sample size is the entire universe of RDE projects. There will be an estimated average of 45 awards active each year. This number is expected to remain relatively stable throughout the clearance period, and data will be collected from each award each year. These projects are heterogeneous in terms of their research focus and their academic disciplines in the sciences, technology, engineering, and mathematics.

 

Population	Estimated Universe Size	Sample Size
RDE Awards	45	45

 

B.2. Information Collection Procedures/Limitations of the Study

This data collection will use a Web-based system. Each RDE award will provide answers once a year. These data are not a part of the hierarchy of evaluation study designs described in the ACC report, but they may serve as foundation work for later program evaluations. These data are a key element in NSF’s efforts to manage its program portfolio, to report on agency activities and goals, and to lay the groundwork for future evaluations.

B.2.1. Statistical Methodology for Stratification and Sample Selection

This collection is a census of all active RDE awards, so no sampling is required.

B.2.2. Estimation Procedure

Not applicable.

B.2.3. Degree of Accuracy Needed for the Purpose Described in the Justification

Not applicable.

B.2.4. Unusual Problems Requiring Specialized Sampling Procedures

Not applicable.

B.2.5. Use of Periodic (Less Frequent Than Annual) Data Collection Cycles

Not applicable.

B.3. Methods for Maximizing the Response Rate and Addressing Issues of Nonresponse

The collection is part of reporting required of awardees; principal investigators (PIs) are responsible for ensuring that data are collected from other center personnel and students. Similar annual collections for other EHR programs have had 100 percent response rates from PIs and graduate fellows, and NSF anticipates that this collection will have a similar response rate. Awardees were told when they received their awards that data will be collected on these programs, and they have been encouraged to collect data for use in their internal award management. In addition, the data collection period will be scheduled to fall during the school year, when awardees will be available to respond. Considerable effort will also made to follow up for non-response and incomplete responses with all respondents; this will be done by sending regular e-mails to award sites that have not logged into the system, by notifying all award sites still entering data when the system closing date is one week away, and by using additional email and phone follow-up as needed. After the first year of data collection is complete, NSF will review the response patterns and identify whether changes need to be made to the data collection period or to the follow-up methods in order to encourage and facilitate responses. Examples of the e-mail messages that will announce the opening of the system and remind awardees to log in and enter data are included in Appendix C.

B.4. Tests of Procedures or Methods

This collection follows the basic model of collections already in place at NSF and within the EHR directorate. In those systems, input is continually received from users and their suggestions are implemented as the system is upgraded. Other test methods used by the various collections include asking for feedback from PIs both as data are collected and during meetings and conferences, review by NSF staff, and testing performed by the system developer. This system will use these methods as well, taking feedback into consideration to ensure that the system is continually improved.

B.5. Names and Telephone Numbers of Individuals Consulted

The following individuals were consulted on the EHR Generic Clearance:

 

Agency Unit

Mark Leddy (703-292-5148), Division of Human Resource Development, National Science Foundation, 703-292-4655

William Neufeld (703-292-5148), Division of Research on Learning in Formal and Informal Settings, National Science Foundation, 703-292-5150

 

Contractor or Grantee

Lea Mesner, ICF Macro, (301) 657-3077.

 

 

3