0568 SS Part B 011017

SUPPORTING STATEMENT

OMB CONTROL NO: 0648-0568

National Oceanic and Atmospheric Administration: (1) Office of Education, Educational Partnership Program (EPP) with Minority Serving Institutions (MSI), (2) Ernest F. Hollings Undergraduate Scholarship Program; (3) Dr. Nancy Foster Scholarship Program; and, (4) National Marine Fisheries Service Recruitment, Training, and Research (RTR) Program

B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS

This section applies only to the student alumni form.

1. Describe (including a numerical estimate) the potential respondent universe and any sampling or other respondent selection method to be used. Data on the number of entities (e.g. establishments, State and local governmental units, households, or persons) in the universe and the corresponding sample are to be provided in tabular form. The tabulation must also include expected response rates for the collection as a whole. If the collection has been conducted before, provide the actual response rate achieved.

The alumni form was deployed online as the Voluntary Alumni Update System (VAUS) in 2014, at which time a response rate of 60% was targeted. Since then, 162 responses were received in the system for an average of 81 per year, a response rate of approximately 3%. In an effort to increase the response rate, OEd will circulate a reminder to complete the form three times annually, rather than once. As a result, the expected response rate has been revised to 10%, higher than the actual response rate, but below the previous estimate of 60%..

Table 2: Potential respondent universe and expected response rates

Population	Sample	Sample Size	Expected Response Rate 10%
EPP/MSI Cooperative Science Center Alumni	Census	1400	140
Ernest F. Hollings Scholarship Alumni	Census	1200	120
EPP/MSI Undergraduate Scholarship Alumni	Census	180	18
EPP/MSI Graduate Sciences Scholarship Alumni	Census	56	6
Nancy Foster Scholarship Alumni	Census	40	4
NMFS RTR Program Alumni	Census	150	15

2. Describe the procedures for the collection, including: the statistical methodology for stratification and sample selection; the estimation procedure; the degree of accuracy needed for the purpose described in the justification; any unusual problems requiring specialized sampling procedures; and any use of periodic (less frequent than annual) data collection cycles to reduce burden.

As there will be censuses of the respective populations, there will be no sampling.

3. Describe the methods used to maximize response rates and to deal with nonresponse. The accuracy and reliability of the information collected must be shown to be adequate for the intended uses. For collections based on sampling, a special justification must be provided if they will not yield "reliable" data that can be generalized to the universe studied.

• The questionnaire has been designed to be respondent-friendly (e.g., almost all questions are closed-ended, worded in a clear, easy to understand manner, and skip logic has been incorporated).

Addressing Nonresponses

• Several modalities are used to determine post-graduation outcomes and which mitigate non-responses by alumni themselves:

  1. OEd has commissioned a study, due for completion in Spring 2017, by Insight Policy Research, which surveyed more than 2,000 former scholars about their educational and employment achievements and whether their experience with NOAA programs helped them attain their goals. This study is covered by another data collection (OMB Control No. 0648-0721).

  2. OEd staff conducted thorough online searches on all OEd graduates, which produced current employment and academic information on approximately 70% of OEd program participants.

  3. A cohort of approximately 800 students was submitted in 2015 to National Student Clearinghouse, which uses algorithmic methods to determine whether or not students completed their undergraduate degrees and if they subsequently enrolled in a graduate degree program.

4. Describe any tests of procedures or methods to be undertaken. Tests are encouraged as effective means to refine collections, but if ten or more test respondents are involved OMB must give prior approval under the Paperwork Reduction Act.

Voluntary Alumni Data Form

The revised alumni form (not yet final) was provided to four NOAA student alumni scholars to complete.  NOAA OEd Silver Spring received data and feedback from the experience using the form.  The data was uploaded into the SPMTS and the feedback on the experience was shared with the system developer.

Sample

Responses from two users of the revised alumni data form regarding time to complete the form:

0. It took me perhaps 5 minutes max.

I recall this was fairly quick process.  I couldn't imagine it exceeding more than [7 minutes +/- 2 ]

5.  Provide the name and telephone number of individuals consulted on the statistical aspects of the design, and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.

Individuals Consulted on Statistical Design:

Dr. John Baek, Education Evaluator, NOAA Office of Education developed the statistical design for the proposed evaluation study.

If you have any questions about the statistical design of the study, please contact Dr. John Baek: john.baek@noaa.gov, 202-482-8189.

Individual Who Will Overseeing Data Collection and Analysis:

The evaluation system is designed to collect data through online survey systems. For Hollings and EPP, this is the Voluntary Alumni Update System. Nancy Foster will use Google Forms or Survey Monkey.

Todd Christenson, NOAA Office of Education (todd.christenson@noaa.gov, 301.628.2916) will be responsible for overseeing the automated data collection process and for overseeing the functioning and maintenance of the evaluation system for EPP and Hollings.

Seaberry Nachbar, Education Coordinator, NOAA Office of National Marine Sanctuaries (seaberry.nachbar@noaa.gov, 240-472-9892) will be responsible for initiating the automated data collection process and for ensuring the functioning and maintenance of the evaluation system for Nancy Foster.

Jim Berkson, Director, NMFS RTR Program (jim.berkson@noaa.gov, 352-294-0887) will be responsible for initiating the automated data collection process and for ensuring the functioning and maintenance of the evaluation system for the NMFS RTR program.

John Baek, Education Evaluator, NOAA Office of Education (john.baek@noaa.gov, 202-482-8189) will be responsible for coordinating the data collections and analyzing the data.

5