Supporting Statement A for
Effectiveness of the NIH Curriculum Supplements Programs and Career Resources Study (OD/OSE)
December 4, 2008
Name: Dave Vannier, Ph.D. (OD/OSE)
Address: 6100 Executive Blvd, Suite 3E01
Telephone: (301) 496-8741
Fax: (301) 402-3034
Email: vannierd@od.nih.gov
A.1 Circumstances Making the Collection of Information Necessary
This submission is a request for a reinstatement of OMB approval for a three-year generic clearance for OSE to conduct surveys on the use and usefulness of the NIH Curriculum Supplements programs and career resources. This follows on OMB approval #0925-0551, which expires 11/30/2008. This request is consistent with the OSE’s mission of enhancing student achievement and interest in science and science careers. Data collections will be conducted in accordance with Executive Order 12862, dated September 11, 1993, which directs federal agencies that provide significant services directly to the public to survey customers to determine the kind and quality of services they want and their level of satisfaction with existing services.
As of November 2008, 16 NIH Curriculum Supplements are in print and three are in development. Informal feedback on the supplements has been overwhelmingly positive, and OSE plans to continue with the project in the foreseeable future. Each year OSE spends one third of its budget, over $1,000,000, on the supplement projects. From concept to completion, it takes nearly four years to develop a supplement. OSE partnered with the National Science Foundation, WestEd and Abt Associates to conduct a survey of the effectiveness of the first three NIH Curriculum Supplements (OMB No. 3145-0192, expired 09/30/2004). This study was useful in gauging the implementation of these supplements and their effect on students. The supplements are an ongoing project, and it is imperative to continually evaluate their effectiveness. OSE has not systematically evaluated the teacher workshops on the curriculum supplements or the Women Are Scientists videos.
Data from surveys of supplement and career video customers and workshop attendees will be used in the ongoing assessment and future development of OSE’s major activities. Specifically, survey data will
Provide OSE with the information necessary to develop future supplements, effective workshops, and career resources;
Identify areas in the supplements that need to be updated or improved;
Provide information on new and more-effective science education projects;
Allow OSE to monitor the use and usefulness of new supplements and career resources as they are released;
Identify difficulties that customers experience that can be addressed on the OSE Web site;
Provide positive results that will encourage other educators to use the NIH curriculum supplements and career resources; and
Identify barriers to the successful implementation of the supplements and utilization of career resources.
Survey data will be analyzed by OSE staff and made available to the public on the OSE Web site.
Under OMB clearance 0925-0551, OSE sought to initiate the survey of Women Are Scientists customers. OMB asked that we defer this survey until January 2009, and the details are again described in this application. This request seeks to reinstate OMB clearance 0925-0551.
Surveys will be conducted electronically via the Web.
The proposed surveys will monitor and assess the NIH curriculum supplements programs and career resources. Other non-governmental organizations are using these resources and conducting similar workshops. To our knowledge, however, none have conducted rigorous studies of their effectiveness. Should we become aware of any such evaluation, we will work with the investigators to make sure that efforts are not duplicated. Posting our findings on the OSE Web site will inform any potential investigators of our activities.
The study of the first three NIH Curriculum Supplements (OMB No. 3145-0192) will serve as a guide to the surveys proposed herein so that we can compare data across time. This should lead to a richer understanding, especially in regard to the newer curriculum supplements.
No small businesses will be involved in this study.
Because of the large population size, OSE does not need to collect information frequently from the same people. Supplement, career resource and workshop customers would only be contacted once or twice over the three-year period. The burden to the respondent is very minimal. By using electronic surveys, the data collection burden on OSE staff is also not great. Without the proposed survey information, NIH has no systematic way of knowing whether the OSE programs are a wise use of taxpayer dollars.
This information collection fully complies with 5 CFR 1320.5(d)(2) guidelines.
A.8 Comments in Response to the Federal Register Notice and Efforts to Consult Outside the Agency
No consultation outside the Agency has occurred.
One e-mail comment was received on September 23, 2008 in response to the 60-day Federal Register notice (September 23, 2008, Volume 73, Number 185, page 54840):
From:
<bk1492@aol.com>
Date:
Tue,
23 Sep 2008 12:00:39 -0400
To:
<VANNIERD@OD.NIH.GOV>,
<AMERICANVOICES@MAIL.HOUSE.GOV>, <INFO@TAXPAYER.NET>,
<MEDIA@CAGW.ORG>, <MEMBER@CITIZEN.ORG>
Subject:
Fwd:
WE HAVE AN EDUCATION DEPT - DONT NEED TWO DEPTS DOING SAME WORK
b
sachau
WE DONT NEED BIG PHARMA OR MEDICAL INDUSTRY TO DO
CHILDREN'S EDUCATION. WE HAVE A US DEPT OF EDUCATION THAT IS IN
CHARGE OF CHILDREN'S EDUCATION. WHY DO TAXPAYERS NEED TO FUND TWO
DEPTS TO DO THE SAME EXACT THING. THAT IS WHY TAXES ARE SO
BURDENSOME.
SECONDLY THESE ARE HIGH PRICED RESEARCHERS AT
NIH. WHY ARE THEY INVOLVED IN CHIDLREN'S EDUCATION. THEY SHOULD BE
FINDING CURES FOR AUTISM, ETC. THEY SHOULD BE RESEARCHING TO
HELP AMERICA.
THIS MAKES NO SENSE AT ALL TO ME.
B.
SACHAU
15 ELMST
FLORHAM PARK NJ 07932
The teacher workshop evaluation involves a longer survey sent to subgroups of interest. To ensure a high response rate and compensate for the burden, we propose sending teachers who complete the long workshop survey an honorarium of $25. Teachers are professionals with very limited time. The stipend ensures their participation and reinforces their importance to NIH’s educational efforts.
Respondents to all other surveys will be thanked in a letter, but not compensated with cash.
The data collected will fully comply with the NIH Privacy Act, Federal Register, September 26, 2002, Vol. 67, No. 187, page 60765-60768/09-25-2561. The Privacy Act may apply to some data collection activities. When the Privacy Act is applicable, respondents will be told:
the purpose for which the information is being asked,
the statutory authorization for asking for the information,
whether or not responding to the request for information, in whole or in part, is voluntary,
the consequences, if any, of not responding, and
the extent of confidentiality.
All respondents will be assured that their participation is voluntary, that not responding will not affect them adversely, and that their comments and opinions will be kept confidential. However, within the OSE, the data will be reviewed to identify trends, make decisions, study impact, determine direction of program, etc. Names of respondents will not be recorded.
No sensitive questions will be asked. No personally identifiable information will be collected.
A.12 Estimates of Hour Burden Including Annualized Hourly Costs:
The estimated annual burden for all of the proposed surveys is 1,146 hours:
Survey of NIH Curriculum Supplement customers
Table 1: Annualized Burden Hours for Survey Responders
Type of Respondent: Survey Title |
Total Number of Respondents |
Frequency of Response |
Ave. Time per Response |
Hour Burden per year |
Teacher: supplement requestor survey |
16,000 |
1 |
0.17 hours |
910 hours |
Teacher: career video survey |
1,500 |
1 |
0.17 hours |
85 hours |
Teacher: workshop short survey |
2,000 |
1 |
0.17 hours |
117 hours |
Teacher: workshop long survey |
200 |
1 |
0.5 hours |
34 hours |
Total |
19,700 in three year period |
|
|
1,146 hours per year |
Table 2: Annualized Respondent Cost
Type of Respondent |
Total Number of Respondents |
Frequency of Response |
Hourly Wage Rate |
Respondent Cost per year |
Teacher: supplement requestor survey |
16,000 |
1 |
$35 |
$31,850 |
Teacher: career video survey |
1,500 |
1 |
$35 |
$2,975 |
Teacher: workshop short survey |
2,000 |
1 |
$35 |
$4,025 |
Teacher: workshop long survey |
200 |
1 |
$35 |
$4,550 |
Total |
19,700 in three year period |
|
|
$43,400 per year |
Note: Median income of a secondary-school teacher is $47,900/year, according to Bureau of Labor Statistics 2007 data. This roughly translates to $35/hour.
A.13 Estimate of Other Total Annual Cost Burden to Respondents or Record Keepers
No capital, start-up, or operational and maintenance costs are incurred by study participants in our information collection activities.
The estimated annualized cost to the federal government is $20,000. The costs are based on using OSE staff to conduct all activities, not an outside contractor.
Planning Stage $2,750
Data Collection $500
Data Analysis & Report $3,000
Planning Stage $2,750
Data Collection $2,000
Data Analysis & Report $9,000
This is a reinstated collection of information. Certain surveys and burden hours have been changed from the previous OMB clearance (No. 0925-0551). Specifically, a survey of “Careers in Science” requestors and focus groups of NIH curriculum supplement requestors were deleted due to reduced OSE staff. The burden hours for the Survey of NIH Curriculum Supplement customers was increased because there are now more people in this pool. The burden hours for the Teacher Workshop Short Follow-up Survey was also increased for this reason.
The survey data will be used to assess the effectiveness of these NIH programs. The results will help shape future programs as well. We do not anticipate publishing the results in a peer-reviewed journal. Evaluation reports will be posted on the OSE Web site.
Teacher Workshop Evaluations: During year 1, OSE will send short surveys to 2,000 randomly-selected teachers who attended a workshop during FY 02 – 08. In years 2 and 3, OSE will send 100 longer surveys per year. The long survey will be drafted after the results from the short survey have been reviewed. The long survey will not be sent until approved by OMB.
Activity: Year 1 |
Time Schedule: Year 1 |
Short survey of workshop participants from FY 02 – 08. |
1 month after OMB approval |
Responses collected |
2 - 3 months after OMB approval |
Results tabulated and analyzed. Subgroups identified for further analysis |
4 - 8 months after OMB approval |
Short survey report released Long survey for subgroups drafted and sent into OMB for approval |
8 - 12 months after OMB approval |
Activity: Years 2 & 3 |
Time Schedule: Year 2 & 3 |
Long survey sent to select populations from previous year |
2 weeks after OMB approves long survey. |
Responses collected |
1 –2 months after responses received |
Results tabulated and analyzed |
Last quarter of year |
Report released |
Last quarter of year |
Survey of NIH Curriculum Supplement and Career Video Customers: These surveys will occur once during the 3-year period of OMB clearance. The precise survey instruments have yet to be drafted and are not submitted with this proposal.
Activity |
Time Schedule |
Survey of supplement customers |
Month 1 – 6 immediately after survey is OMB approved. |
Results tabulated and analyzed |
|
Report released |
Month 10 after OMB approval |
The expiration date will be displayed on all instruments approved for this study.
This collection of information involves no exceptions to the Certification for Paperwork Reduction Act Submissions.
-
| File Type | application/msword |
| File Title | Date |
| Author | IsomC |
| Last Modified By | curriem |
| File Modified | 2008-12-04 |
| File Created | 2008-12-04 |