SRAE PAS Supporting Statement A_2024 ext_11.15.2024

Alternative Supporting Statement for Information Collections Designed for

Research, Public Health Surveillance, and Program Evaluation Purposes

Sexual Risk Avoidance Education Program Performance Analysis Study

(SRAE PAS)

OMB Information Collection Request

0970-0536

Supporting Statement

Part A

Type of Request: Extension

November 2024

Submitted By:

Office of Planning, Research, and Evaluation

Administration for Children and Families

U.S. Department of Health and Human Services

4^th Floor, Mary E. Switzer Building

330 C Street, SW

Washington, D.C. 20201

Project Officers:

Caryn Blitz, Selma Caal

Part A

Executive Summary

• Type of Request: This Information Collection Request (ICR) is for an extension without change to continue the ongoing information collection for the Sexual Risk Avoidance Education Performance Analysis Study (SRAE PAS). We are requesting an extension until additional updates, as described in this request, are finalized.

• Description of Request: The goal of the SRAE PAS is to collect performance measures data from SRAE grant recipients and their program participants ages 10–20 on: the characteristics of youth involved in programming; youth sexual behavior, sexual behavior intentions, and behaviors relevant to the success sequence;¹ the range of services youth receive; program structure, cost, and support for implementation; program attendance, reach, and dosage; how programs addressed the A–F topics;² and youth outcomes at program exit. The performance measures have and will continue to allow both the Administration for Children and Families (ACF) program office and grant recipients to monitor and report on progress in implementing SRAE programs and informs technical assistance. The data collected in the study are not intended to be generalized to a broader population. We do not intend for this information to be used as the principal basis for public policy decisions.

• Progress to Date: OMB originally approved the information collection in October 2019, and grant recipients have been collecting SRAE PAS data since January 2020. In the most recently completed reporting year (2022-2023), performance measures data were submitted for 182 grants and 465 program providers, including entry survey data for 203,933 youth participants and exit survey data for 159,260 participants.

• Timeline and Time Sensitivities: There were no challenges to meeting the original timeline. SRAE grant recipients have been collecting and submitting performance measures data on an ongoing basis since January 2020. The current OMB expiration date is January 31, 2025. ACF was planning to submit a request to update sexual orientation and gender identity (SOGI) items once additional guidance was available and measures for youth-serving programs had been tested (see “Previous Terms of Clearance” below). This work is still in progress so at this time ACF is requesting an additional extension without change to allow grant recipients to continue collecting and submitting data as they provide programming to additional cohorts of youth while work continues on SOGI items.

ACF requests approval of the extension before the current approval expires in January 2025 so that grant recipients only have to update the expiration date once, as the process to update the expiration date more than once is confusing and costly.

• Previous Terms of Clearance: The Notice of Action (NOA) received on January 9, 2024, stated that the request was “approved for 1-year consistent with the understanding that ACF will submit changes to include replacement of its binary sex question across instruments for a more inclusive gender base question(s) upon completion of agency testing and discussions. The agency should collaborate with OMB for the specific changes.” Since then, ACF has continued efforts to improve the survey questions on SOGI and race/ethnicity to better represent the range of participants, as well as to align with a White House Executive Order and guidance from OMB. The HHS SOGI Data Plan was approved in June 2024. As part of an agency-wide initiative to select SOGI items, ACF is beginning a process of pretesting potential SOGI questions with youth, including youth participating in SRAE programs. When this process is complete, ACF plans to replace the current binary sex question in the SRAE PAS participant entry and exit surveys item with the new items. However, to allow time for the pretesting of the new items to be completed, we currently request an extension without change but with terms included to specify that once this work is completed, ACF will submit updated surveys to OMB for review and approval.

A1. Necessity for Collection

The consequences of adolescent sexual activity remain a critical social and economic issue in the United States, shaping the lives of thousands of teens and their families every year. Despite declining births to teen mothers over the past 25 years, the teen birthrate in the United States remains higher than in other industrialized countries and varies widely across geographic regions and racial/ethnic groups (Martin et al., 2017). Further, adolescents and young adults account for half of all new sexually transmitted infection (STI) cases each year (Centers for Disease Control and Prevention, 2017). Sexual activity in youth is also related to engaging in other risk behaviors, such as alcohol and substance use.

The Sexual Risk Avoidance Education (SRAE) Program targets these issues. SRAE is funded generally under the authority of Title V, Section 510 of the Social Security Act, 42 U.S.C. § 1310, and specifically by the appropriation for General Departmental Management for the Office of the Secretary under Division H, Title II of the Consolidated Appropriations Act, 2016, Pub. L. 114-113. As updated by Congress in FY2018, the legislation enables grant recipients to “implement education exclusively on sexual risk avoidance (meaning voluntarily refraining from nonmarital sexual activity)” and permits including medically accurate information on contraception that ensures program participants understand that contraception offers physical risk reduction and not risk elimination. The legislation also includes A–F criteria to ensure youth receive a variety of information to improve their future health and well-being.

With this information collection extension request, the Family and Youth Services Bureau (FYSB) and Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) at the Department of Health and Human Services (HHS) seek approval to continue collecting performance measures data from SRAE grant recipients, program providers, and youth participants. The collection and analysis of performance measures plays a unique role in the mix of current federal evaluation efforts to expand the evidence base on teen pregnancy prevention programs. The SRAE PAS is the first federal effort to collect performance measures data on sexual risk avoidance programs. This descriptive study will allow both the program office and grant recipients to continue to monitor and report on progress in implementing SRAE programs.

The Government Performance and Results Act (GPRA) Modernization Act of 2010 (Public Law 111-352) requires federal agencies to report annually on measures of program performance. It is essential that SRAE grant recipients submit the performance data described in this ICR to enable ACF to carry out its reporting requirements to the Office of Management and Budget (OMB). Further, collecting these data will allow grant recipients and ACF to report to other key stakeholders on SRAE program design, implementation, and outcomes.

A2. Purpose

Purpose and Use

The objective of the SRAE performance measures effort is to document how SRAE-funded programs are operationalized in the field and assess program outcomes. The performance measures data will continue to be used by the program office and SRAE grant recipients to monitor and report on implementation progress and inform continuous quality improvement of SRAE programs. The data provide ACF with up-to-date information on youth participant characteristics, service receipt, and outcomes, and on program infrastructure, reach and scope, and program content. ACF uses the information to (1) assess whether SRAE objectives are being met (e.g., in terms of the populations served); (2) provide technical assistance to help drive programs toward continuous improvement of service delivery; and (3) fulfill reporting requirements to OMB concerning the SRAE initiative. ACF also shares grant recipient- and subrecipient-level findings with each grant recipient to inform their own program improvement efforts. In addition, ACF data are and will be used in public-facing reports and fact sheets targeted to broader audiences, including practitioners.

The information collected is meant to contribute to the body of knowledge on ACF programs. It is not intended to be used as the principal basis for a decision by a federal decision-maker, and is not expected to meet the threshold of influential or highly influential scientific information.

Research Questions

The performance measures will continue to provide insight into questions related to program and participant characteristics, program inputs and outputs, and participant outcomes. Key questions include the following:

• Questions related to grant recipients’ management of their grant(s):

• How many grant recipients awarded sub-awards to subrecipient program providers to implement programming?

• How do grant recipients support program providers’ implementation of SRAE programs?

• How did grant recipients allocate their SRAE budgets?

• Questions related to program providers’ delivery of their program(s):

• What proportion of program providers provided services through schools, versus community-based settings, versus other settings?

• What proportion of program providers addressed each of the A–F topics?

• What was the program provider’s program budget?

• Questions related to program instructors:

• How many facilitators and educators are employed in providing SRAE programming?

• What proportion of program instructors received training in the programs they implemented?

• To what extent are program instructors monitored to ensure program quality?

• Questions related to program participants:

• How many youth were served by SRAE programs?

• What were the characteristics (e.g., demographics) of the youth served?

• At program exit, what influences did youth participants perceive the program had on their knowledge, attitudes, and behavioral intentions related to the topics covered in SRAE programs? For example, what percentage of youth participants reported at program exit that participating in SRAE made them more likely to intend to delay having sex?

• What trends in participant outcomes can be identified over time? For example, for each successive year of the SRAE Program, how do outcomes related to knowledge, attitudes, and behaviors compare to previous years’ outcomes?

A major objective of the performance measures analysis is to construct, for grant recipients and ACF, a picture of SRAE implementation in the form of a basic set of statistics across all grants. These statistics, for example, will continue to answer questions for the overall SRAE programs, such as the following:

• What programs were implemented, and for how many youth?

• What are the characteristics of the populations served?

• To what extent were members of vulnerable populations served?

• How many youth participated in most program sessions or activities?

• How many entities are involved at the subrecipient level in delivering programs?

• How do grant recipients allocate their resources?

• How do participants feel about the program, and how do they perceive its effect on them?

• What challenges do providers experience in implementing SRAE programs?

Study Design

SRAE PAS is an ongoing descriptive study that collects performance measures data from SRAE grant recipients, program providers, and participants to allow both the program office and grant recipients to continue to monitor and report on progress in implementing SRAE programs. The study design reflects the multiple layers that grant recipients use to support program delivery. For example, some grant recipients directly implement the programs, and others deliver programs through subrecipient providers. The data that the grant recipients submit to ACF will continue to originate from three levels of respondents: the grant recipient, program provider(s), and youth participants (Figure A2.1). For some performance measures, grant recipients will continue to provide data about activities or decisions that they undertake directly at the grant level. For other measures, data will continue to come from the program providers to the grant recipient because providers are the ones implementing the activities to be documented. In addition, some data will continue to come from the youth themselves via entry and exit surveys. As in past years, the grant recipients will be responsible for ensuring that all performance measures are submitted to ACF.

Figure A2.1. Levels of Performance Measures Data

As part of an agency-wide initiative to select SOGI items, ACF is beginning a process of pretesting potential SOGI questions with youth, including youth participating in SRAE programs. When this process is complete, ACF plans to replace the current binary sex question in the SRAE PAS participant entry and exit surveys with the new items. ACF is also reviewing the race and ethnicity items in relation to updated guidance through the Statistical Policy Directive 15: Standards for Maintaining, Collecting, and Presenting Federal Data on Race and Ethnicity (SPD 15) (89 FR 22182). No changes are proposed at this time, but ACF is reviewing these elements and the updated guidance and currently plans to update these items when we make changes to the SOGI items.

The study involves continuing to collect data via the previously OMB-approved set of instruments (attached) developed for the collection of SRAE performance measures:

• Instrument 1: Participant entry survey

• Instrument 2: Participant exit survey

• Instrument 3: Performance Reporting System Data Entry Form

• Instrument 4: Subrecipient Data Collection and Reporting Form

The participant entry and exit surveys (Instruments 1 and 2) will continue to collect youth self-report data on youth demographics and special population status (e.g., foster care, homelessness, adjudicated, etc.). The participant entry survey also collects information on participants’ prior sexual behaviors, other behaviors, knowledge, and attitudes about the A–F topics, including the success sequence. The participant exit survey also collects information on participants’ perceptions that their participation in the program had an influence on their sexual behavior and other behavior intentions (e.g., intentions to avoid sex) and on their knowledge and attitudes relating to other A–F topics. There are four versions of the entry survey (Instruments 1, 1a, 1b, and 1c) and two versions of the exit survey (Instruments 2 and 2a).

• Instrument 1: Entry survey for high school and older youth

• Instrument 1a: Entry survey for middle school youth

• Instrument 1b: Entry survey for high school and older youth in programs with impact evaluations

• Instrument 1c: Entry survey for middle school youth in programs with impact evaluations

• Instrument 2: Exit survey for high school and older youth

• Instrument 2a: Exit survey for middle school youth

The versions for middle school youth exclude some of the more sensitive items. The entry survey versions for programs with impact evaluations include only a limited number of questions, to decrease burden due to grant recipients’ participation in other studies that often include extensive surveys. Programs with impact evaluations use the same version of the exit surveys as other programs³.

The program-level data collection forms (Instruments 3 and 4) will continue to be used by grant recipients and subrecipient program providers to submit their data on SRAE program structure and delivery:

• SRAE program structure refers to how grant funds are being used; the program models selected; their coverage of the required A–F topics; the ways in which grant recipients and subrecipients support program implementation; and the characteristics of the youth served, including attendance, reach, and dosage. This information will continue to be collected from the grant recipients (Instrument 3) and their subrecipient program providers (Instrument 4). Subrecipients submit their data on these topics to grant recipients, who then compile this information and submit it to ACF once a year (Instrument 3).

• SRAE program delivery refers to the extent to which the intended program dosage is delivered, youths’ attendance, and challenges experienced in implementing the programs. This information will continue to be collected from program providers (Instrument 4) and submitted to ACF by the grant recipients twice a year (Instrument 3).

The performance measures data will continue to be submitted by grant recipients to the SRAE Performance Measures Data Portal, which the contractors developed and maintain. The frequency with which performance data are collected and submitted by grant recipients is summarized in Table A2.1.

Table A2.1. Collection Frequency for Performance Measures Data

Data Collection Instrument/Content	Respondent	Frequency of Collectiona	Frequency of Submission to ACF
#1 Participant Entry Survey	Youth participants
Demographics; sexual behaviors and intentions; pregnancy history		At program entry	Twice a year
#2 Participant Exit Survey	Youth participants
Demographics; participant perceptions of program effects on sexual intentions and other behaviors; participant assessments of program experiences		At program exit	Twice a year
#3 Grant Recipient Performance Reporting Data Entry Form	SRAE grant recipients
Total respondent counts by measures of attendance, reach, and dosage; program completion by cohort Administrative data on measures of structure, cost, and support for program implementation		At cohort completion Once a year	Twice a year Once a year
#4 Subrecipient Data Collection and Reporting Form	Subrecipient program providers
Respondent counts by measures of attendance, reach, and dosage; program completion by cohort Administrative data on measures of structure, cost, and support for program implementation (including program characteristics; staffing training and observation; and implementation challenges and technical assistance needs)		At cohort completion Once a year	Twice a year Once a year

^a “Collection frequency” refers to when grant recipients, their subrecipients, and program staff collect the data that are later compiled and submitted to ACF. Grant recipients submit the data twice a year to ACF in order to inform continuous quality improvement.

The SRAE PAS is designed to describe the implementation and outcomes of the SRAE Program. The performance measures data will continue to provide necessary information to ACF to effectively manage and report on the program and for grant recipients to use for continuous quality improvement.

The performance measures data cover the entire universe of SRAE grant recipients, programs, and participants, but are not designed to be representative of or generalizable to any other population. A limitation to the study is the reliance on youths’ completion of entry and exit surveys and grant recipients’ submission of all data.

Other Data Sources and Uses of Information

This ICR covers all data to be collected for the ongoing SRAE PAS study. Revisions are planned over the next year and revised material will be submitted for review and approval when finalized.

In addition to the original purposes for which the performance measures data are collected, a subset of the data elements will be shared with the contractor conducting activities for the SRAE National Evaluation (SRAENE), for which a number of formative data collections will occur⁴. The SRAENE contractor will use the performance measures data rather than requesting similar information from grant recipients, thereby avoiding duplication of data collection effort.

A3. Use of Information Technology to Reduce Burden

To comply with the Paperwork Reduction Act of 1995 (Pub. L. 104-13) and to reduce grant recipient burden, ACF is continuing to (1) provide common data element definitions across SRAE grants and program models, (2) obtain these data from grant recipients in a uniform manner through the SRAE Performance Measures Data Portal, (3) use the Portal to calculate common performance measures across grants and program models, and (4) maintain an SRAE Performance Measures Dashboard (Dashboard) that is interoperable with the Portal to provide near-real-time data reporting for SRAE grant recipients, FYSB project officers, and other ACF staff. Using the Portal reduces data submission burden, minimizing grant recipient and subrecipient costs related to the data submission requirements. Implementing the Dashboard reduces data analysis and report production time so that grant recipients can receive near-real-time data and customized reports through an interactive data dashboard.

A4. Use of Existing Data: Efforts to reduce duplication, minimize burden, and increase utility and government efficiency

ACF has carefully reviewed the information collection requirements to avoid duplication with existing studies and believes that this requested data collection complements, rather than duplicates, the existing literature and other ongoing evaluations and projects. Although performance measures data have been collected for other teen pregnancy prevention programs, SRAE PAS is the first study to collect performance measures data for SRAE programs. The SRAE Performance Measures Data Portal was designed to minimize burden of data submission, and the SRAE dashboard is intended to increase access and utility of the measures to both grant recipients and ACF staff.

A5. Impact on Small Businesses

SRAE programs in some sites may be operated by community-based organizations. ACF and its contractor teams will continue to provide thorough training and technical assistance throughout the entire data collection effort, from the planning period through data analysis. This training and technical assistance should help to minimize the burden on small organizations.

A6. Consequences of Less Frequent Collection

GPRA requires federal agencies to report annually on measures of program performance. Therefore, it is essential that grant recipients continue to submit the performance data described in this ICR to ACF. Failure to obtain performance measures across all grant recipients will inhibit ACF from carrying out its reporting requirements to OMB. Further, failure to obtain data will inhibit grant recipients and ACF from reporting to other key stakeholders on SRAE program design, implementation, and outcomes. In addition, collection of some measures twice a year assists grant recipients in making mid-course corrections as part of their continuous quality improvement efforts; the SRAE Performance Measures Dashboard is updated twice a year to display the most recent information for this purpose.

A7. Now subsumed under 2(b) above and 10 (below)

A8. Consultation

Federal Register Notice and Comments

In accordance with the Paperwork Reduction Act of 1995 (Pub. L. 104-13) and Office of Management and Budget (OMB) regulations at 5 CFR Part 1320 (60 FR 44978, August 29, 1995), ACF published a notice in the Federal Register announcing the agency’s intention to request an OMB review of this information collection activity. This notice was published on September 16, 2024 (89 FR 75542) and provided a sixty-day period for public comment. During the notice and comment period, no substantive comments were received.

Consultation with Experts Outside of the Study

The contract team developed the SRAE performance measures in consultation with staff from FYSB and OPRE and select SRAE grant recipients, as well as FYSB and ACF leadership.

A9. Tokens of Appreciation

No tokens of appreciation are proposed for the information collection.

A10. Privacy: Procedures to protect privacy of information, while maximizing data sharing

Personally Identifiable Information

As in past years, no personally identifiable information will be collected by ACF and its contractors.

Assurances of Privacy

As with earlier rounds of SRAE performance measures data, information collected will be kept private to the extent permitted by law. Respondents will be informed of all planned uses of data, that their participation is voluntary, and that their information will be kept private to the extent permitted by law.

At least some of the information collected under this ICR will likely be retrieved by an individual’s personal identifier in a way that triggers the Privacy Act of 1974, as amended (5 U.S.C. 552a). The system of records notice (SORN) for this collection is OPRE Research and Evaluation Project Records, 09-80-0361. Each individual will be provided with information that complies with 552a(e)(3) prior to being asked for information that will be placed into that system of records. This means respondents will receive information about the authority, the purposes for use, the routine uses, that the request is voluntary, and any effects of not providing the requested information. As specified in the contract, the Contractor will comply with all Federal and Departmental regulations for private information.

Data Security and Monitoring

Participant-level data. Grant recipients and their subrecipient program providers will continue to gather the participant-level data required for performance measures reporting. Grant recipients then enter this information into the SRAE Performance Measures Data Portal, without any personally identifiable information. Grant recipients and program providers are responsible for ensuring privacy of participant-level data and securing institutional review board (IRB) approvals to collect data, as necessary. Grant recipients are required to inform participants of the steps being taken to protect the privacy of their answers. The following language is also included on the first page of Instrument 1 and Instrument 2:

• The purpose of the information collection and how the information is planned to be used to further the proper performance of the functions of the agency;

• An estimate of the time to complete the instrument;

• That the collection of information is voluntary; and

• That responses will be kept private to the extent permitted by law.

• The statement that an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number, followed by the OMB number for this information collection (0970-0536) and the new expiration date.

Grant-level data. Grant recipients will continue to enter all data into the SRAE Performance Measures Data Portal maintained by the contractor. The Portal was designed to ensure the security of data maintained there. The Portal is a research cloud-based system that provides the appropriate level of security based on the sensitivity or identifiability of the data. Further, no personal identifiers are submitted to ACF.

The contractor will also continue to maintain the SRAE Performance Measures Dashboard to provide authorized stakeholders with self-service access to various views of performance indicators that support the management and on all of the SRAE performance measures. The Dashboard displays data at the grant and national levels and allows users to drill down along dimensions of interest, such as time or curriculum. As needed, the contractor enforces security roles to prohibit grant recipients from accessing others’ data.

A11. Sensitive Information

A key objective of SRAE programs is to prevent teen pregnancy through a decrease in nonmarital sexual activity. We understand that issues pertaining to the sexual behavior of youth and young adults can be very sensitive in nature; however, the questions for the programs’ performance measures are necessary to understanding program functioning. Table A11.1 provides a list of sensitive questions that are included in the existing participant entry and exit surveys and will continue to be asked, along with the justification for their inclusion. Supporting references for inclusion of sensitive questions or groups of questions are included at the end of this document.

Table A11.1. Summary of Sensitive Questions Included on the Participant Entry and Exit Surveys, and their Justification

Topic	Justification
Participant Entry Survey (Instrument #1)
Vulnerable populations (Question 7; also on the Exit Survey)	This question allows us to document the extent to which SRAE programs serve foster care, homeless, and adjudicated youth.
Use of alcohol, tobacco, and other substances (Question 8; also on the Exit Survey)	Collection of this information allows us to document the characteristics of the population served by SRAE programs and the degree to which they engage in risky behavior.
Sexual activity and incidence of pregnancy and sexually transmitted infections (STIs) (Questions 13–15)	Level of sexual activity and incidence of pregnancy and STIs are central to the goals of the programs. Collecting this information allows us to document the characteristics of the population served by SRAE programs and the degree to which they engage in risky behavior.
Participant Exit Survey (Instrument #2)
Participants’ perceptions of SRAE’s effects on their sexual activity (Questions 12–13)	Reducing intentions to engage in sexual activity is among the central goals of SRAE-funded programs. Examining whether participating youth consider SRAE programs to be effective in achieving these goals is an important element of gauging the success of these programs.

All grant recipients are encouraged to collect data on all questions, if possible. Grant recipients will continue to inform program participants that their participation is voluntary, and they may refuse to answer any or all of the questions in the entry and exit surveys. All grant recipients have the opportunity to opt out of asking sensitive questions if necessary.

A12. Burden

Explanation of Burden Estimates

Table A12.1 provides the estimated annual burden calculations for the performance measures data submission. Respondents include the estimated 192 SRAE grant recipients (119 General Departmental SRAE (GDSRAE), 39 State SRAE (SSRAE), and 34 Competitive SRAE (CSRAE) grant recipients), their subrecipient program providers, and youth participants.

Annual Performance Measures Burden for Youth Participants

We estimate the number of participants completing these surveys based on performance measures data submitted by SRAE grant recipients on the number of youth targeted. The amount of time it will take for youth to complete the entry and exit surveys is estimated based on the pretest of the entry and exit surveys (see SSB for additional information) and experience administering similar surveys to youth participants.

Participant entry survey. SRAE grant recipients are expected to serve approximately 488,315 new participants per year (numbers not shown in table). Applying a 95 percent response rate to the participants, we anticipate 463,899 respondents to the entry survey each year (488,315 x 0.95 = 463,899). Based on the pre-test and experience with similar instruments, the participant entry survey is estimated to take 8 minutes (0.1333 hour) to complete.

Participant exit survey. It is estimated that about 20 percent of the participants will drop out of the program prior to completion, leaving approximately 390,652 participants at the end of the program annually (488,315 x 0.8 = 390,652; numbers not shown in table).⁵ Of those, we expect 95 percent, or approximately 371,119 participants, will complete the participant exit survey each year (390,652 x 0.95 = 371,119). Based on the pre-test and experience with similar surveys, the exit survey is estimated to take youth 10 minutes (0.1667 hours) to complete.

Annual Performance Measures Burden for Grant recipients and Subrecipients

As in earlier years of SRAE performance measures data collection, all 192 SRAE grant recipients will be required to submit the required performance measures into the SRAE Performance Measures Data Portal twice a year. They will continue to gather this information with the assistance of their subrecipients (estimated to be 741 across all grants).⁶ Time for a designated grant recipient administrator to aggregate the data across each of the grant’s subrecipients and submit all of the required data into the Portal is included in the burden estimates, along with time to collect information at the grant level that pertain to grant structure, cost, and support for program implementation. The grant recipient and subrecipient data collection efforts described below are record-keeping tasks.

Performance Reporting System Data Entry Form. This form includes all of the required data elements that the grant recipient will continue to collect, aggregate, and submit into the SRAE Performance Measures Data Portal (see Instrument 3). Time for these activities is estimated to be 16 hours per response per grant recipient.

Subrecipient Data Collection and Reporting Form. The subrecipients will continue to conduct multiple activities to support the Performance Analysis Study each year (see Instrument 4). They aggregate the participant-level entry and exit survey data (see Instruments 1 and 2) and on attendance and program session hours, report to the grant recipient on implementation challenges and needs for technical assistance, and report to the grant recipient on subrecipient structure, cost, and support for program implementation.

Estimated Annualized Cost to Respondents

Total Annual Cost for Youth Participants

The estimated average hourly wage for the youth sample that is over 18 is $7.25, the federal minimum wage.⁷ We estimate that 10 percent of the youth sample will be over 18, based on a review of SRAE grant applications and the anticipated number of youth 18 or older served by SRAE grant recipients. The total annual cost for youth participants is of $89,685 for both the entry and exit surveys.

Total Annual Cost for Grant recipients and Subrecipients

The annual cost for grant recipients is estimated to be $174,244 (6,144 hours x$28.36). The hourly wage rate represents the mean hourly wage rate for community and social service occupations (job code 21-0000; $28.36).⁸

Total Annual Burden and Cost Estimates

A total annual burden of 149,113 hours (and cost of $810,313) is requested in this ICR. This includes time and cost for performance measures data collection associated with participants, grant recipients, and subrecipients.

Table A12.1. Total Burden Requested Under this Information Collection, by Grant Recipient Type

Instrument	Type of Grant	No. of Respondents (total over request period)	No. of Responses per Respondent (total over request period)	Avg. Burden per Response (in hours)	Total Burden (in hours)	Annual Burden (in hours)	Average Hourly Wage Ratea	Total Annual Respondent Cost
1. Participant Entry Survey	GDSRAE	126,130	1	0.1333	16,813	16,813	$7.25	$12,189b
	SSRAE	317,633	1	0.1333	42,340	42,340	$7.25	$30,697b
	CSRAE	20,136	1	0.1333	2,684	2,684	$7.25	$1,946b
Totals for Participant Entry Survey		463,899	1	0.1333	61,837	61,837	$7.25	$44,832b
2. Participant Exit Survey	GDSRAE	100,904	1	0.1667	16,821	16,821	$7.25	$12,195b
	SSRAE	254,106	1	0.1667	42,360	42,360	$7.25	$30,711b
	CSRAE	16,109	1	0.1667	2,685	2,685	$7.25	$1,947b
Totals for Participant Exit Survey		371,119	1	0.1667	61,866	61,866c	$7.25	$44,853b
3. Performance Reporting Data Entry Form (Record-keeping)	GDSRAE	119	2	16	3,808	3,808	$28.36	$107,995
	SSRAE	39	2	16	1,248	1,248	$28.36	$35,393
	CSRAE	34	2	16	1,088	1,088	$28.36	$30,856
Totals for Performance Reporting Data Entry Form		192	2	16	6,144	6,144	$28.36	$174,244c
4. Subrecipient Data Collection and Reporting Form (Record-keeping)	GDSRAE	252	2	13	6,552	6,552	$28.36	$185,815
	SSRAE	426	2	13	11,076	11,076	$28.36	$314,115
	CSRAE	63	2	13	1,638	1,638	$28.36	$46,454
Totals for Subrecipient Data Collection and Reporting Form		741	2	13	19,266	19,266	$28.36	$546,384c
Total					149,113	149,113		$810,313

^a For Instruments 1 and 2, the average hourly wage is the Federal Minimum Wage, U.S. Department of Labor: https://www.bls.gov/cps/cpsaat44.pdf, and calculations using that wage are based on respondents aged 18 years or older. For Instruments 3 and 4, the hourly wage rate represents the mean hourly wage rate for community and social service occupations ($28.36) (National Occupational Employment and Wage Estimates, Bureau of Labor Statistics, Department of Labor, May 2023).

^b For Instruments 1 and 2, calculations of total annual cost are based on the 10% of respondents estimated to be age 18 or older.

^c Any differences between this value and the computed sum of the values above are due to rounding.

A13. Costs

There are no additional costs to respondents.

A14. Estimated Annualized Costs to the Federal Government

The annual cost to the federal government for development, collection, and analysis of the SRAE performance measures is estimated to be $801,003.

Cost Category	Estimated Costs
Operating Portal for Biannual Data Submission	$191,791
Maintaining Dashboard	$116,093
Training and Technical Assistance	$180,505
Analysis and Reporting	$127,825
Dissemination	$46,916
Other SRAE PAS Tasks	$137,874
Total annual costs	$801,003

A15. Reasons for changes in burden

This is a request to continue an existing information collection. Through this request process minor discrepancies were noted between the OMB-approved instruments and those currently in use. These minor errors were fixed in the versions included with this request. There are no changes to hourly burden estimates. Cost estimates in section A12 have been updated to reflect the most recent wage data from the BLS.

A16. Timeline

Grant recipients submit performance measures data twice a year (each July and January), as summarized in Table A2.1 above, and the first data submission under the extension will begin in January 2024.

Displays of performance measures data will continue to be available to ACF and grant recipients through the SRAE Performance Measures Dashboard soon after each round of submission. In addition, the Contractor shall continue to retrieve and analyze data from the SRAE Performance Measures Data Portal and submit data reports to ACF annually. These reports address ACF performance management data needs, e.g., performance measures in ACF’s performance budget, and whether performance benchmarks were met. In particular, FYSB provides information on a subset of performance measures to OMB.

The annual reports discuss performance trends across SRAE programs, as well as by subgroups of grant recipients and subrecipients. The annual draft reports are expected in approximately March of each year. End-of-cohort reports on the performance data will be made available on ACF’s website.

A17. Exceptions

No exceptions are necessary for this information collection.

Attachments

• Instrument 1: Participant Entry Survey for high school and older youth

• Instrument 1a: Participant Entry Survey for middle school youth

• Instrument 1b: Participant Entry Survey for high school and older youth in programs with impact evaluations

• Instrument 1c: Participant Entry Survey for middle school youth in programs with impact evaluations

• Instrument 2: Participant Exit Survey for high school and older youth

• Instrument 2a: Participant Exit Survey for middle school youth

• Instrument 3: Performance Reporting System Data Entry Form

• Instrument 4: Subrecipient Data Collection and Reporting Form

Supporting references for inclusion of sensitive questions or groups of questions

Blake, Susan M., Rebecca Ledsky, Thomas Lehman, Carol Goodenow, Richard Sawyer, and Tim Hack. “Preventing Sexual Risk Behaviors among Gay, Lesbian, and Bisexual Adolescents: The Benefits of Gay-Sensitive HIV Instruction in Schools.” American Journal of Public Health, vol. 91, no. 6, 2001, pp. 940–46.

Boyer, Cherrie B., Jeanne M. Tschann, and Mary-Ann Shafer. “Predictors of Risk for Sexually Transmitted Diseases in Ninth Grade Urban High School Students.” Journal of Adolescent Research, vol. 14, no. 4, 1999, pp. 448–465.

Buhi, Eric R. and Patricia Goodson. “Predictors of Adolescent Sexual Behavior and Intention: A Theory-Guided Systematic Review.” Journal of Adolescent Health: Official Publication of the Society for Adolescent Medicine, vol. 40, no. 1, 2007, pp. 4.

Davis, E.C., and Friel, L.V. “Adolescent Sexuality: Disentangling the Effects of Family Structure and Family Context.” Journal of Marriage & Family, vol. 63, no. 3, 2001, pp. 669–681.

Dermen, K.H., M.L. Cooper, and V.B. Agocha. “Sex-Related Alcohol Expectancies as Moderators of the Relationship between Alcohol use and Risky Sex in Adolescents.” Journal of Studies on Alcohol, vol. 59, no. 1, 1998, pp. 71.

Fergusson, David M. and Michael T. Lynskey. “Alcohol Misuse and Adolescent Sexual Behaviors and Risk Taking.” Pediatrics, vol. 98, no. 1, 1996, pp. 91.

Goodenow, C., J. Netherland, and L. Szalacha. “AIDS-Related Risk among Adolescent Males Who have Sex with Males, Females, or both: Evidence from a Statewide Survey.” American Journal of Public Health, vol. 92, 2002, pp. 203–210.

Li, Xiaoming, Bonita Stanton, Lesley Cottrell, James Burns, Robert Pack, and Linda Kaljee. “Patterns of Initiation of Sex and Drug-Related Activities among Urban Low-Income African-American Adolescents.” Journal of Adolescent Health: Official Publication of the Society for Adolescent Medicine, vol. 28, no. 1, 2001, pp. 46.

Magura, S., J.L. Shapiro, and S. -. Kang. “Condom use among Criminally-Involved Adolescents.” AIDS Care, vol. 6, no. 5, 1994, pp. 595.

Raj, Anita, Jay G. Silverman, and Hortensia Amaro. “The Relationship between Sexual Abuse and Sexual Risk among High School Students: Findings from the 1997 Massachusetts Youth Risk Behavior Survey.” Maternal and Child Health Journal, vol. 4, no. 2, 2000, pp. 125–134.

Resnick, M.D., P.S. Bearman, R.W. Blum, K.E. Bauman, K.M. Harris, J. Jones, J. Tabor, T. Beuhring, R. Sieving, M. Shew, L.H. Bearinger, and J.R. Udry. “Protecting Adolescents from Harm: Findings from the National Longitudinal Study on Adolescent Health.” JAMA: The Journal of the American Medical Association, vol. 278, no. 10, 1997, pp. 823.

Santelli, John S., Leah Robin, Nancy D. Brener, and Richard Lowry. “Timing of Alcohol and Other Drug use and Sexual Risk Behaviors among Unmarried Adolescents and Young Adults.” Family Planning Perspectives, vol. 33, no. 5, 2001.

Sen, Bisakha. “Does Alcohol-use Increase the Risk of Sexual Intercourse among Adolescents? Evidence from the NLSY97.” Journal of Health Economics, vol. 21, no. 6, 2002, pp. 1085.

Tapert, Susan F., Gregory A. Aarons, Georganna R. Sedlar, and Sandra A. Brown. “Adolescent Substance use and Sexual Risk-Taking Behavior.” Journal of Adolescent Health: Official Publication of the Society for Adolescent Medicine, vol. 28, n3, 2001, pp.181.

Upchurch, D.M. and Y. Kusunoki. “Associations Between Forced Sex, Sexual and Protective Practices, and STDs Among a National Sample of Adolescent Girls.” Women's Health Issues, vol. 14, no. 3, 2004, pp.75–84.

1 The “success sequence” refers to a series of milestones in life that predict adult self-sufficiency and well-being. Although definitions vary, researchers commonly describe the success sequence to include achieving at least a high school education, finding and maintaining a full-time job, and getting married before having children.

2 In updating the Title V, Section 510 legislation in FY2018, Congress replaced the prior criteria with A–F criteria: (A) the holistic individual and societal benefits associated with personal responsibility, self-regulation, goal setting, healthy decision making, and a focus on the future. (B) the advantage of refraining from nonmarital sexual activity in order to improve the future prospects, and physical and emotional health of youth; (C) the increased likelihood of avoiding poverty when youth attain self-sufficiency and emotional maturity before engaging in sexual activity; (D) the foundational components of healthy relationships and their impact on the formation of healthy marriages and safe and stable families; (E) how other youth risk behaviors, such as drug and alcohol usage, increase the risk for teen sex; and (F) how to resist and avoid, and receive help regarding sexual coercion and dating violence, recognizing that even with consent teen sex remains a youth risk behavior.

3 Previously there was a version of the exit survey for programs conducting impact studies but use of those was discontinued prior to the OMB approval in 2022.

4 Grant recipients are notified that information will be shared between SRAENE and SRAE PAS contractors and the purpose of this sharing in the Notices of Funding Opportunities and will be reminded during grant recipient informational meetings regarding performance measures and/or training and technical assistance.

5 Based on our experience with data collection efforts with similar populations, we anticipate a program completion rate of 80 percent.

6 The estimated number of subrecipients is based on information provided by the SRAE grant recipients through their earlier performance measures data submissions.

7 Federal Minimum Wage, U.S. Department of Labor: https://www.bls.gov/cps/cpsaat44.pdf

8 National Occupational Employment and Wage Estimates, Bureau of Labor Statistics, Department of Labor, May 2023, https://www.bls.gov/oes/current/oes_nat.htm#21-0000https://www.bls.gov/cps/cpsaat44.pdf.