Form Approved
OMB No. 0990-
Cost Study of TPP Programs – evaluation Topic Guide Exp. Date XX/XX/20XX
Cost Study OF EVIDENCE-BASED TEEN PREGNANCY PREVENTION PROGRAMS: economic evaluation
Evaluation TOPIC GUIDE
As part of the Cost Study of Evidence-Based Teen Pregnancy Prevention Programs, Mathematica is conducting an economic evaluation of the relative cost-effectiveness of grantee programs across program models and among grantees implementing the same intervention. Researchers will gather information about the impact evaluations in progress, through review of grantee and evaluation documents and discussion with the evaluation contact person recommended by the grantee. To avoid redundant data collection, information gathered about the evaluations will be combined with implementation data, which will be gathered through a separate instrument. The evaluator discussion will fill gaps and confirm the accuracy of data assembled through documents. Document review will begin in summer 2014 and evaluator calls will begin in fall 2014, immediately after initial implementation interviews with grantees.
A. Background Information
Grantee name, contact information
Implementing agency name, contact information (if different)
Local or Federal evaluation, evaluation contractor name, location, designated contact(s)
Contact information for designated contact(s)
B. Evaluation Overview
Counterfactual condition
Target population for evaluation (eligibility criteria)
Evaluation research design: QED, RCT, clustered RCT
Research group formation, if QED
Random assignment process, if RCT
According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is 0990-xxxx . The time required to complete this information collection is estimated to average 180 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, and complete and review the information collection. If you have comments concerning the accuracy of the time estimate(s) or suggestions for improving this form, please write to: U.S. Department of Health & Human Services, OS/OCIO/PRA, 200 Independence Ave., S.W., Suite 336-E, Washington D.C. 20201, Attention: PRA Reports Clearance Officer.
C. Timeline for Enrollment, Service Delivery, and Data Collection
Timing of baseline data collection and random assignment relative to enrollment and consent—when and for how long is enrollment possible?
Period of services covered by evaluation; number of cohorts; if multiple cohorts, service period for each.
Timing of end-of-program data collection, follow-up data collection; mode and response rates, if available, for post-program follow-ups
D. Availability of Performance Measures Data
Evaluator’s role in entering/updating performance measures data
Completeness of evaluation data in performance measures system; limitations that could affect data analysis
Data collected for evaluation beyond required performance measures and accessibility of this data (for example, cohort and cluster indicators, additional demographic baseline data, fidelity measures, additional outcomes not included in OAH performance measures)
Timing for availability of final evaluation data
E. Evaluator’s Analysis and Reporting Plans
Primary and secondary outcome measures, measurement approach, and whether included in performance measures
Approach to and timing of data cleaning
Definition of evaluation sample member for analytic sample; sample restrictions
Methods for analyzing impacts on outcomes
Design features and analytic approach: clusters, sampling weights, stratification variables
Number of reports planned, scheduled for producing reports
F. Issues Related to Data Sharing
Plans for public-use or restricted-use file production; timing of file development
Analysis data file sharing, confidentiality agreements and approvals (include local IRBs) to facilitate data sharing
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Heather Zaveri |
| File Modified | 0000-00-00 |
| File Created | 2021-01-27 |