Diaper Distribution Demonstration and Research Pilot Baseline Data Collection
OMB Information Collection Request
0970 – 0531
Supporting Statement Part B –
Statistical Methods
September 2024
Submitted By:
Office of Community Services
Administration for Children and Families
U.S. Department of Health and Human Services
Respondent Universe and Sampling Methods
The Office of Community Service (OCS) will administer this formative information collection to program participants, as described here.
Beneficiary Survey – Baseline Version (Instrument 1): The potential respondent universe for this instrument includes any family enrolling to receive diapers and diapering supplies from the Diaper Distribution Demonstration and Research Pilot (DDDRP). There are 21 grant recipients, and OCS estimates grant recipients will serve about 45,500 beneficiaries between fall of 2022 and January of 2025. We have observed response rates near 25% for cohort 1, 50% for cohort 2, and 75% for cohort 3. Based on cohort-level response rates, we estimate a total sample size of 4,000 respondents to the beneficiary survey between now and January 2025.
Beneficiary Survey – Follow-Up Version (Instrument 2): The potential respondent universe for this instrument includes respondents to the baseline version using the unique ID. In order to observe changes in outcomes of interest, we will only administer the follow-up version to participants who have been enrolled in the program for at least 3 months prior to the follow-up survey, which we anticipate administering in November of 2024. Our records show 7,000 respondents meet these criteria. OCS anticipates a 75 percent response rate among these participants, which is similar to what we observe with the baseline version, for a total of 5,250 responses across 9 sites.
Procedures for the Collection of Information
The Beneficiary Survey – Baseline and Follow-up Versions (Instruments 1 and 2) are programmed in an electronic collection system (e.g., Survey Monkey) and are distributed by partner organizations. Surveys are submitted directly to OCS through the electronic collection system. The electronic collection system will include both skip patterns and checks for missing or incomplete data. OCS staff also cleans the data post-collection, before analysis begins. OCS provides regular summary statistics back to grant recipients on the demographics of families served and levels of diaper need experienced by beneficiaries.
OCS also intends to share the data collected with the federal implementation evaluation contractor.
Methods to Maximize Response Rates and Deal with Nonresponse
Instrument 1 is given to families who receive diapers and diapering supplies from any partner organization. To maximize response rates, OCS will provide regular reports to grant recipients showing the number of participants (per site, for recipients using unique ID), which will allow grant recipients to address low response rates. We have observed that regular reporting of response counts to grant recipients has boosted response rates for sites. Based on our experience administering this survey to past cohorts of grant recipients, we observed that 25% of cohort 1 beneficiaries completed the survey early in administration. These recipients did not receive regular reports when the survey initially launched. That rate has risen to 75% for cohort 3 grant recipients who are using the unique ID and are receiving regular reports of survey results at the site level.
Test of Procedures or Methods to be Undertaken
There are no formal tests of procedures or methods being taken at this time. However, OCS has experience collecting large amounts of data from grant recipients, partner organizations, and direct beneficiaries through Quarterly Reporting in two of our program offices. Thus, DDDRP is going to rely on best practices and lessons learned from those OMB approved collections.
Individuals Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data
The ACF OCS employee consulted on the data collection design for the DDDRP is Rachel Hammond, Program Specialist in the Low Income Household Water Assistance Program (LIHWAP). The data will actually be collected by 35+ partner organizations. The data analysis will be conducted internally by the ACF OCS staff working on the DDDRP program as well as staff of OPRE’s contracted evaluator, Westat.
OCS Staff
Regine Adrien
Thom Campbell
Jessica Hale
Juliana Melara
Bronte Nevins
Julia Rabin
Bridgette Sullivan
Ben Wills
Westat Staff
Allison Hyra
Sarah Glidden
Kelsey Gray
Olivia Iles
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | Melara, Juliana (ACF) |
| File Modified | 0000-00-00 |
| File Created | 2024-10-07 |