SSB Form for Supplemental IV-E Project for Formative

Title IV-E Tribal-State Agreement Evaluation

Formative Data Collections for ACF Program Support

0970 – 0531

Supporting Statement

Part B – Statistical Methods

SEPTEMBER 2022

Submitted By:

Capacity Building Center for Tribes

Children’s Bureau

Administration for Children and Families

U.S. Department of Health and Human Services

4^th Floor, Mary E. Switzer Building

330 C Street, SW

Washington, D.C. 20201

Project Officers:

Nanette Bishop, Arleen Rodriguez, and Bob Lindecamp

B1. Respondent Universe and Sampling Methods

Our sample will be selected from 98 Tribal Child Welfare representatives of Native American Tribes located within the United States, who have current Title IV-E Tribal-state passthrough agreements in place. Our primary respondents will be Tribal Child Welfare Directors and associated Tribal staff members with working knowledge of their Tribe’s passthrough agreements. We will recruit respondents using the Center for Tribes universal email listservs and Children’s Bureau regional officers may also share the survey with their designated Tribes via email.

B2. Procedures for Collection of Information

The survey has been designed in Qualtrics and will be emailed out to all participants with an introductory message (see Instrument 1: Title IV-E Tribal State IV-E Survey). The survey will be sent to Tribal Child Welfare directors and staff and will be open for 2 months. The survey allows for a single response from each Tribe. Only one individual is expected to respond from each Tribe. During the time of survey administration, we will send out weekly reminders with the option to opt out of future communications regarding survey participation. Participation is voluntary, and participants may opt out of communication and participation regarding the survey at their discretion.

Participant information will be kept private and contact information (e.g., email address) is only collected for gift card distribution, if approved by OMB. Contact information ill not be associated with responses. Only the study researchers will have access to the responses, which will be kept in secure cloud computing files at the University of Denver.

Once the data has been collected and the survey has closed, Center evaluators will clean and validate the data and then conduct descriptive statistical analyses on the dataset using SPSS software. Open-ended text responses will be coded for themes using NVivo qualitative software, to be added to the quantitative data. See Supporting Statement A, section A2 for additional information.

B3. Methods to Maximize Response Rates and Deal with Nonresponse

Expected Response Rates

There are only 98 Tribes in the United States who currently maintain Tribal-state agreements. With our sample size of 98 Tribal agencies, we expect approximately 40 total responses (30% overall response rate). We are targeting a minimum of 40 out of 98 potential participants, so that we can obtain a confidence interval of 90% and 10% error rates for statistical validity.

Dealing with Nonresponse

We will continue to send weekly invitations to participate in our research, in addition to offering tokens of appreciation to complete the survey. Tokens of appreciation will be especially important considering the limited sample population.

Maximizing Response Rates

We will continue to send invitations and follow up emails weekly to our sample. Children’s Bureau regional officers may share the survey with their regional email contact list on an ongoing basis while the survey remains open. We also offer an e-gift card as a token of appreciation to encourage participation. Please refer to section A9 in Supporting Statement A form.

B4. Tests of Procedures or Methods to be Undertaken

The survey and its measures have been carefully considered by a team of experienced Center for Tribes staff, in collaboration with external agencies and Children’s Bureau regional officers. We have validated and tested these methods through beta survey administration with our Center for Tribes staff who have experience working as Tribal Child Welfare directors under Title IV-E Tribal-state passthrough agreements. Based on their assessment, the survey was found to take and average of 10 minutes to complete.

B5. Individual(s) Consulted on Statistical Aspects and Individuals Collecting and/or Analyzing Data

The Center for Tribes evaluation team is trained in qualitative and quantitative statistical analyses at the doctoral level and has been contracted by the Children’s Bureau for the collection and analysis of this data. Basic descriptive statistics will be used for quantitative data and the qualitative data gathered from open ended survey responses as described above. Principal Investigators Dr. Robin Leake and Dr. Suzanne Delap with the Butler Institute at the University of Denver will lead the analytical work with the Capacity Building Center for Tribes team, including Ms. Sophia Warren, B.A., as lead research assistant.

4