Family Self-Sufficiency Demonstration Development Grants Evaluation Support: Data Collection for Final Report

SEEDS Survey to Collect Grant Recipient Feedback

SEEDS Survey to Collect Grant Recipient Feedback

The purpose of this optional survey is to gather feedback from you about your experience with the FSSDD grant and SEEDS support. We will use this information to inform our final report to the Office of Planning, Research, and Evaluation within the Administration for Children and Families (ACF). This report will be internal to ACF and will not be publicly posted. We will keep your responses private and we will blend your responses with responses of other grant recipients, so no single finding or statement will be attributed to an individual person or grant recipient. Your responses will not affect your organization’s ability to receive funding from ACF, now or in the future. Your responses will not be shared directly with your coach. We estimate it will take about 10 minutes to complete the survey.

PAPERWORK REDUCTION ACT OF 1995 (Public Law 104-13) STATEMENT OF PUBLIC BURDEN:

The purpose of this information collection is to provide evaluation support to innovative interventions serving individuals, children, and families facing challenges to economic independence to expand the evidence base. Public reporting burden for this collection of information is estimated to average 10 minutes per respondent, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. This is a voluntary collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information subject to the requirements of the Paperwork Reduction Act of 1995, unless it displays a currently valid OMB control number. The OMB # is 0970-0356 and the expiration date is 02/29/2024. If you have any comments on this collection of information, please contact Julia Lyskawa at JLyskawa@mathematica-mpr.com.

1. Grant recipient affiliation. Please select the grant recipient organization you are affiliated with.

[Drop down menu with all 20 grant recipient organizations listed.]

2. Role. Which of the following best describes your role on the FSSDD grant project? Please select one option.

• FSSDD Project lead

• FSSDD Project team member

• External evaluator for FSSDD Project

• Other role, specify:

3. Supports utilized. Reflecting on your experiences with the SEEDS coaches, which of the following supports did you use? Among the supports you used, please indicate how useful each is/was/will be for your work.

		Please indicate how useful each was for your work.
	Did not use this resource / Was not relevant to my work	Not useful	Somewhat useful	Very useful
a. One-on-one individualized coaching support via regular calls with SEEDS coaches
b. Qualitative methods learning community
c. Self-sufficiency learning community
d. Learn-Innovate-Improve (LI2) training
e. Road test challenge training
f. Grant Recipient Annual Meeting 1 (GRAM1; held virtually in summer 2022)
g. Grant Recipient Annual Meeting 2 (GRAM2; held in-person in May 2023)
h. Culturally responsive and equitable evaluation (CREE) consult with Dr. Tanisha Tate Woodson
i. Communications/Dissemination consult with Deric Joyner or Miranda Kharsa
j. Consult with other Mathematica staff beyond SEEDS coaches to discuss our project
k. Written guide to conducting a road test
l. Written guide to developing a logic model, identifying the core components of a program, and identifying implementation strategies for a program
m. Written templates for dissemination (e.g., intervention summary template, descriptive study brief template, etc.)
n. SharePoint site where FSSDD/SEEDS resources are shared [hyperlink]

3. Research activities. Thinking about your work with the SEEDS team, what research activities did you complete?

	Completed during the FSSDD grant period Check all that apply
Created a logic model for our program or intervention	☐
Defined core components and/or implementation strategies for our program or intervention	☐
Conducted a road test or pilot test to try out a new strategy or aspect of our program	☐
Conducted a rapid cycle evaluation of our program	☐
Conducted a study to describe how our program is currently being implemented (e.g., implementation evaluation or process study)	☐
Assessed how well we are implementing our program compared to a set of standards or measures (e.g., fidelity assessment)	☐
Used qualitative data collection methods, such as staff interviews, participant interviews, focus groups, etc.	☐
Conducted a study analyzing participants before and after they participated in our program (e.g., a pre-post outcomes study)	☐
Conducted an evaluation comparing participants receiving our program services to participants not receiving our program services (e.g., impact evaluation, quasi-experimental design, randomized control trial)	☐
Used quantitative data collection methods, such as collecting surveys or gathered data from our internal data systems	☐
Infused culturally responsive and equitable evaluation principles into our work	☐
Other (specify)	☐
Other (specify)	☐

4. Knowledge. Overall, would you say your knowledge about each topic below is substantially better, about the same, or substantially worse as before the FSSDD grant?

	Please indicate how your knowledge about each topic has changed, if at all
	Substantially better	About the same	Substantially worse
How to clearly define the core components and target outcomes of a program or intervention	☐	☐	☐
How to strengthen or refine the implementation of a program or intervention using research methods	☐	☐	☐
How to design a research project or evaluation of a program or intervention	☐	☐	☐
How to conduct research on a program or intervention by collecting and analyzing data	☐	☐	☐

5. Coaching feedback. Please indicate the degree to which you agree or disagree with the following statements.

	Strongly agree	Agree	Neutral	Disagree	Strongly disagree
The advice and guidance I got from my coaches was valuable to me.	☐	☐	☐	☐	☐
My coaches gave me the guidance I needed to make progress on my organization’s research goals.	☐	☐	☐	☐	☐
My coaches were knowledgeable about research methods.	☐	☐	☐	☐	☐
My coaches made me feel excited about conducting research and using evidence.	☐	☐	☐	☐	☐
My coaches helped us put structures or processes in place to measure the impact of our program.	☐	☐	☐	☐	☐
My coaches connected me to helpful resources throughout the grant project.	☐	☐	☐	☐	☐
My coaches equipped me with the tools and data necessary to tell the story of our impact on children and families.	☐	☐	☐	☐	☐
My coaches instilled confidence in me to conduct research activities on my own.	☐	☐	☐	☐	☐
After working with my coaches, I better understand how research and data could benefit my organization’s staff and participants.	☐	☐	☐	☐	☐

6. Open feedback. Please use the space below to share whatever additional feedback you have about the FSSDD grant project, SEEDS support, or any other aspect of this experience.

DRAFT 12/15/23 Mathematica^® Inc. 4