Slide title | Original slide number | Resubmission slide number | Original content (deletions in blue) | Edited contents (edits in red) |
Building Bridges and Bonds (B3) | 2 | 2 | A rigorous multi-site study testing innovative services offered by fatherhood programs. An opportunity for the fatherhood and research communities to produce new evidence about specific service approaches. |
A rigorous, multi-site study of innovative services offered by Responsible Fatherhood/ReFORM (RF) programs Unique opportunity for the program and research communities to produce new evidence about specific service approaches OFA and other stakeholders are involved in helping B3 to set priorities |
Why B3? | 4 | 3 | Fathers play a unique role in children’s lives However, they may face barriers to positive involvement with their children Improving outcomes for low-income fathers and children is a high priority for policymakers Programs use a number of promising approaches, but there is a limited evidence base |
Fathers play a distinct role in children’s lives However, they often face barriers to positive economic and emotional involvement with their children Improving outcomes for low-income fathers and children is a high priority for policymakers A number of promising approaches are emerging, but there is a limited evidence base |
Study goals | 3 | 4 | Provide evidence about effective strategies Focus on individual program components Test program impacts in three areas: 1. Parenting and co-parenting interventions 2. Employment services 3. Participant recruitment and engagement strategies |
Provide evidence about strategies that: -Are feasible in RF program context -Improve outcomes -Have the potential to change practice Build knowledge in three areas: 1. Employment 2. Parenting and co-parenting 3. Participant recruitment and engagement |
Study team | 6 | 5 | No difference | No difference |
Federal evaluations and the grant application and award process | N/A | 6 | No parallel slide | Approximately 6 RF and 6 HM sites will be chosen for the federal evaluations The B3 and STREAMS selection process is separate from the grant selection process -Selection for the evaluation will take place after grants are awarded -The B3 and STREAMS teams have no role in grant decisions -No additional points will be awarded for including mentioned approaches in funding proposals -The study teams may not work with programs on grant applications |
A research-practice partnership | N/A | 7 | No parallel slide | B3 is planning ongoing communication with the entire range of stakeholders January 2015 meeting: Heard views from several current grantees and fatherhood researchers about potential priorities for B3 Newsletter and at RFHM grantee conferences: Continue the dialogue Ongoing: Will work closely with sites throughout recruitment, random assignment, and implementation |
Complementary studies | 5 | 8 | B3 is one of several studies providing this evidence Others include: -The Parents and Children Together: Focuses on “whole package” of Responsible Fatherhood programs -Fatherhood Research and Practice Network: Supports evaluations of several promising approaches to services for fathers B3 complements these studies with its focus on individual components |
B3 is one of several studies providing new evidence for RF field Others include -Local evaluations from next cohort of RF grantees -Parents and Children Together (PACT) -Fatherhood Research and Practice Network B3 complements these studies with its focus on individual program components and implementation features |
What we know | N/A | 9 | No parallel slide | Fathers in PACT report that their participation is motivated by -Employment -Better relationships with their children RF programs are -Important to local communities -Strong partners to other organizations -A forum for men to discuss their roles as fathers and support each other’s efforts Like other federal programs, increasingly focused on evidence of effectiveness |
Study components (original) Key questions addressed in B3 (resubmission) |
7 | 10 | Impact analysis: What results do the services produce? -Measures effects of program components on participant outcomes -Uses random assignment -Focuses on relatively short-term outcomes Implementation analysis: How are impacts achieved? -Gives context to impact analysis findings -Describes program participants, how program services were delivered, and any challenges faced along the way |
What outcomes do the services affect? (Impact analysis) -Examine effects of program components, including program approaches and implementation factors -Measure impacts using random assignment How are impacts achieved? (Implementation analysis) -Give context to impact findings -Describe how component was delivered, staff/participant views of services, and challenges and solutions |
Program services to be studied (original) High-priority employment services (resubmission) |
17 | 11 | Program services to be studied Sample parenting/co-parenting interventions A…… B…… C…… Sample employment services interventions D…… E…… F…… |
Challenge -Help men find and maintain better jobs with higher earnings than they can find on their own Promising approaches -Active job development -Services informed by cognitive behavioral principles -Wage subsidies -Industry-specific training |
Program services to be studied (original) High-priority parenting services (resubmission) |
17 | 12 | Program services to be studied Sample parenting/co-parenting interventions A…… B…… C…… Sample employment services interventions D…… E…… F…… |
Challenges -Build parenting skills of dads even if not living with children -Increase conflict management skills and reduce co-parenting conflict for both parents Promising approaches -Parenting curricula involving the child -Co-parenting sessions involving the mother -Parenting curricula with some evidence |
Program recruitment and engagement | 18 | 13 | Participant recruitment and engagement are challenging for many fatherhood programs B3 seeks to -Identify and test new approaches in this area -Apply learnings from behavioral economics The study team will help sites -Identify current challenges -Develop and quickly test new strategies -Use internal data to assess and refine enhancements |
Participant recruitment, engagement, and retention are a central issue for many programs B3 seeks to -Work with programs to identify and test new approaches in this area -Apply learnings from “behavioral economics” The study team will help sites -Identify current challenges -Test multiple strategies -Assess and refine enhancements |
Random assignment | 10 | 14 | The most rigorous and reliable method for demonstrating program effects Program participants are randomly assigned to one of two groups -Group 1: Receives program services, including the component intervention being tested -Group 2: Receives program services, but not the component intervention being tested The difference in the outcomes of the two groups shows the intervention’s impact |
No difference |
Random assignment | 11 | 15 | No difference | No difference |
Desired study site characteristics | 22 | 16 | Programs funded through OFA Responsible Fatherhood grants and other sources Demonstrated experience running strong fatherhood programs Operating a strategy to be tested, or willing to implement new program enhancements Capacity to recruit and serve at least 500 fathers over 18 months Open to implementing evaluation processes, including random assignment |
Funded through OFA Responsible Fatherhood grants and/or other sources Demonstrated experience running a fatherhood program Operating a high-priority strategy or willing to implement new program enhancements Capacity to recruit and serve approximately 500 fathers over 15-18 months |
Benefits of participating | 20 | 17 | Program funding to support enhanced services and/or increased recruitment Expert technical assistance on -Participant recruitment and engagement, -Program service being tested, and -Study procedures Contribution to a growing evidence base that will help programs serve disadvantaged fathers more effectively Program-specific findings Increased visibility as part of a national study |
May provide additional funds to support programming and study participation, for example, to support enhancements to services Expert technical assistance on -Participant recruitment and engagement -Program service being tested -Study procedures Specific results for your program Contribute to growing evidence base Increased visibility as part of a national study |
Study team responsibilities | 21 | 18 | Visit organizations to learn about program operations and brainstorm study options Facilitate meetings to design and plan study implementation Provide funding and other resources to support program enhancements and research activities Train and support program staff on study procedures Analyze data and produce reports Provide ongoing technical assistance to achieve highest-quality program enhancement and research procedures |
Maintain close communication with organizations, including visits, to learn about program operations, hear your interests, and brainstorm study options Facilitate meetings to plan study implementation Provide funding and other resources to support program enhancements and research activities Train and support program staff on study procedures Provide ongoing technical assistance to achieve high-quality program enhancement and research procedures Analyze data, share lessons, and publish reports |
Study timeline | 23 | 19 | 2015-2016: Site recruitment 2016-2017: Enrollment of fathers into the evaluation; sites receive evaluation support 2017: Implementation study report 2018: Impact study report 2019: Final synthesis report |
2015-2016: Site recruitment 2016-2017: Enroll participants into the study 2016-2018: Sites receive study support 2017-2019: Share lessons with RF field 2017: Implementation reports 2018: Impact reports 2019: Final synthesis reports |
Contact information | 24 | 20 | (No text) | MDRC (research contractor) www.mdrc.org/b3 b3@mdrc.org OPRE (federal office) Anna Solmeyer Anna.Solmeyer@acf.hhs.gov 202-401-4055 |
Additional information | N/A | 21 | No parallel slide | (No text) |
Impact analysis | 8 | 22 | No difference | No difference |
Implementation analysis | 9 | 23 | No difference | No difference |
Study implementation | 19 | 24 | No difference | No difference |
Random assignment | 12 | 25 | No difference | No difference |
Random assignment | 13 | 26 | No difference | No difference |
Random assignment procedure | 14 | 27 | No difference | No difference |
Example: co-parenting | 15 | 28 | No difference | No difference |
Program services to be studied | 16 | N/A | Three areas will be tested -Parenting/co-parenting component(s) -Employment services component(s) -Recruitment and engagement Design process -Considering evidence-based or promising interventions -Also seeking to identify promising strategies fatherhood programs use -Each component likely to be tested at multiple program sites -Expect six programs will be chosen as study sites |
No parallel slide |
File Type | application/vnd.openxmlformats-officedocument.spreadsheetml.sheet |
File Modified | 0000-00-00 |
File Created | 0000-00-00 |