Appendix E - Matrix of Research Questions and Sources of Data

Appendix E: Matrix of Research Questions and Sources of Data

	D ocument Review			Survey			Telephone Interviews
Evaluation Questions
What is the socioeconomic context in which the SCF Grantees operate?
How deep was the economic recession in SCF communities? Unemployment rates in 2008 and 2012 Number of people receiving ARRA benefits in 2008 and 2012 Number of foreclosures or average price of housing	X		X
How large is the nonprofit sector and faith-based community in the target areas? Number and size of religious congregations in the area Number, size and types of nonprofit organizations			X
What are the characteristics of the SCF grantees and their initial plans for using their SCF funds?
What are the characteristics of the SCF grantees Type, age, and size of organization Geographic location of SCF target service area (e.g., city, suburban, rural, statewide, multi-state, etc.) Prior experience providing training and technical assistance Prior experience working with government (federal, state, or local levels)	X	X		X	X
How did the grantees implement their SCF capacity building plans?
Did the program change over time (i.e., did it differ from what was proposed, were there modifications)?	X	X					X	X
What approaches or methods were used to provide training, technical assistance, outreach, etc.?		X		X	X		X	X
Were partnerships or collaborations used to provide training, technical assistance, outreach, etc.? If so, were these new relationships or existing ones?		X		X	X		X	X
How did the nonprofit grantees allocate activities across the five capacity building areas designated by the SCF program? What was the rationale for this allocation?		X		X			X
What was the focus of State, local and tribal grantee efforts to build their own capacity? What was the rationale for this?		X			X			X
What criteria did grantees use for selecting FBCOs for capacity building?	X						X	X
What were the characteristics (e.g., type of organization, program focus, size) of the FBCOs that received capacity building assistance? Subawards (applies only to nonprofit grantees)?	X	X				X
To what extent did FBCOs find the assistance helpful?						X
What challenges did grantees encounter in implementing the programs? How were these challenges addressed? Can any “best practices” or “lessons learned” be identified?		X		X	X		X	X

	D ocument Review			Survey			Telephone Interviews
Evaluation Questions
How did FBCOs that received subawards or intensive TA increase their capacity?
In which of the five designated areas did FBCOs focus their capacity building efforts? What types of organizational changes were made?						X	X	X
In what ways did FBCOs use their increased capacity to further their involvement in economic recovery to help low-income individuals? For example, did they: Develop new programs Expand existing programs Conduct workforce assessments Avoid staff layoffs/hire additional staff or consultants		X		X	X	X	X	X
How many (or what percentage) of FBCOs provide services specific to ARRA? For example, did they: Assess “green needs” Provide training for green jobs Provide information/counseling for ARRA benefits/programs		X		X	X	X	X	X
How many (or what percentage) of FBCOs provide “traditional” services to help individuals secure and retain employment? To what extent were these new or expanded services? For example, did they: Provide job readiness and retention training Provide education/training (literacy, ESL classes) Provide support services (such as counseling, child care, food assistance)		X		X	X	X	X	X
What capacity-building outputs or early outcomes were achieved? For example, did FBCOs develop: Business plans or strategic plans Board policies Information systems Volunteer recruitment and training materials Outcome indicators, performance measurement systems, etc.		X				X

	D ocument Review			Survey			Telephone Interviews
Evaluation Questions
How were collaborations and partnerships developed?
What types of collaborations and partnerships were formed by SCF grantees and FBCOs as a result of the SCF program?		X		X	X	X	X	X
To what extent did State, local or tribal grantees increase their willingness or capacity to collaborate/partner with FBCOs?		X			X	X		X
What is the purpose/goal of the collaboration/partnerships?		X		X	X	X	X	X
Is there evidence that the SCF capacity building efforts can be sustained?
Have the finances of the SCF grantees and FBCOs improved over the past two years – i.e., have the sources of revenue changed over time?				X	X	X	X	X
To what extent is increased government (State, local or tribal) Grantee capacity expected to be sustained? What approaches were used for this		X			X			X
To what extent has increased FBCO capacity expected to be sustained? What approaches were used for this (e.g., sustainability plans)		X		X	X	X	X	X
To what extent were collaborations and partnerships developed under SCF sustained after the grant? Developed partner MOUs or partner orientation materials Increased number or diversity of partners or collaboration Unintended effects				X	X	X	X	X
To what extent do SCF grantees plan to sustain their capacity building training and technical assistance efforts after the grant?						X	X	X
To what extent did SCF grants affect employment?
How many jobs did SCF Grantee organizations create or retain through SCF funds?		X					X	X
Were these positions retained/expected to be retained through other sources of funding after the end of the grant?		X					X	X
How many consultant positions were supported through SCF funds?		X					X	X

3