Attachment D - Overview of Revisions - Project Outcome Assessment Survey Update 2019

ATTACHMENT D

ANA Project Outcomes Assessment Survey Changes

Pages 1-3 [NO CHANGES]

SECTION 1 – Objective Work Plan

• Removed question: If you could share some best practices from your project with other ANA grantees, what would they be?

SECTION 2 – Results (Outputs) and Benefits (Outcomes)

• Removed portion of question 2.1: To what extent did you serve this population?

• Added:

2.1.2. Number of people the project actually served_____

2.2 Describe how your indicator was achieved throughout the project.

2.3 Was the indicator from the application the best measurement to capture the outcomes of your project?

2.3.1 If not how would you have identified or revised the indicator?

2.4 Name up to three achievements you are most proud of and would want to share about your project?

2.5 What project outcomes would you like to sustain after ANA funds end, and what is needed to sustain such outcomes?

2.6 Now that you are at the end of your project is, your Three-Year End of Project Target still achievable realistic? If not, how would you revise?

2.7 What obstacles are foreseen to project sustainability over the next 5 years?

2.8 As a result of this project is/will it be a(n):

• New Initiative

• Continuing Program

• Merged into an existing program

• Intended to End (e.g. Manual/Regulation Development)

2.9 What factors will contribute to the continued sustainability of this project?

2.10 Was any infrastructure created?

2.11 FOR NON-LANGUAGE PROJECTS: Were language activities incorporated into the project in any way? If so, how?

SECTION 3 – Partnerships [Moved to SECTION 6; Replaced by PROJECT DEVELOPMENT (formerly Section 6)]

Project Development

Questions asked in this question elucidate on the question removed in SECTION 1 to glean richer qualitative data.

• Added:

3.6 What were the best practices in marketing to your specific population?

3.7 How was the project received by the community?

3.9 How did you keep the community engaged or updated throughout the project?

3.10 How did you encourage project participants to maintain their participation in the project? Were there external factors that also helped?

3.11 How did you facilitate multigenerational activities?

3.11.1 What were the results of these activities among the participants?

3.11.2 What are some best practices in facilitating multigenerational activities?

SECTION 4 – Beneficiaries

• Deleted questions and moved to SECTION 9

• Project Challenges moved from SECTION 7 – [NO CHANGES]

SECTION 5 – Project Benefits

5.2 – Renumbered to 5.1.2

• Added:

5.2 Were any businesses created by the project?

5.2.1 Was income generated by businesses?

5.2.2 List income generated: How was income generated?

5.3 Were any businesses expanded?

5.3.1 If yes, how were they expanded?

5.4 Added an employment table.

SECTION 6 – Project Development [Moved to SECTION 3; Replaced by PARTNERSHIPS (formerly Section 3)]

6.1 Deleted and Replaced

6.1 What role did partnerships play in your project?

SECTION 7 – Staffing [Moved to SECTION 8; Replaced by PROGRAM SPECIFIC (formerly Section 8)]

Program Specific

ERE

• Added:

7.1 What was the project type:

• Renumbered the remaining questions with no changes.

Language

• Added:

7.1. Please provide the:

7.1.1 Language Family:

7.1.2 Language:

7.1.3 Dialect:

7.2 Can you rate on a scale of 1 to 5, language use in the following spaces:

7.2.1 Community

7.2.2 In the home

7.2.3 School

4. Tribal Government

7.3 Has there been any space/place that language use has increased since the grant began? Where? How has it increased?

7.4 What external positive effects have been noted in the community outside of the project?

7.8 Were there any external positive effects have been noted in the community outside of the project?

• Renumbered:

7.1 (7.6), 7.2 (7.6), 7.2.1 (7.7)

SUSTAINABLE EMPLOYMENT AND ECONOMIC DEVELOPMENT STRATEGIES

• Deleted:

7.1, 7.1.1, 7.1.2, 7.1.3, 7.1.4, 7.2, 7.3, 7.4.2, 7.4.4, 7.5, 7.6, 7.6.1, 7.6.2, 7.7, 7.7.1, 7.11

• Added:

7.1(new) Do you know of (a) project participant(s) who have experienced economic hardship and were better equipped to overcome that situation as a result of this project?

7.1.1(new) If yes, how were they more successful?

• Renumbered:

7.4 (7.2), 7.4.1 (7.2.1), 7.4.2 (7.2.2), 7.8 (7.4), 7.9 (7.5), 7.10 (7.5.1), 7.12 (7.6)

NATIVE ASSET BUILDING INITIATIVE

• Deleted the following and renumbered remaining questions:

7.1, 7.2, 7.3, 7.7, 7.10, 7.14, 7.15, 7.16, 7.17

SECTION 8 – Program Specific [Moved to SECTION 7; Replaced by STAFFING (formerly Section 8)]

Staffing

• Added:

8.1.2 If there was turn-over, did the organization have a succession plan to transfer knowledge of the project and completed activities to the next PI/PD?

3. Does your organization have an IT/Data Management Department?

8.4 Among staff that work on this project, please indicate the highest level of knowledge in the following areas:

(Scale: Extremely Knowledgeable, Moderately knowledgeable, slightly knowledgeable, use external expertise, not part of regular project business)

1. Performance Indicators

2. Descriptive statistics

3. Program Evaluation

4. Data visualization

5. Data programming

6. Data management (and what software used)

8.5 How would you characterize the availability of financial resources, including personnel availability, for data usage and management:

(Scale: 1-10 from Extremely inadequate to Extremely Adequate)

8.6 Through this project, has your organization/tribe increased their ability to collect, manage, or analyze data in any way?

8.7 What are the primary barriers to data development and analysis that limit the ability of your project to use data to inform key policy and programmatic issues?

8.8 What is the capacity of your organization (in staff)?

8.8.1 Did you have all of the staff available to carry out your individual project?

SECTION 9 – Beneficiaries [Moved from SECTION 4]

• Added (As guiding questions, mainly to be completed by general conversation with project beneficiaries):

  • Beneficiary’s impact from project participation:

    • What made you want to participate in the project?

    • Were there any challenges you faced in participating in the project?

    • What was your favorite aspect of the project?

    • What have you seen change in your life or the community related to the project?

SECTION 10 – Project Specific – [NO CHANGES]