#5.Program Completers Interview Protocol

Program Completer Interview Protocol

Tribal HPOG Program Completers

The purpose of the interview is to obtain information from Participants who completed the program about their experiences with and perceptions of the tribal HPOG program. The following topics are addressed:

A. Program Structure 2

1. Program Design and Curriculum 2

2. Skills and Competencies for Local Health Care Workforce 3

B. Program Processes 3

1. Recruitment 3

2. Orientation 3

3. Supportive Services 3

4. Family Education Model 4

5. Quality of Instruction 4

C. Program Outcomes 4

1. Educational Attainment 4

2. Employment Outcomes 4

3. Employability Outcomes 5

4. Satisfaction with tribal HPOG program 5

5. Recommendations for Program Improvement 6

D. Recommendations for Program Improvement 6

E. Conclusion 6

All background information relevant to these topics will be consulted prior to the telephone interview in order to provide contextual information. The interviewer will also confirm the contact information for delivery of the respondent incentive.

Tribal HPOG program	Blackfeet Community College Cankdeska Cikana Community College Cook Inlet Tribal Council College of Menominee Nation Turtle Mountain	Study ID
Interviewed by		Date & time

Directions to Interviewer: Obtain consent then read the following statement to the respondent:

Good morning/afternoon. My name is [insert name] and I work for NORC at the University of Chicago. NORC has been contracted by the Administration for Children and Families to evaluate the Health Professions Opportunities Grants in tribal communities. The program you participated in through [Grantee site name] is part of the Health Professions Opportunities Grants.

The Tribal HPOG Evaluation is a comprehensive evaluation of the design, implementation, and outcomes of the five Tribal HPOG programs. The interview questions will focus on your perceptions of the Tribal HPOG program, including the program design and curriculum, recruitment, supportive services, family engagement, the quality of instruction, educational attainment and employment outcomes of participants, implementation barriers and facilitators, and overall satisfaction. Your participation is voluntary, but it is very important because your responses will help us to improve the program. As explained in the consent form you signed, we will keep information about you private and you will not be identified in any report or publication of this study or its results. You may decline to answer any question you wish. If you have any questions, please let me know.

Program Structure

Have grantees incorporated structures necessary to enhance the health care workforce needs of the community?

Program Design and Curriculum

1. [READ ALOUD TO RESPONDENTS BEFORE ASKING 1a-1d] First, we are interested in learning about the curriculum of your program, such as academic lectures and internships, and in learning about ways in which the program was designed to meet your needs.

   1. What program did you participate in? Why did you choose this program?

• Competencies to be developed (i.e., skill requirements of the target occupation)

• Pre-requisites

• Start and end dates.

• Program location

  • Convenience

  • Accessibility

2. Did you find the tribal HPOG program to be relevant to your culture? Please describe.

3. Were your needs discussed? This may include needs related to your education, finding a job or any other social support needs. Were your family’s needs discussed?

4. What career do you hope to pursue following this training? Allied health, LTC, child care health advocate training, health IT, nursing.

Skills and Competencies for Local Health Care Workforce

2. [READ ALOUD TO RESPONDENTS BEFORE ASKING 2a] Next we would like to learn about whether the training program provided you the skills needed to do a job in your community?

   1. Do you think the training program helped you develop the skills or ability to do a job needed in your community? Please describe.

Program Processes

Have grantees implemented processes to prepare participants for employment in the tribal health care sector?

Recruitment

3. [READ ALOUD TO RESPONDENTS BEFORE ASKING 3a-3f] Now we would like to learn about how you found out about the program and your decision to enroll in the program.

   1. Stepping back for a moment, can you tell us how you learned about the program?

   2. Were you referred to the program? By whom?

   3. Were you recruited to participate? By whom?

   4. Did you talk to anyone about whether you were a good fit for the program? Do you feel that you received enough information about the program before you joined?

   5. Did you have any concerns about the program? Did program staff address these concerns when you were joining the program?

   6. Were you accepted? Wait-listed? Placed on a modified track?

Orientation to the Program

4. [READ ALOUD TO RESPONDENTS BEFORE ASKING 4a-4b] Building on the last questions, we would now like to discuss how you were introduced and welcomed to the program.

   1. Once enrolled, how were you welcomed or oriented to the program? What did the program staff do? Please describe.

   2. Was this helpful? Please describe.

Supportive Services

5. [READ ALOUD TO RESPONDENTS BEFORE ASKING 5a-5g] Next, we would like to ask you some questions about the support services, such as transportation, mentoring, and other services, that were offered to you as part of the program.

   1. What kinds of services did you receive once you joined the program?

• Social services (e.g., food stamps, childcare, transportation)

• Employability services (e.g., essential skills, life skills, job readiness)

• Employment related services (e.g., job development and placement, job coaching)

• Retention services (e.g., mentoring)

• Post-program supportive services (e.g., mentoring, peer support groups)

2. How did you learn about the support services that were available?

3. How did you go about seeking help?

4. Who provided this/these the service(s)?

   1. The tribe (administration, departments, programs)?

   2. Tribal organizations?

   3. Non-tribal partners (IHS, local social services)?

5. Where were the supportive services provided? Onsite? Off-site?

6. Did these services meet your needs? What additional services would have helped you complete the program and/or find a job?

7. Did you receive financial support?

   1. If yes: What support did you receive? (e.g., grant, student loan, work study, etc)

Family Education Model

6. [READ ALOUD TO RESPONDENTS BEFORE ASKING 6a-6b] We would now like to discuss any strategies that were used to inform your families about the program.

   1. Did the program engage your family in any way? If so, how? Examples are provided information, participated in orientation, participated in college activities, provided support for studying, other.

   2. If your family did not participate, can you tell us why not? Did this affect your participation in the program in any way?

Quality of Instruction

7. [READ ALOUD TO RESPONDENTS BEFORE ASKING 7a-7c] Next we would like to hear your thoughts about your teachers and your classes.

   1. Were the teachers good?

   2. Was the training content good?

   3. Do you feel prepared to work in your chosen profession?

Program Outcomes

Is there evidence that participants in the program achieved successful employment and work force capacity building outcomes?

Educational Attainment

8. [READ ALOUD TO RESPONDENTS BEFORE ASKING 8a-8f]Next, we would like to learn if you earned a degree or certificate as a result of participating in the program and whether or not after you completed the program you pursued a licensure or certification issue through a state or industry entity.

   1. Did you earn a certificate or degree? If so, what certificate or degree or licensure id you earn?

   2. If yes, specify which.

      1. What program components (e.g. competency based curricula, supportive/cultural services, family education/engagement/employment and employability activities) were important to your success?

      2. What personal factors were important to your success?

      3. Do you have plans to continue your education?

   3. If no, why not? What do you plan to do?

   4. Did you pursue a state or industry licensure or certificate after completion of the program? Did you receive the licensure?

   5. If yes specify which:

      1. What program components (e.g. competency based curricula, supportive/cultural services, family education/engagement/employment and employability activities) were important to your success?

      2. What personal factors were important to your success?

      3. Do you have plans to continue your education?

   6. If no, why not? What do you plan to do?

Employment Outcomes

9. [READ ALOUD TO RESPONDENTS BEFORE ASKING 9a-9d] Next we would like to learn about your employment prior to and after completion of the program.

   1. Did you have a job prior to participating in the program? If yes, were you working in a healthcare field?

   2. Are you currently employed? Please indicate whether you are:

• Employed full-time

• Employed part-time

• Serving internship

1. [If yes]

• What is your job?

• Did the program help you find this job?

• Is it in your chosen field?

• With what employers? With tribe: In area/out of area; Other tribe; Non-tribal

• Where is it located? Examples are Tribal health services, IHS, local health care provider, out of area

• How long have you been in your position?

• Are you working with tribal populations?

• Is it in your own tribal community?

• Are you supervised or mentored while on the job/practicum site?

• Have you advanced in this job—higher pay, more responsibilities, promotion? Do you think you will be able to advance in the future?

• How does your salary compare to before participating in the program? Do you feel like your current salary is enough to provide for you and/or your family?

1. [If no], why not?

1. Did you continue to receive any support after you completed the program? If so, describe. Examples are job retention and advancement supports (e.g., mentoring, peer support groups)

2. Was it hard to find a job in your tribal community? If so, please describe.

Employability Outcomes

10. [READ ALOUD TO RESPONDENTS BEFORE ASKING 10a-10c] We are now interested in learning ways in which the program has impacted your life.

    1. In what other ways has your life changed, since enrolling/completing the program? Examples are increased life skills, self efficacy, confidence, social supports

    2. Do you consider yourself more independent after completing the program?

    3. Do you rely on other sources of financial and non-financial support?

• TANF or tribal General Assistance

• SNAP (food stamps), tribal Commodities

• Child care subsidies

• Transportation

• Housing

• Informal support

• Other

Satisfaction with tribal HPOG program

11. [READ ALOUD TO RESPONDENTS BEFORE ASKING 11a-11c] Finally, we would like to hear how satisfied you are with the program.

    1. On a scale of 1 to 5, where 1 is ‘not satisfied at all’ and 5 is ‘very satisfied’, how satisfied are you with the program?

    2. Did you meet your goals?

    3. What would you say about the tribal HPOG program if you were asked by an interested family member or friend?

Recommendations for Program Improvement

12. Is there anything that you would change about the program that could be helpful to future participants?

Conclusion

13. Is there anything you would like to add before concluding the interview?

Thank you very much for your time. It has been a pleasure to speak with you.

6