ROSS Site Visit-Staff and Partners

ROSS-SC Evaluation

3-29-18_ROSS SC_ Appendix C

ROSS Site Visit-Staff and Partners

OMB: 2528-0316

Document [docx]
Download: docx | pdf

Appendix C: Administrative Interview Protocols

Public Burden Statement

The public reporting burden for this information collection is estimated to be 2 hours. You are not required to respond to this collection of information unless a valid OMB control number is displayed.

OMB Number: (XXXX-XXXX)

Expiration Date:

Informed Consent

[DISCUSS THE PURPOSE OF OUR PROJECT/CONTRACT BASED ON THE DESCRIPTION IN THE CONSENT FORM. THEN READ THE FOLLOWING OUT LOUD TO THE INTERVIEW PARTICIPANTS BEFORE STARTING.]

Before we begin, I want you to know that the information you share in this interview will be kept private to the extent permitted by law. We will not include your name in our notes or reporting, and our notes and recordings will not be shared outside of our Urban Institute research team. When we report our findings, we will combine information from everyone we talk to and present it in a way that individual answers cannot be easily identified. Every effort will be made by the research team to preserve your privacy by not using your name or any other identifying information that can be linked to a specific comment in our report.

We want to be sure that you freely consent to participate in this interview and that you are aware that you are not obligated to answer any questions you do not wish to. Do you consent to participate in the interview?

(If the contract monitor is in the room, have them read this) My name is _________, and I am with the Office of Policy Development and Research at the U.S. Department of Housing and Urban Development national office, the agency that funds [GRANTEE NAME] to provide the Resident Opportunity and Self-Sufficiency Service Coordinator program and that is funding this program evaluation. If you agree, I would like your permission to observe how the Urban Institute conducts this interview to ensure the quality of their research process. I would like you to know that I am only here to monitor the research, and perform no role in the collection or analysis of the data you provide to them. I will not use any of your personal information or discuss any of the experiences you describe during this interview for any other purpose. Your responses will remain private to the extent permitted by law and will not be reported to anyone. Do you consent to my staying in the room to observe this interview?

(If there is more than one participant in the interview): However, because there is more than one participant in this interview we cannot ensure that what is shared during this conversation not be shared with outside stakeholders. We encourage participants not to share what other respondents say in respect of their privacy.

[IF THE INTERVIEWEE RESPONDS YES, NOTE THE TIME. IF NO, THANK THEM FOR THEIR TIME AND ALLOW THEM TO LEAVE.]

[THE INTERVIEWER SHOULD CONTINUE BY READING THE FOLLOWING]

With your permission, we would also like to record our interview for note-taking purposes. Only our research team will have access to the recording and we will erase all recordings after our research is finished. Do you consent to have the interview recorded?

[IF YES, BEGIN RECORDING].

Before we begin, do you have any questions for us about the interview?





Service Coordinator

First, we would like to ask you about yourself, and your professional experience. Then we would like to ask you about the ROSS program and your role as a ROSS Service Coordinator.

  1. How did you come to this job?

  2. How long have you been here?

  3. How do you like it?

  4. What did you do before this job?

  5. What training/certification/education/experience did you have prior to starting this job?

  6. What training have you received while you were working in this job?

Now, we would like to ask you about the ROSS program and your role as a ROSS Service Coordinator.

  1. How would you describe the ROSS program in your own words?

  2. What does your typical day look like from beginning to end?

  3. How much time did you spend in the last month:

    1. With residents

    2. With work colleagues [IF NEEDED, CLARIFY BETWEEN SAME PROGRAM STAFF/DIFFERENT PROGRAM/SUPERVISOR]

    3. With service partners

    4. On administration [IF NEEDED, CLARIFY PAPERWORK, REPORTING & DATA ENTRY, ETC]

      1. How much of this is for [INSERT GRANTEE NAME] vs. HUD?

      2. Do you ever find you have to enter the same data in multiple places?

      3. Can you explain where and in what context?

  1. What do you like most about your work?

  2. What do you like least about your work?

[FACILITATOR READS]: We would like to hear more about the activities you perform during an average week.

  1. What is a considered a full caseload for you in terms of the number of residents you work with?

    1. How many residents are you expected to see on a weekly basis?

    2. How many of them would you say you work with on a regular basis (at least monthly) or are considered “active”?

  2. What do you do to reach out to residents and get to know them?

    1. How do you make yourself available to help them?

      1. One-on-one meetings [IF NEEDED, PROBE IF THESE ARE SCHEDULED VS. WALK-INS]

      2. Events

      3. Other

  1. What outreach methods do you find to be most effective?

    1. Are there any particular events or communications strategies that have been more effective than others to increase resident participation?

  2. What kinds of conversations do you have with families?

    1. For elderly/people with disabilities? [AS APPROPRIATE]

  3. What are some of your residents’ greatest needs?

  4. Are any residents reluctant to or unwilling to participate?

    1. Why do you think that is?

  5. Do you have residents complete an Individual Training Service Plan (ITSP) – or a plan that defines their final and interim goals, the steps they need to reach those goals, and barriers they may face?

    1. At what point do you encourage a resident to complete such a plan?

  6. How many people have an active plan right now? Are the ROSS participants similar or different from participants in other programs or services that you offer?

    1. If yes, how? [PROMPT: BY TYPE OF NEEDS, INTERESTS, DEMOGRAPHICS, OTHER CHARACTERISTICS]

  7. Do you refer residents to services/agencies/ resources outside of your agency?

    1. If yes, can you provide a few examples?

    2. How do you know about these various resources?

    3. Are these resources available on or off-site?

      1. If off site, how do residents access them?

    4. Do you meet with or speak to representatives within these agencies/organizations regularly?

    5. Do you strategize with them about how to meet your residents’ needs?

      1. Give them feedback on your residents’ experiences with their services?

    6. Are there referral services that are necessary, but not available or don’t have the capacity to meet all of your residents’ needs?

    7. Which resources for residents do you wish you could improve or expand?

  8. Which referral services do you feel best enhance residents’ self-sufficiency?

  9. How do you track progress and follow up with residents?

  10. How often do you follow up with each resident?

    1. Do you wait for them to reach out to you?

    2. Do you schedule regular appointments/check-ins to follow up/update Individual Service Plans [INTERVIEWER SHOULD RELPLACE WITH THE NAME THEY USE AT THE SITE] with participants?

  11. What is the most challenging aspect of your job?

  12. What has been your greatest accomplishment?

  13. What would help you most in your work supporting ROSS participants?

    1. Training

    1. [IF YES] can you specify what type of training?

    2. Did you find it helpful?

  1. Compensation

  2. Activities

  3. Services/Partners

  4. Coordination with other programs/grantee resources

  5. Technical Assistance or help from HUD Did the help come from HUD HQ?

    1. The local Field Office?

    2. What type of help did they offer?

[IF NEEDED, PROMPT WITH EXAMPLES: DATA COLLECTION; OUTREACH TO PARTNERS; ENGAGING RESIDENTS]

  1. Do you have any other recommendations you have that would make the ROSS program stronger?

[INTERVIEWER SHOULD TAKE THIS TIME TO NOTE IN WRITING ANY RELEVANT INFORMAL OBSERVATIONS]

Grantee Supervisor/Manager



  1. How long have you had a ROSS-SC program running at this location?

  2. Do you have multiple ROSS awards serving different public housing sites?

    1. [IF SO SPECIFY THAT YOU WOULD LIKE THEM TO ANSWER FOR ALL ACTIVE SITES]

[INTERVIEWER READS] We’d like to ask you some questions now about the ROSS-SC Program Structure and Processes

  1. How many residents would you estimate are served at the ROSS-SC sites currently?

    1. In the past year?

  2. According to our data, the budget for the ROSS-SC program at this site is $NUMBER. Is this about right?

  3. The data also show that you have had about $NUMBER of this amount dispersed. Does this seem about right?

    1. Do you expect to use the full amount prior to the expiration in DATE?

    2. Why or why not?

  4. How does ROSS-SC program and staff fit into your overall organizational structure?

  1. How is the SC’s work managed? To whom does s/he report?

  2. How is the work divided between multiple SCs?

  3. Does the ROSS-SC staff work coordinate with other programs you may be running?

    1. What other self-sufficiency or service-related programs do you run?

    2. Do they take steps to avoid duplication of program activities or participants served? If so, what kind of steps do they take?

    3. Do you use the ROSS program to leverage funding or resources from within your agency? From external funders or agencies?

  4. Do you expect to continue applying to be a ROSS site in the future?

    1. If not, why?

      1. [PROBE: RAD, OTHER LOSS OF PUBLIC HOUSING, STRATEGIC PLAN CHANGES, OTHER]

  1. Do you run any other self-sufficiency focused programs?

    1. [IF NEEDED, PROMPT]:

      1. Family Self Sufficiency (FSS) program?

      2. Are there any interactions or overlaps between the ROSS and FSS or other self-sufficiency programs?

[INTERVIEWER READS] Now we’d like to turn the conversation to talk a bit about the characteristics and activities of your Service Coordinator/s

  1. What are the qualifications (education, experience) for the Service Coordinator position and the Service Coordinator Manager position?

    1. How are they compensated?

  2. What type of training and technical assistance do you provide to your service coordinators?

    1. Do your service coordinators receive any training from other sources, such as the Office of Field Operations, or the HUD Field Office staff?

  3. How frequently do service coordinators turn over?

  4. What activities do the service coordinators conduct as part of the services they provide to residents?

  5. How do coordinators conduct outreach to residents?

  6. Are the ROSS participants similar or different from participants in other programs or services that you offer?

    1. If yes, how? [PROMPT: BY TYPE OF NEEDS, INTERESTS, DEMOGRAPHICS, OTHER CHARACTERISTICS]

  7. What types of partners do you interact with?

    1. What types of services do these partners provide?

    2. Who maintains the relationships with these various partners or referral agencies?

    3. Is someone charged with maintaining regular communication with these partners/agencies?

    4. Does someone strategize with them about how to meet your residents’ needs?

      1. Give them feedback on your residents’ experiences with their services?

    5. Who runs the partner organizations?

      1. State/local governments?

      2. Non-profits?

      3. Charities?

    6. Which resources do you wish you could improve or expand for residents?



[THESE QUESITONS MAY EITHER BE SAVED OR REPEATED FOR THE INTERVIEW WITH THE DATA MANAGER]
We would like to ask you some questions about the data that you submitted both in your proposed logic model as well as the reporting data submitted to HUD. These questions are only so that HUD can better understand how grantees are interpreting the data fields and to improve their process moving forward. We are not evaluating your performance specifically.


  1. How do you, as a ROSS-SC grantee compile and track their data throughout the year?

    1. Do they use a case management system?

  2. What documentation do you keep on the program and its participants and for how long?

  3. Who set the goals you use in the ROSS-SC Logic Model during the application phase?

  1. What role does the SC play in determining the goals on the logic model?

  2. Who completes the Logic Model during grant implementation?

  1. Did the FY14 mandatory metrics affect the services you provide, the partners you work with, or your program’s overall design or mission? How?

  2. How do you count the number of residents “served” by the service coordinator reflected in the logic model?

  1. [PROMPT] Do you count individual sessions with residents?

  2. The number of individuals served?

  3. Number of referrals or programs each individual is involved in? [DISPLAY A COPY OF THE LOGIC MODEL FOR CLARIFICATION]

  1. The logic model provides a space for projected and for recorded numbers. How do you determine the values for the projected numbers?

    1. When filling out the form, are the projected numbers always referring to next year’s goals, or are they goals you set for yourselves for the current reporting period?

  2. In looking at the data we received from HUD, we see that there are larger discrepancies between your projected and recorded numbers, such as in the Seniors/Disabled-Service Coordination-Referrals for senior/disability services sections [DISPLAY A COPY OF THE DATA REPORTED FOR CLARIFICATION]. Do these numbers look right to you?

    1. What are some of the reasons for this discrepancy?

    2. Why are the projections the same for each senior category, but the recorded numbers vary?

22. How do you understand the difference between services/activities and outcomes?

    1. Both categories seem to have a projected and recorded option. Can you explain how you view the difference between these two areas?

    2. Why do the numbers vary between these two areas of reporting, for both the projected and recorded values?

[INTERVIEWER READS] Finally, we have a few questions we would like to ask related to our Outcome Evaluation

  1. How successful do you think your program is?

    1. What indicates success to you?

  2. What do you think contributes most to program success?

  1. Capacity of SET

  2. Capabilities of service coordinators

  3. Characteristics of program participants

  4. Availability of services/partners

  5. Additional factors

  1. What are the biggest challenges to the program’s success?

  1. Costs

  2. Staffing

  3. Resident participation rates

  4. Case loads

  5. Service/Partner availability

  6. Reporting metrics – appropriate way to measure outcomes?

  7. Etc.

[INTERVIEWER SHOULD TAKE THIS TIME TO NOTE IN WRITING ANY RELEVANT INFORMAL OBSERVATIONS]



Partner

  1. What types of services does your organization provide?

  2. What are your organization’s strengths?

    1. What do you think contributes most to program success for your clients/participants?

    2. What indicates success to you?

  3. How long have you been working with [GRANTEE]?

    1. Do you know that [GRANTEE] is receiving a ROSS Service Coordinator grant?

    2. What do you know about the ROSS-SC program?

  4. How long have you been working specifically with the ROSS Service Coordinator program run by [GRANTEE]?

    1. What governs your partnership with them?

      1. A Formal partnership, such as a subcontract, or a Memorandum of Understanding?

      2. An Informal relationship or referrals?

      3. A Local Partnership Council?

  5. How do you serve clients referred to you from [GRANTEE]?

    1. What kinds of supports do you provide those clients?

    2. Do you have regular communication with the Service Coordinators (include names of SC’s, if known)? General communication or about specific clients?

    3. How do you track and report on participant progress?

      1. To whom do you report?

    4. How do you keep participants engaged?

      1. What are the major obstacles?

  6. What are your biggest challenges to meeting their need for services?

  1. Funding

  2. Need

  3. Coordination

  1. What could improve your ability to serve clients?

    1. Is there anything that might strengthen the partnership between [GRANTEE] and you/your organization?



[INTERVIEWER SHOULD TAKE THIS TIME TO NOTE IN WRITING ANY RELEVANT INFORMAL OBSERVATIONS]

1


File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
AuthorMyhre, Marina L
File Modified0000-00-00
File Created2021-01-21

© 2024 OMB.report | Privacy Policy