Assessing Models of Coordinated Services for Low-Income Children and Their Families (AMCS)

State TELEPHONE INTERVIEW INVITATION

T o: [DIRECTOR OF STATE APPROACH]

Subject: We invite you to join a conversation about [STATE APPROACH NAME]!

Dear [DIRECTOR OF STATE APPROACH]:

[IF APPROACH COMPLETED PROFILE] Thank you again for helping us learn more about [STATE APPROACH NAME] by confirming a profile about your coordinated services approach. As part of the Assessing Models of Coordinated Services for Low-Income Children and Their Families (AMCS) study, we are following up to invite you to participate in a conversation about your process for service coordination for families. We would like to invite staff from [STATE APPROACH NAME] to participate in a one-hour telephone interview so we can learn more about your coordinated services approach.

[IF APPROACH DID NOT COMPLETE PROFILE]. We recently contacted you about an important new project that the Administration for Children and Families (ACF) within the U.S. Department of Health and Human Services is conducting, called Assessing Models of Coordinated Services for Low-Income Children and Their Families. We would like to invite you and staff from [STATE APPROACH NAME] to participate in a one-hour telephone interview so that we can include your work in this important study!

[ALL APPROACHES] We would like to talk with you and other staff at [STATE APPROACH NAME] about your experiences at [STATE APPROACH NAME] in order to understand how coordinated services approaches work, including topics such as partnerships, strategies for service delivery, staffing, and data sharing. If you would like to participate in this telephone interview, we ask that you identify a few staff (between two and five) who you think could provide information about the coordination process, from both the development of the coordinated services approach to the current operations. We are happy to discuss an approach to selecting staff to participate if that would be helpful.

We will call you in the next few days to answer any questions you have and discuss this opportunity. In the meantime, please contact me by email [EMAIL] or phone [PHONE] if you have questions or would like to discuss the study.

Sincerely,

[NAME]

Paperwork Reduction Act Statement: The referenced collection of information is voluntary. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB control number for this collection is 0970-0356 and it expires 06/30/2021.

STATE TELEPHONE INTERVIEW INVITATION follow-up phone script

Protocol for STATE TElephone interview invitation

Interviewer instructions: The goal of this telephone call is to follow-up on an email request to invite staff from state and local coordinated services approaches to participate in a telephone interview. Please ask to speak to the director of the coordination approach (or someone in the equivalent role). If that person is not available, please use the information below to briefly describe the study and the request and ask if there is anyone else to speak to or if the director of the coordination approach could return your call. Once you are speaking to the director, or other person who is able to address the request, please follow the protocol below.

Telephone protocol:

INTRODUCTION

Hello, my name is ________ and I am from an organization called Mathematica. I am calling about a study called Assessing Models of Coordinated Services for Low-Income Children and Their Families. I’m following up on an email I sent last week inviting you to participate in a telephone interview about your approach to coordinating services for children and their families. Did you receive that email?

[IF NO]. I am sorry to hear you did not receive the email. I can tell you about the opportunity briefly now. Do you have about five minutes to talk now?

[If YES] I’d like to tell you a little more about the interview and see if you are interested in participating. Do you have five minutes to talk now?

[IF YES, OK TIME] Great. Thank you.

[PROCEED WITH “ABOUT THE STUDY AND INTERVIEW]

[IF NO, NOT OK TIME] No problem, is there a better time for me to reach you? [IF YES, PLEASE CONFIRM ALTERNATE TIME]. I will call you back then. Thank you very much. [IF NOT INTERESTED AT ALL/REFUSES, SKIP TO “IF DECLINED” AT END]

ABOUT THE STUDY AND STATE TELEPHONE INTERVIEW

The Assessing Models of Coordinated Services study is being conducted for the Administration for Children and Families in the U.S. Department of Health and Human Services. The goal of the study is to learn more about how states and communities are coordinating services to serve children and their families. We would like to talk with you and other staff at [STATE APPROACH NAME] about your experiences at [STATE APPROACH NAME] in order to understand how coordinated services approaches work, including topics such as partnerships, strategies for service delivery, staffing, and data sharing. We will use this information to help inform others in the field about how coordinated services can best support families. We estimate that the telephone interview will take one hour. If you would like to participate, we would ask you to identify a few staff (between two and five) who you think could provide information about the coordination process, from both the development of the coordinated services approach to the current operations. If you think there is one person who would have all of this information it is also fine to identify just one person.

SCHEDULING THE STATE TELEPHONE INTERVIEW

We would like to schedule the interview between [DATE] and [DATE] [REFER TO TIME PERIOD]. When would be a good time for you and your staff? We can follow-up after this call by email if that is best.

IDENTIFYING STATE TELEPHONE INTERVIEW PARTICIPANTS

Prior to the interview, we would like to ask that you please provide an organizational chart, if you have one, and a list of people who will participate in the interview. Both of these documents will help us to prepare for the conversation and make the interview as efficient as possible. We can email you a reminder about this as well as a form to complete to identify the interview participants. [CONFIRM EMAIL ADDRESS]

CLOSING

[IF AGREED] Thanks so much, I look forward to speaking with you and your colleagues on [DATE]. I will follow up with a request for staffing information prior to that call.

[IF DECLINED]. Thank you for speaking with me. We have enjoyed finding out about your coordinated services approach through our public documents and we wish you continued success.

AMCS State Telephone Interview Protocol

Thank you for your willingness to speak with us today about [State approach]. My name is [Interviewer 1], and I work for Mathematica. My colleague, [Interviewer 2] has also joined us today.

Let me provide some background. As we’ve mentioned in previous communication, the Office of Planning, Research and Evaluation at the Administration for Children and Families within the U.S. Department of Health and Human Services, contracted with us to study how states and communities coordinate different types of services for children and families. When we talk about coordinating or integrating services, we mean providing families with high quality early care and education, and simultaneously addressing additional family needs, like income supports, health and mental health services for children and their families, job search and training, and other types of health and human services. Earlier, we conducted a nationwide scan of coordination approaches in operation, which is how we came to learn about [State approach]. We recently sent a profile with information we gathered on [State approach]. [If approach confirmed profile] We appreciate [name(s)] verifying the information to help us learn more about your work and prepare for this call. [If approach did not confirm] Today, we would like to walk through that profile with you and ask some additional questions so that we can learn more about your work.

We are not evaluating [State approach]. Instead, we are gathering information across several state and local approaches, to better understand how coordination looks in different settings. We know that we have a group of people on the phone with us today, so as we ask questions perhaps the person who is most familiar with that topic can chime in first. However, if others have anything to add, please do not hesitate to speak up. We have a lot to cover in our discussion today so I may have to move our conversation along at times.

Your participation in this interview is voluntary, and what you say today will be considered private to the extent provided by law. Information will be summarized across interviews and your names will not be associated with your comments in any reports. The reports might list and describe coordinated services approaches that contributed information, but we will not quote you by name or title. You may refuse to answer any question and may stop the interview at any time. If it is ok with you, we will take notes over the course of the interview so that we can remember the information we collect. Do you mind if I also record the conversation? It will help us ensure we accurately capture our discussion today. [If yes, start recording.] Our notes and the recording will be stored on a secure drive, and destroyed when this project is over.

An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid Office of Management and Budget control number. The Office of Management and Budget number for this information collection is 0970-0356 and the expiration date is 06/30/2021.

Do you have any other questions? If not, then I’ll get started.

I’d like to first confirm who is on the call today, and get familiar with each of your voices as we start our conversation. Would you each please briefly introduce yourself with your name, job title or role in [State approach]? Thank you for sharing staffing information with us ahead of the interview [Interviewer Note: Review the model staffing information. Confirm that the individuals listed on the staffing information form are on the call and make note of any staff who are not present or who are present, but were not listed on the staffing information chart].

[Interviewer Note: Review the state model profile. For fields that are missing information, please first prompt the interviewees to respond/fill in that information before starting the interview questions.]

[Interviewer Note: As you go through the interview protocol, you will see references to lines in the model profile that these questions are expanding upon. Refer to the information from that line in the model profile as you ask these questions. Please pace the interview such that you reserve 5-10 minutes at the end to ask the follow-up questions that appear at the end of section C.]

A. Development of Approach

We’d like to learn more about how [State approach] was developed.

• What is [State approach] doing to coordinate services to improve outcomes for children and families?

  • Expanding on line 3 in model profile

• Can you tell us a little more about how the [State approach] was developed? [Probe: Was it a response to a challenge? Was there a state investment? A push from an advocacy organization? Sometimes, changes to the ways of doing work and delivering services have “champions”, who are individuals whose enthusiasm and vision is a driving force behind the change. Were there any legislative, executive or agency-level champions that led to the development of the coordinated services approach?

  • Expanding on line 7 in model profile

• What aspects of [State approach] have been most successful?

  • Expanding on line 9 in model profile

• What challenges have you encountered in [State approach]? How have you worked to overcome these challenges?

  • Expanding on line 9 in model profile

• What changes would you make to [State approach]? [Probe: Do you anticipate making any changes to [State approach]? What changes do you anticipate making?]

  • Expanding on lines 9 and 28 in model profile

• How do federal and state policies and regulations affect your ability to provide coordinated services to families, including things like combining funding streams, building and maintaining partnerships, or other aspects of coordination? [PROBE: For example, there can be different eligibility criteria for service funding streams?]

  • Expanding on line 34 in model profile

• Is input from families used to design, refine or govern [State approach]? If so, please describe. Is your coordinated services approach a product of human-centered design, or design thinking? Human-centered design is a framework that develops solutions to problems by involving the perspective of the user [families] in all steps of the problem-solving/design process.

B. Partners in coordination

A component of providing coordinated services to children and families includes building partnerships. Next, we’d like to discuss how you engage with partners to coordinate services for children and families.

• Interviewer note: prepare this question by referring to line 16. We understand that the lead partner is [FILL IN] and that some important partners are [FILL IN]. How were partners identified and how did the partnerships develop?

  • Expanding on lines 16 - 20 in model profile

• Are partnerships formalized in some way, such as through a formal governance structure or MOU? If so, what is included in the [agreement/MOU]? [PROBE: Does it include blending of funds?]

  • Expanding on line 16 - 20 in model profile

• How do the [State approach] partners communicate?

  • Expanding on line 16 - 20 in model profile

• What are the roles of the partners that are involved with [State approach]?

  • Expanding on line 16 - 20 in model profile

• Who is involved in decision-making? [If a group/multiple organizations] Does this group meet regularly? What are they responsible for? How are decisions made? How are disagreements resolved?

  • Expanding on line 16 - 20 in model profile

• How did you build and maintain buy-in among partners?

  • Expanding on line 16 - 20 in model profile

• Are there entities you are not partnering with but that you wish you could involve (or that you plan to involve in the future)?

  • Expanding on line 16-20 in model profile

• Has the partnership changed over time? If so, why and when? Are there any policies (local, state, or federal) that have helped facilitate building and maintaining partnerships? Have any policies or laws made partnering challenging? [PROBE: For example, different eligibility criteria for service funding streams?]

  • Expanding on line 16 - 20 in model profile

• What barriers or challenges have you encountered through building partnerships? How have you addressed these barriers?

  • Expanding on line 16 - 20 in model profile

• What do you see as the benefits of partnering to deliver coordinated services?

  • Expanding on line 16 - 20 in model profile

• Does the [State approach] receive any funding specifically aimed at helping to support the coordination of services or to help you collaborate with partners?

  • Expanding on line 11 - 15 in model profile

C. Services

We’d like to learn more about how services are coordinated and your role in coordinating services for children and families.

• What types of outreach does [State approach] conduct to other agencies or service providers to identify eligible families for [State approach]?

  • Expanding on lines 21 and 25 in model profile

• Are there different eligibility rules for different components of the coordination approach?

  • Expanding on line 25-26 in model profile

• Has [State approach] worked to change eligibility criteria for any services? Has [State approach] tried to align requirements? Are there federal or state barriers related to eligibility or enrollment?

  • Expanding on line 26 in model profile

• What is [State approaches’] role in facilitating local implementation of the coordinated services approach? [Interviewer Note: If State facilitates local implementation, ask follow up questions. Otherwise, skip to next section on “Data systems and use”].

Expanding on line 4 and 5 in model profile

• How are communities across your state selected as local implementation sites?

  • Expanding on line 5 in model profile

• Are there differences in how local sites in different communities are coordinating services? For example, are there differences in rural versus urban counties in your state?

  • Expanding on line 4 in model profile

• How does the [State approach] support staff implementing the approach locally?

  • Expanding on lines 3 and 4 in model profile

• Do your partners provide support to staff implementing the approach? What kind of support do service providers often need?

  • Expanding on line 3 in model profile

• Does [State approach] provide or deliver any training or technical assistance to local service providers? Do service providers receive training or technical assistance from other organizations for this coordination?

  • Expanding on line 3 in model profile

• We would love to follow up with one or two local implementation sites in your State to learn more about how they are serving children and families in their community/communities. Is there a local organization or community (or two) you would recommend we reach out to? If so, would you mind if we follow up with you to share contact information?

  • [Interviewer Note: If you have not gotten to this question already, reserve the last 5-10 minutes of the interview to discuss local implementation. Refer to line 4 of the model profile].

D. Data systems and use

We’re also interested in learning about how coordination approaches measure progress for children and families. We’d like to talk about your data system and how you use that data.

• What was the status of your data system when the [State approach] started?

• Have you built it out from there?

• Are partners able to share data?

  • Expanding on lines 29 - 32 in model profile

    • If no, what have been the challenges in sharing data across partners (e.g. security concerns, systems not talking to each other)?

    • If yes, how do you facilitate data sharing among partners? Have there been challenges in sharing data across partners (e.g. security concerns, systems not talking to each other)?

• What do you use the data for? Who uses the data? How do you use data to inform service delivery? To monitor service receipt? To assess the quality of services? To measure progress toward outcomes for the approach?

  • Expanding on line 31 in model profile

• Does the [State approach] receive any funding specifically aimed at supporting data collection or data sharing?

  • Expanding on lines 12 - 14 in model profile

E. Size

• Has the number and/or make up of types of children and families [State approach] serves changed over time? If so, how and why has this changed?

  • Expanding on line 10 in model profile

F. Closing

Thank you for taking the time to share your work and experiences with us today. This discussion has been very helpful in learning more about [State approach]. Do you have any questions before we conclude?

We appreciate your time.