Attachment D - State System Interview Protocol for Local Partner Staff

Attachment D

Apprenticeship Evidence-Building Portfolio

State Apprenticeship Systems Capacity Assessment Semi-Structured Interview Protocol for Local Partner Staff

Apprenticeship Evidence-Building Portfolio

State Apprenticeship Systems Capacity Assessment

Local Partner Staff Discussion Guide

INTRODUCTION 

I am/we are researchers with The Urban Institute/Mathematica, private research organizations based in the Washington, DC area that conduct policy-related research on a variety of social welfare and economic issues. This project is being conducted under a contract to the U.S. Department of Labor.

Our interview today is for a study of state apprenticeship systems and partnerships that support Registered Apprenticeship and pre-apprenticeship, sponsored by the U.S. Department of Labor. During this interview, we want to better understand how your state apprenticeship system works and learn more about how your organization partners with [name of local lead organization] to support [add in topics of focus for this interview/state]. We will also be interviewing state apprenticeship staff and representatives of other local organizations and employers who are engaged in apprenticeship activities.

Privacy Statement:  We expect the interview to take approximately one hour. I/we know that you are busy and we will be as focused as possible and will only ask questions that are relevant to your experience. We have many questions and will be talking to many different people, so please do not feel as though we expect you to be able to answer every question. Your participation in this interview is voluntary and you may choose not to answer some or any of our questions. We will do everything we can to secure the privacy of the information you provide, but the technical limitations with Zoom and other internet platforms mean that we cannot guarantee the confidentiality of what is said. Also, we ask that you consider using headphones or finding a private space to talk so that other people cannot hear or see this conversation. We believe the risks of participating in this study are minimal.

While there may be no direct benefits to you, we believe your participation in this study will benefit DOL and the broader apprenticeship field by providing research insights on how apprenticeship programs can be strengthened to benefit workers and industry.

My colleague and I will be taking notes in order to document what we hear during our discussion, and we may record this discussion. We do not share these notes with anyone outside of our research team, including Department of Labor, and we will destroy these notes after the end of our project. When we compile our reports, the names of individual respondents will not be included. If we choose to quote you, you will only be identified by your title. You will not be quoted directly by name in any of our reports. While it is possible that you might be identified by your title, we will do our best to minimize the chance of that occurring.

Finally, to help us accurately capture the information you share, we would like to record this interview. The recording is just a back-up for our notes and will be kept within our small research team. The interview recording will be deleted once we have developed a full set of notes from the interview.

OMB Burden Statement: According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such collection displays an Office of Management and Budget (OMB) control number. The valid OMB control number for this information collection is XXXX-XXXX. The time required to complete this collection of information is estimated to average 60 minutes, including the time to review instructions, search existing data resources, gather the data needed and complete and review the collection of information. Send comments regarding the burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Chiefevaluationoffice@DOL.gov and reference the OMB Control Number XXXX-0NEW.

Do you have any questions before we begin?

[If we decide to record the interview] Are you okay with us recording the interview to improve the accuracy of our notes?

Do I have your permission to begin the interview? [BEGIN INTERVIEW IF CONSENT GRANTED]

1. Respondent/Organizational Background

1. Information about the respondent(s):

   1. Name, title, organization, role in apprenticeship activities

   2. Length of involvement with the organization and with apprenticeship

2. Information on the organization:

   1. Mission of organization; role in apprenticeship activities

   2. Estimate of how many of the organization’s employees work on apprenticeship

   3. Connections to the local apprenticeship staff/local lead organization

2. Local Apprenticeship Goals

1. Description of goals

   1. Target industries

   2. Employers/sponsors

   3. Recruitment of apprentices/diversity

   4. Regions/rural areas

   5. Partnerships

   6. Funding/policy changes

   7. Data infrastructure/performance measurement

   8. Other

2. How local goals align (or not) with state/local goals/initiatives

3. Local capacity to achieve goals

   1. Changes over time

3. Local Context – Economic, Policy and Funding for Apprenticeship

1. Economic Context [Review available industry and labor market information prior to interview.]

   1. Worker shortages

   2. Workforce characteristics

   3. Major/growing industries

   4. How it has shaped apprenticeship strategies

2. Policy Context [Review state legislation/policy guidance prior to interview.]

   1. How legislation in the past 5 years has supported/hindered apprenticeship efforts

   2. Involvement in Governor or state agency-led initiatives related to apprenticeship

   3. Use of state policy guidance developed/issued related to apprenticeship

   4. How new or expanded policy has shaped organization’s apprenticeship strategies

3. Funding Context [Review available information on state budget and grants awarded to state, which could be a federal or foundation source, and information on DOL grants.]

   1. Organization’s budget/sources for apprenticeship activities

   2. Sharing of funding/resources with local organizations

   3. Receipt of funding via federal grants (grantee or subgrantee) (use for expansion, strategies, industries)

   4. Foundation and state grants (use for expansion, strategies, industries)

   5. Other funding/resources (employers, state budget, local government)

   6. How funding deployed

   7. Added value of funding/measuring return on investment

4. State and Local Partnerships

1. Description of partnership with local lead organization (goals, role, resources, strategies)

2. Partnerships with other local institutions/organizations (goals, role, resources, strategies)

   1. Workforce development boards/American Job Centers

   2. Employer/industry

   3. Community colleges and other training providers

   4. Non-profit/community organizations

   5. School districts, career-technical high schools

   6. Other

3. Partnerships with statewide entities (goals, role, resources, strategies)

   1. State apprenticeship agencies or regional Office of Apprenticeship

   2. State workforce agency/workforce development board

   3. Industry associations

   4. Unions or other labor organizations

   5. State higher education agency

   6. Other

4. Resources/funding to support partnerships

5. Outcomes

6. Successes and challenges of partnerships

7. Sustainability of partnerships

8. Added value of partnerships

5. The COVID-19 Pandemic and Apprenticeship

1. Effect of COVID on apprenticeship in your locale

   1. Expansion

   2. Program operations

   3. Recruitment of apprentices

   4. Recruitment of employer sponsors

   5. Outcomes for apprentices (completion, retention in jobs)

   6. Other

2. Strategies to address challenges in partnership with the local lead organization

   1. Virtual delivery of on-the-job training and related instruction

   2. Virtual delivery of supports (e.g., mentoring)

   3. New/enhanced partnerships

   4. Changes to resources/funding

   5. Changes to deployment of resources

   6. Changes to policy and regulations

   7. Other

3. Successes and challenges

4. Strategies that will last beyond pandemic

6. Apprenticeship Expansion in Rural Areas and to Combat the Opioid Crisis

   1. Rural apprenticeship

      1. Goals for rural expansion

      2. Industries

      3. Structure and funding

      4. Partnerships

      5. Recruitment of employers/sponsors

      6. Target populations

      7. Outcomes

      8. Sustainability and future plans

      9. Successes and challenges

      10. Added value/return on investment

   2. Apprenticeship strategies to combat the opioid crisis in partnership with the local lead organization

      1. Goals for expansion to combat the opioid crisis

      2. Structure and funding

      3. Recruitment/engagement of healthcare employers

      4. Occupations of interest (e.g., counselors, community health workers)

      5. Partnerships

      6. Target populations

      7. Outcomes

      8. Sustainability and future plans

      9. Successes and challenges

      10. Added value/return on investment

7. Financial Incentives to Expand Apprenticeship

1. Goals for financial incentives

2. Structure and types of incentives

3. How targeted

4. Resources/funding

5. Deployment

6. Use of incentives

7. Outcomes

8. Sustainability and future plans

9. Successes and challenges

10. Added value/return on investment

8. Efforts to Increase Diversity in Apprenticeship

1. Goals for increasing diversity (racial, gender, etc.)

2. Targeted populations (adults, youth, incumbent workers, etc.)

3. Resources/funding

4. Partners

5. Strategies for recruitment, placement, and retention

6. Outcomes

7. Successes and challenges

8. Sustainability and future plans

9. Added value/return on investment

9. State Support for Local Apprenticeship Activities

1. State initiatives/activities to support local apprenticeship activities

   1. Goals (connections to larger state apprenticeship strategy)

   2. Industries of focus

   3. Target populations

   4. Strategies developed

   5. Partnerships

2. State resources provided (other than funding; see above)

   1. State staff

   2. Data infrastructure

   3. Employer relationships

   4. Others?

3. Reporting local outputs/outcomes

4. Successes and challenges

5. Sustainability of local apprenticeship activities should federal/state support diminish

10. Employer Recruitment

1. Goals for recruitment (numbers, industries, regions)

2. Resources/funding

3. Marketing/communications strategies

4. Role of financial incentives

5. Partners, including workforce system

6. Strategies for rural employers or small businesses

7. Recruitment in nontraditional industries

8. Successes and challenges

9. Sustainability and future plans

10. Added value/return on investment

11. Registration of Apprenticeship Programs [Note: tease out differences between SAA and OA states]

1. Steps in registration process

2. Length of time from start to finish

3. Resources/funding

4. Sponsor/employer support and satisfaction with process

5. Challenges/”pinch” points during process

6. Changes/improvements to process over time

7. Successes

8. Future plans

12. Data Infrastructure and Performance Measurement for Apprenticeship

1. Goals/measures of local apprenticeship performance

2. Description of data system

   1. Data collected/data not collected but would like to

   2. Capacity of system to support data entry/collection

      1. Resources/staffing

      2. Technology

   3. Upgrades/changes over time

   4. Links to other data systems

   5. RAPIDS

   6. Advantages/challenges with system

3. Use of data

   1. Tracking and monitoring

   2. Outcomes reporting and evaluation of programs/strategies

   3. Dissemination of apprenticeship performance

   4. Use for decisionmaking

      1. Changes/improvements to existing strategies/program components

      2. Informing new strategies/program components

   5. Successes and challenges

11