Assessing and Evaluating the Effectiveness of Hazard Recognition and Risk Assessment Interventions

Attachment B

EXAMiner Evaluation Interview Guide

Form Approved

OMB NO. 0920-0953

Expiration Date: 7/31/2018

[This Evaluation Interview Guide will be used with the person responsible for using EXAMiner. This person is likely to be a safety professional. This interview will take place during Visit 1].

Participant information

Participant ID:______________ Date: ____________

Job title: _________________________________ Years Mining: ________

Are you the person who usually does Part 46 Annual Refresher Training? Yes or No

• If yes, how long have you been responsible for Part 46 Annual Refresher Training? __________months or years

• If no, was this your first experience? Yes or No (clarify, if needed)

Preparing to use EXAMiner [Usability/Ease of Use]

When preparing to use EXAMiner:

• Was the software easy to install and set up? Yes or No What made it hard or easy?

• Could you find what you needed to prepare to use EXAMiner? If not, what was difficult to find?

• Were you able to navigate through EXAMiner, from page to page?

• Did anything break while you were using it (did it crash? Did you identify any errors?)

Presenting EXAMiner [Usability/Ease of Use]

In total, how many times have you used EXAMiner? __________

How large were the training groups you presented to?

Who was the primary audience?

Can you briefly describe how you displayed EXAMiner?

• Did you use a projector?

• If yes, did you feel that your trainees had good visibility of the panoramic pictures?

• If yes, did you feel that your trainees had good visibility of the training module?

• If no, how did you display EXAMiner?

Using EXAMiner [Usability/Ease of Use/Reaction]

Public reporting burden of this collection of information is estimated to average 60 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to CDC/ATSDR Information Collection Review Office, 1600 Clifton Road NE, MS D-74, Atlanta, Georgia 30333; ATTN: PRA (0920-0953).

If you were able to pass on any information to other trainers about using EXAMiner, what suggestions would you make?

Probes for additional information:

• Structure your training class to use EXAMiner?

• Any suggestions for how to use EXAMiner in a group?

EXAMiner Debriefing [Reaction/Satisfaction]

Did you choose to debrief your trainees’ performance after they searched through the first set of 4 pictures? Why or why not?

Tell me how you conducted a debrief session?

• What did you focus on during the debrief?

Probes:

• Overall accuracy?

• The hazards that were identified?

• The hazards that were missed?

• The supplemental materials?

Can you give me an example of how your trainees may use this information in the field?

Future Use (Reaction/Satisfaction)

How do you plan to use EXAMiner again?

What will you do differently the next time you use EXAMiner?

Would you recommend this product to other trainers? Why or why not?

What value do you see EXAMiner and the training bringing to the mining industry?

Changes (Reaction/Satisfaction)

What changes can we make to improve EXAMiner before we make it widely available to the industry?