OMB Control Number: 0560-0286
OMB Expiration date: 11/30/2020
Farmers.gov Tree Testing Study Plan
The objective of this study is to evaluate the findability of content through the Farmers.gov navigation hierarchy and labeling system. The research question for this study is:
RQ: Does the current structure and labeling system of the Information Architecture support the way users look for information in order to complete priority tasks?
A Tree Test is a task-based research method that quantifies the findability of priority content on a website by using only the labels and structure of the navigation. Participants will be asked to find priority information by only using a navigational tree, without any design elements or search functions.
The tests will be performed remotely via the online tool Tree Jack and will be unmoderated. The entire study should take no more than 20 min. Users will be able to complete it on their own time using a desktop computer with internet connection. Some of the metrics we will be able to gather from Tree Jack include:
Task by task success rates
Time to complete task successfully
Path analyses
Destination table with probable problem areas
A hurricane has impacted your cattle. See if there are any resources that can help you with that.
Success = Recover -> Livestock Indemnity Program
Success = Recover -> Emergency Assistance for Livestock, Honeybees, and Farm-Raised Fish Program
Success = Recover -> Disaster Assistance Discovery Tool
You need to schedule time to meet with your local USDA service center representative. Find where you can do that.
Success = Connect -> Make an Appointment
You want to enlarge your existing farm and you want to find out if the USDA can help you with the necessary finances. See where you can find this information.
Success = Fund -> Farm Loans - > Farm Ownership Loan Program
You are new to crop farming and you want to find out the most important USDA deadlines (crop insurance deadlines etc.) in one place. Where can you find this information?
Success = Connect -> Search the Calendar
You have decided that you want to become a farmer and you want to find out what economic assistance is available to you. See where you can find this information.
Success = Fund -> Targeted Loans -> Beginning Farmers and Ranchers Loans
Protecting your farm land and the environment is important to you as a farmer and you want to learn how you can do that. See where you can find that information.
Success = Conserve -> Explore Conservation Practices
Your vines were impacted by excessively strong winds last year and you want to know if you can receive any help from USDA. Where can you find this information?
Success = Recover -> 2017 Wildfires and Hurricanes Indemnity Program
Success = Recover -> Tree Assistance Program
Success = Recover -> Disaster Assistance Discovery Tool
You are looking for help with your farm’s irrigation system. Where can you find that ?
Success = Conserve -> Learn about funding for conservation -> Environmental Quality Incentives Program
Success = Recover -> Environmental Quality Incentives Program
You want to find out about field days coming up near you. See where you can locate this information.
Success = Connect -> Calendar
You are interested in finding trade data for your crops. See where you can find that.
Success = Manage -> MARS Market Prices
You are ready to step down and hand over the day-to-day operations of your farm to someone else and you want to learn about the process. See where you can find this information.
Success = Manage-> Retirement Information
After each task:
Task completion confidence on a 1-7 scale
1 = Not at all confident
7 = Extremely confident
Task difficulty on a 1-7 scale
1 = Not Difficult at All
7 = Extremely Difficult
At the end of the test:
What was the most difficult thing about this exercise and why?
(List of all tasks to aid user cognition)
The ideal sample size for this study is 35-50 participants. We will recruit participants through the use of a recruitment survey published on the live farmers.gov site. Participants will need to meet certain criteria to be eligible for this study (see Farmers.gov Usability Testing Screener language section).
Farmers.gov team members will be responsible for identifying potential candidates and communicating with them about the study. Participants will be sent a link to the Tree Test to complete on their own time before the due date. There will be no incentive offered.
How familiar are you with farmers.gov
I’ve never heard of it
I’m aware but have never used it
I’ve used it a few times
I use it often
Which category best describes you?
I’m a beginning farmer
I’m a mid-career farmer
I’m an established farmer
Neither
What type of farming do you do?
Open ended
Do you have access to a computer with reliable internet connection?
Yes
No
How old are you?
Under 18
18 -23
24 - 44
45 - 54
55-65 +
Please select timeslots when you are available for a one-hour discussion session
Grid with timeslots
What is your contact email address or phone number (whichever you prefer)?
Open ended
The results of this study will be presented in a findings and recommendation report shortly after the completion of the study.
Scheduling will be done manually by MetroStar System team members via email.
We need help from producers like you. Please take a few minutes to answer a few questions to see if you are eligible to participate in a study with farmers.gov
All PII and personal data from potential participants will be stored in the federally-approved survey software (e.g., Qualtrics).
Any use of data stored in the survey software will be anonymized and aggregated. Documents containing PII that are exported from the survey software, such as Microsoft Excel files, will be password protected or encrypted.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Microsoft Office User |
File Modified | 0000-00-00 |
File Created | 2021-01-13 |