Various Demographic Area Pretesting Activities

---

Overview

original baseline
tasks for 2012
comparison of baseline tasks
Drop Downs

---

Sheet 1: original baseline

Question Number	Original Baseline Questions	Experience Level
1	You plan to move to one of the following cities— Seattle, WA; San Francisco, CA; Washington, DC— and would like to know the average income of females in each city for the last three years. You would like to come back to this information later. You wonder if there is any way to be able to access it all again without having to go through all those steps.	Expert
2	You would like to know the total number of finance and insurance companies in 2002, together. Then, you would like to make some comparisons between the two industries (finance and insurance). You don’t want to see extraneous information, but you would like to see the information displayed with the number of employees first, payroll second and revenue last.	Expert
3	You would like to find a map that displays the counties in California with the most recent data on the average housing values of all homes that are owned (as opposed to rented). Is there a county in Southern California that has a price range between $350,000 and $540,000?	Expert
4	You are interested in the income of senior citizens living in each county in Florida in 2007. You would like to gather the number of households with retirement income and the total retirement income in each county. Once you have these data displayed together, you would like to arrange the data by the highest total retirement income. Then you would like to save your work for later reference.	Expert
5	You would like to know the percent of disabled people in Virginia who are at least 65 years old in 2006. You would also like to find the county with the highest percentage of disabled people. You are looking not just for the numbers but for a map for a presentation you are preparing. When you find the information, you would like to save it in a format that would allow you to insert it into a PowerPoint presentation.	Expert
6	You are looking for the number of health clubs in the following counties in Virginia: Prince William, Fairfax, Stafford, Fauquier, and Loudoun. When you find the information you need, you would like to save it for later use.	Expert
1	You are thinking about moving to Maryland and want to get as much information as you can about Maryland, including how many people live there. How many people live in Maryland?	Novice
2	You are doing research for a project on poverty and want to know which three states had the most people living in poverty in 2006. Are you able to print this information for later use?	Novice
3	You are doing a project about businesses in America through the years. You want to know what type of U.S. business had the highest amount of sales in 2002?	Novice
4	What percent of U.S. imports currently come from China?	Novice
5	How many people worked for the U. S. government in 2002?	Novice
6	You are doing a report on education and to better understand its relationship with environment, you would like the information displayed so that you can see exactly where these states are. Specifically, you want to know what percent of the total population in Virginia, Kansas, Maryland and Texas were college-educated in 2006.	Novice
7	You are working on a project that involves city limits and you are interested in finding the borders of the city of Fairfax in 2000. You would like this information to be displayed visually as you are a visual learner.	Novice
8	You are interested in demographic changes in the U.S. and want to know what the fastest growing age group was, over the age of 45, from 2006 to 2007?	Novice
9	You are interested in various states’ overseas importing and exporting and specifically are interested in Idaho. You want to know which country Idaho increased exports with the most between 2003 and 2004.	Novice
10	You are interested in finding the average salary of households in Virginia and Maryland for 2007. Which state had the highest average household salary?	Novice

---

Sheet 2: tasks for 2012

Question Number	Baseline Question 1Q2012	Modified	How modified	Legacy Only	Expert
Expert Tasks
1	You plan to move to one of the following cities— Seattle, WA; San Francisco, CA; Washington, DC— and would like to know the average income of females in each city for the last three years. You would like to come back to this information later. You wonder if there is any way to be able to access it all again without having to go through all those steps.	No	---	---	Yes
2	You would like to know the total number of finance and insurance companies in 2002. Then, you would like to make some comparisons between the two industries (finance and insurance), so you would like to see the information displayed with the annual payroll first, revenue second, and the number of establishments last.	Yes	Updated	---	Yes
3	You would like to find a map that displays the counties in California with the most recent data on the median housing values of homes that are owned (as opposed to rented). Is there a county in Southern California that has a price range between $450,000 and $540,000?	Yes	Updated	---	Yes
4	You are interested in gathering data about County Business Patterns in 2008. Specifically, you are looking for a list of the Number of Establishments in the state of California by county. You're not interested in downloading employee or payroll data. You want to download the list in descending order to Excel.	Yes	Rewritten	Yes	Yes
5	You would like to know the percent of disabled people in Virginia who are at least 65 years old in 2006. You would also like to find the county with the highest percentage of disabled people. You are looking not just for the numbers but for a map for a presentation you are preparing. When you find the information, you would like to save it in a format that would allow you to insert it into a PowerPoint presentation.	No	---	---	Yes
6	You are looking for the number of health clubs in the following counties in Virginia: Prince William, Fairfax, Stafford, Fauquier, and Loudoun. When you find the information you need, you would like to save it for later use.	No	---	---	Yes
NOVICE TASKS
1	You are thinking about moving to Maryland and want to get as much information as you can about Maryland, including how many people live there. How many people live in Maryland?	No	---	---	---
2	You are doing research for a project on poverty and want to know which three states had the most people living in poverty in 2009. Are you able to print this information for later use?	Yes	Updated	---	---
3	You are doing a project about businesses in America through the years. You want to know what type of U.S. business had the highest amount of sales in 2007?	Yes	Updated	---	---
4	What percent of U.S. exports currently go to Mexico?	Yes	Rewritten	Yes	---
5	How many people worked for the Government in 2010?	Yes	Updated	---	---
6	You are doing a report on education. You want to know what percent of people in Virginia, Kansas, Maryland, and Texas were college-educated in 2006. You would like the information displayed so that you can see exactly where these states are.	Yes	Updated	---	---
7	You are working on a project that involves city limits and you are interested in finding the borders of the city of Fairfax in 2000. You would like this information to be displayed visually as you are a visual learner.	No	---	---	---
8	You are interested in demographic changes in the U.S. and want to know what the fastest growing age group was, over the age of 45, from 2006 to 2008?	Yes	Updated	---
9	You are interested in various states’ labor costs and are interested in finding out which State had the greatest annual payroll in 2002.	Yes	Rewritten	Yes
10	You are interested in finding the average salary of households in Virginia and Maryland for 2007. Which state had the highest average household salary?	No	---	---

---

Sheet 3: comparison of baseline tasks

Question Number	Baseline Question 1Q2012	Modified	How modified	Legacy Only	Expert	Erica check
Expert Tasks
1	You plan to move to one of the following cities— Seattle, WA; San Francisco, CA; Washington, DC— and would like to know the average income of females in each city for the last three years. You would like to come back to this information later. You wonder if there is any way to be able to access it all again without having to go through all those steps.	No	---	---	Yes
2	You would like to know the total number of finance and insurance companies in 2002. Then, you would like to make some comparisons between the two industries (finance and insurance), so you would like to see the information displayed with the annual payroll first, revenue second, and the number of establishments last.	Yes	Updated	---	Yes	change = info displayed
OLD 2	You would like to know the total number of finance and insurance companies in 2002, together. Then, you would like to make some comparisons between the two industries (finance and insurance). You don’t want to see extraneous information, but you would like to see the information displayed with the number of employees first, payroll second and revenue last.
3	You would like to find a map that displays the counties in California with the most recent data on the median housing values of homes that are owned (as opposed to rented). Is there a county in Southern California that has a price range between $450,000 and $540,000?	Yes	Updated	---	Yes
OLD 3	You would like to find a map that displays the counties in California with the most recent data on the average housing values of all homes that are owned (as opposed to rented). Is there a county in Southern California that has a price range between $350,000 and $540,000?
4	You are interested in gathering data about business patterns. Specifically, you are looking for a list of the number of buninesses in California by county. You're not interested in downloading employee or payroll data. You want to download the list in descending order to Excel.	Yes	Rewritten	Yes	Yes	not comparable
OLD 4	You are interested in the income of senior citizens living in each county in Florida in 2007. You would like to gather the number of households with retirement income and the total retirement income in each county. Once you have these data displayed together, you would like to arrange the data by the highest total retirement income. Then you would like to save your work for later reference.
5	You would like to know the percent of disabled people in Virginia who are at least 65 years old in 2006. You would also like to find the county with the highest percentage of disabled people. You are looking not just for the numbers but for a map for a presentation you are preparing. When you find the information, you would like to save it in a format that would allow you to insert it into a PowerPoint presentation.	No	---	---	Yes
6	You are looking for the number of health clubs in the following counties in Virginia: Prince William, Fairfax, Stafford, Fauquier, and Loudoun. When you find the information you need, you would like to save it for later use.	No	---	---	Yes
Novice Tasks
1	You are thinking about moving to Maryland and want to get as much information as you can about Maryland, including how many people live there. How many people live in Maryland?	No	---	---	---
2	You are doing research for a project on poverty and want to know which three states had the most people living in poverty in 2009. Are you able to print this information for later use?	Yes	Updated	---	---	date change
OLD 2	You are doing research for a project on poverty and want to know which three states had the most people living in poverty in 2006. Are you able to print this information for later use?
3	You are doing a project about businesses in America through the years. You want to know what type of U.S. business had the highest amount of sales in 2007?	Yes	Updated	---	---	date change
OLD 3	You are doing a project about businesses in America through the years. You want to know what type of U.S. business had the highest amount of sales in 2002?
4	What percent of U.S. exports currently go to Mexico?	Yes	Rewritten	Yes	---
	What percent of U.S. imports currently come from China?					exports no longer on site
5	How many people worked for the Government in 2010?	Yes	Updated	---	---	date change only
OLD 5	How many people worked for the U. S. Government in 2002?
6	You are doing a report on education. You want to know what percent of people in Virginia, Kansas, Maryland, and Texas were college-educated in 2006. You would like the information displayed so that you can see exactly where these states are.	Yes	Updated	---	---
OLD 6	You are doing a report on education and to better understand its relationship with environment, you would like the information displayed so that you can see exactly where these states are. Specifically, you want to know what percent of the total population in Virginia, Kansas, Maryland and Texas were college-educated in 2006.
7	You are working on a project that involves city limits and you are interested in finding the borders of the city of Fairfax in 2000. You would like this information to be displayed visually as you are a visual learner.	No	---	---	---
8	You are interested in demographic changes in the U.S. and want to know what the fastest growing age group was, over the age of 45, from 2006 to 2008?	Yes	Updated	---	---	date change only
OLD 8	You are interested in demographic changes in the U.S. and want to know what the fastest growing age group was, over the age of 45, from 2006 to 2007?
9	You are interested in various states’ labor costs and are interested in finding out which State had the greatest annual payroll in 2002.	Yes	Rewritten	Yes	---	not comparable
OLD 9	You are interested in various states’ overseas importing and exporting and specifically are interested in Idaho. You want to know which country Idaho increased exports with the most between 2003 and 2004.
10	You are interested in finding the average salary of households in Virginia and Maryland for 2007. Which state had the highest average household salary?	No	---	---	---

---

Sheet 4: Drop Downs

---	---
Yes	Updated	Novice
No	Rewritten	Complex
		Expert