Download:
pdf |
pdfNATIONAL CENTER FOR EDUCATION STATISTICS
NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS
National Assessment of Educational Progress (NAEP) 2019
and 2020
Long-Term Trend (LTT) 2020 Update
Appendix K1
NAEP 2019 Student Questionnaires
OMB# 1850-0928 v.16
October 2018
No changes since v.11
Appendix F provides the library of possible items to be used in the NAEP 2019 and 2020
questionnaires. This appendix (Appendix K1) includes the final version of the NAEP 2019 Student
questionnaires, as well as a summary of any minor, non-substantive, wording changes made as a
result of pilot and cognitive interview results and final reviews. In addition, note that some of the
questionnaires will utilize spiraling in order to minimize respondent burden while maximizing the
amount of items that can be piloted. The spiral maps for these questionnaires are also included.
The confidentiality citation has been updated in September 2018 and is consistent with that
provided in Part A.
Abbreviation Key
CAFS: Computer Access and Familiarity
ESQ: Extended Student Questionnaire
NIES: National Indian Education Study
The items presented in this appendix are those to be used in the digitally based assessments. Some of the
questionnaires will also be administered in paper based assessments. Adaptations to the item-level directions
may be made, as appropriate (for example, “select one answer choice on each row” in DBA would become
“fill in one oval on each line” in PBA).
Contents
Student Questionnaires
Student Login Screen
5
Appendix K-1a: Summary of Changes Operational and Pilot Student Debrief
Grades 4, 8, and 12
6
Appendix K-1b: Operational and Pilot Student Debrief Grades 4, 8, and 12
9
Appendix K-1c: Summary of Changes Operational Grade 4 Core
11
Appendix K-1d: Operational Grade 4 Core
17
Appendix K-1e: Summary of Changes Pilot Grade 4 Core
25
Appendix K-1f: Pilot Grade 4 Core
31
Appendix K-1g: Spiral Map Grade 4 Core
38
Appendix K-1h: Summary of Changes Operational Grade 8 Core
41
Appendix K-1i: Operational Grade 8 Core
49
Appendix K-1j: Summary of Changes Pilot Grade 8 Core
58
Appendix K-1k: Pilot Grade 8 Core
65
Appendix K-1l: Spiral Map Grade 8 Core
74
Appendix K-1m: Summary of Changes Operational Grade 12 Core
77
Appendix K-1n: Operational Grade 12 Core
87
Appendix K-1o: Summary of Changes Operational Grade 4 Reading
97
Appendix K-1p: Operational Grade 4 Reading
103
Appendix K-1q: Summary of Changes Pilot Grade 4 Reading
110
Appendix K-1r: Pilot Grade 4 Reading
117
Appendix K-1s: Spiral Map Grade 4 Reading
125
Appendix K-1t: Summary of Changes Operational Grade 8 Reading
128
Appendix K-1u: Operational Grade 8 Reading
135
Appendix K-1v: Summary of Changes Pilot Grade 8 Reading
145
Appendix K-1w: Pilot Grade 8 Reading
154
Appendix K-1x: Spiral Map Grade 8 Reading
163
Appendix K-1y: Summary of Changes Operational Grade 12 Reading
167
Appendix K-1z: Operational Grade 12 Reading
175
Appendix K-1aa: Summary of Changes Operational Grade 4 Mathematics
186
Appendix K-1ab: Operational Grade 4 Mathematics
193
Appendix K-1ac: Summary of Changes Pilot Grade 4 Mathematics
200
Appendix K-1ad: Pilot Grade 4 Mathematics
208
Appendix K-1ae: Spiral Map Grade 4 Mathematics
216
3
Appendix K-1af: Summary of Changes Operational Grade 8 Mathematics
219
Appendix K-1ag: Operational Grade 8 Mathematics
230
Appendix K-1ah: Summary of Changes Pilot Grade 8 Mathematics
240
Appendix K-1ai: Pilot Grade 8 Mathematics
252
Appendix K-1aj: Spiral Map Grade 8 Mathematics
262
Appendix K-1ak: Summary of Changes Operational Grade 12 Mathematics
266
Appendix K-1al: Operational Grade 12 Mathematics
280
Appendix K-1am: Summary of Changes Operational Grade 4 Science
291
Appendix K-1an: Operational Grade 4 Science
299
Appendix K-1ao: Summary of Changes Operational Grade 8 Science
308
Appendix K-1ap: Operational Grade 8 Science
315
Appendix K-1aq: Summary of Changes Operational Grade 12 Science
323
Appendix K-1ar: Operational Grade 12 Science
333
Appendix K-1as: Summary of Changes Operational Grade 4 NIES
344
Appendix K-1at: Operational Grade 4 NIES
354
Appendix K-1au: Summary of Changes Operational Grade 8 NIES
365
Appendix K-1av: Operational Grade 8 NIES
376
Appendix K-1aw: Summary of Changes Operational Grade 4 CAFS
389
Appendix K-1ax: Operational Grade 4 CAFS
395
Appendix K-1ay: Summary of Changes Operational Grade 8 CAFS
403
Appendix K-1az: Operational Grade 8 CAFS
413
Appendix K-1ba: Summary of Changes Operational Grade 12 CAFS
428
Appendix K-1bb: Operational Grade 12 CAFS
443
Appendix K-1bc: Summary of Changes Operational Grade 4 ESQ
458
Appendix K-1bd: Operational Grade 4 ESQ
466
Appendix K-1be: Summary of Changes Operational Grade 8 ESQ
479
Appendix K-1bf: Operational Grade 8 ESQ
488
Appendix K-1bg: Summary of Changes Operational Grade 12 ESQ
505
Appendix K-1bh: Operational Grade 12 ESQ
514
4
Student Login Screen
Appendix K-1a: Summary of Changes Operational and Pilot
Student Debrief Grades 4, 8, and 12
6
2019 Operational and Pilot Grade 4, 8, and 12 Debrief Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
NC
N/A
D
To keep
student
burden low,
this item was
dropped.
To keep
student
burden low,
this item was
dropped.
(2018 Grade 4, 8, and 12)
(2018 Grade 4, 8, and 12)
(2018 Grade 4, 8, and 12)
Issue: Debrief
Issue: Debrief
N/A
(2018 Grade 4, 8, and 12)
7
2019 Operational and Pilot Grade 4, 8, and 12 Debrief Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
To keep
student
burden low,
this item was
dropped.
(2018 Grade 4, 8, and 12)
8
Appendix K-1b: Operational and Pilot Student Debrief Grades 4, 8,
and 12
9
VH260313
1. How easy or difficult was this test?
A Extremely difficult
B Quite difficult
C Somewhat difficult
D Somewhat easy
E Quite easy
F Extremely easy
VH333658
. How much effort did you apply to succeed on this test?
A No effort at all
B Very little effort
C Some effort
D Quite a bit of effort
E A lot of effort
10
Appendix K-1c: Summary of Changes Operational Grade 4 Core
11
2019 Operational Grade 4 Core Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Race/Ethnicity
Issue: Race/Ethnicity
Issue: Socioeconomic Status
12
2019 Operational Grade 4 Core Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
NC
N/A
NC
N/A
Issue: Socioeconomic Status
Due to
concerns
about
content
relevance and
to keep
student
burden low,
sub-items b
and c were
dropped.
Issue: Technology Use
Issue: School Climate
Issue: Socioeconomic Status
13
2019 Operational Grade 4 Core Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Socioeconomic Status
Issue: Technology Use
Issue: Technology Use
14
2019 Operational Grade 4 Core Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
of the item
was dropped.
Issue: Grit
Issue: Grit
15
2019 Operational Grade 4 Core Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
of the item
was dropped.
Issue: Desire for Learning
Issue: School Climate
16
Appendix K-1d: Operational Grade 4 Core
17
VH260313
1. How easy or difficult was this test?
A Extremely difficult
B Quite difficult
C Somewhat difficult
D Somewhat easy
E Quite easy
F Extremely easy
VH333658
2. How much effort did you apply to succeed on this test?
A No effort at all
B Very little effort
C Some effort
D Quite a bit of effort
E A lot of effort
VH240387
3. Are you Hispanic or Latino? Select one or more answer choices.
A No, I am not Hispanic or Latino.
B Yes, I am Mexican, Mexican American, or Chicano.
C Yes, I am Puerto Rican or Puerto Rican American.
D Yes, I am Cuban or Cuban American.
E Yes, I am from some other Hispanic or Latino background.
18
VH240388
4. Which of the following best describes you? Select one or more answer choices.
A White
B Black or African American
C Asian
D American Indian or Alaska Native
E Native Hawaiian or other Pacific Islander
VH240186
5. About how many books are there in your home?
A Few (0–10)
B Enough to fill one shelf (11–25)
C Enough to fill one bookcase (26–100)
D Enough to fill several bookcases (more than 100)
19
VH271104
6. Do you have any of the following in your home? Select one answer choice on each row.
a. Access to the Internet
b. Your own bedroom
c. A desktop or laptop computer (including
Chromebooks) that you can use
d. A tablet (for example, Surface Pro, iPad,
Kindle Fire) that you can use
e. A smartphone (for example, iPhone,
Samsung Galaxy, HTC One) that you can
use
Yes
No
A
B
VH271105
A
B
VH336762
A
B
VH591976
A
B
VH271110
A
B
VH271112
VH354591
7. How often do you use the Internet for homework at home?
A Never
B About once or twice a month
C About once or twice a week
D Almost every day
E Every day
VH240190
8. How many days were you absent from school in the last month?
A None
B 1 or 2 days
C 3 or 4 days
D 5 to 10 days
E More than 10 days
20
VH240189
9. How often do you talk about things you have studied in school with someone in
your family?
A Never or hardly ever
B Once every few weeks
C About once a week
D Two or three times a week
E Every day
VH271144
10. Do any of the following people live in your home? Select one answer choice on each
row.
a. Mother
b. Stepmother
c. Foster mother or other female legal
guardian
d. Father
e. Stepfather
f. Foster father or other male legal guardian
Yes
No
A
B
VH271145
A
B
VH271146
A
B
VH271147
A
B
VH271148
A
B
VH271149
A
B
VH271150
VH591969
11. In this school year, how often did you use a laptop or desktop computer (including
Chromebooks) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
21
VH271276
12. In this school year, how often did you use a tablet (for example, Surface Pro, iPad,
Kindle Fire) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
VH733141
13. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I finish whatever I
begin.
b. I try very hard even
after making mistakes.
c. I keep working hard
even when I feel like
quitting.
d. I keep trying to
improve myself, even
when it takes a long
time to get there.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733142
A
B
C
D
E
VH733143
A
B
C
D
E
VH733145
A
B
C
D
E
VH733144
22
VH733149
14. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I like complex
problems more than
easy problems.
b. I like activities that
challenge my thinking
abilities.
c. I enjoy situations
where I will have to
think about
something.
d. I enjoy thinking about
new solutions to
problems.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733150
A
B
C
D
E
VH733151
A
B
C
D
E
VH733155
A
B
C
D
E
VH733154
VH271367
15. In this school year, how often have you done each of the following? Select one answer
choice on each row.
a. I started working on
assignments right
away rather than
waiting until the last
minute.
b. I paid attention and
resisted distractions.
c. I stayed on task
without reminders
from my teacher.
d. I paid attention in
class even when I was
not interested.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271370
A
B
C
D
E
VH271372
A
B
C
D
E
VH271374
A
B
C
D
E
VH271375
23
VH271934
16. In this school year, how often have you felt any of the following ways about your
school? Select one answer choice on each row.
a. I felt awkward and out
of place at school.
b. I felt happy at school.
c. I felt that I learned
something that I can
use in my daily life.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271942
A
B
C
D
E
VH271944
A
B
C
D
E
VH336903
24
Appendix K-1e: Summary of Changes Pilot Grade 4 Core
25
2019 Pilot Grade 4 Core Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
R
Sub-items b
and c were
dropped to
keep student
burden low,
and sub-items
e, f, and g
were revised
to examine
performance
of alternative
item wording.
N/A
Issue: Race/Ethnicity
Issue: Race/Ethnicity
Issue: Socioeconomic Status
Issue: Socioeconomic Status
26
2019 Pilot Grade 4 Core Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Technology Use
Issue: School Climate
Issue: Socioeconomic Status
Issue: Socioeconomic Status
27
2019 Pilot Grade 4 Core Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
R
The stem of
this item was
revised for
clarity.
N/A
Issue: Technology Use
(2017 Grade 4)
Issue: Technology Use
(2017 Grade 4)
Issue: Grit
28
2019 Pilot Grade 4 Core Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
The stem of
this item was
revised for
clarity.
N/A
Issue: Grit
Issue: Desire for Learning
29
2019 Pilot Grade 4 Core Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
Issue: School Climate
N/A
D/A/
R/NC+
R
Rationale
D
Due to the
time burden
associated
with
completing
this item and
to keep
student
burden low,
this item was
dropped.
New subitems (d, e,
and f) were
added to
expand
measurement
of this
content.
30
Appendix K-1f: Pilot Grade 4 Core
31
VH240186
1. About how many books are there in your home?
A Few (0–10)
B Enough to fill one shelf (11–25)
C Enough to fill one bookcase (26–100)
D Enough to fill several bookcases (more than 100)
VH880711
2. Do you have any of the following in your home? Select one answer choice on each row.
a. Access to the Internet
b. Your own bedroom
c. Your own desktop or laptop computer
(including Chromebooks)
d. Your own tablet (for example, Surface Pro,
iPad, or Kindle Fire)
e. Your own smartphone (for example,
iPhone, Samsung Galaxy, or HTC One)
Yes
No
A
B
VH271105
A
B
VH336762
A
B
VH853088
A
B
VH853090
A
B
VH853089
VH354591
3. How often do you use the Internet for homework at home?
A Never
B About once or twice a month
C About once or twice a week
D Almost every day
E Every day
32
VH240190
4. How many days were you absent from school in the last month?
A None
B 1 or 2 days
C 3 or 4 days
D 5 to 10 days
E More than 10 days
VH240189
5. How often do you talk about things you have studied in school with someone in
your family?
A Never or hardly ever
B Once every few weeks
C About once a week
D Two or three times a week
E Every day
33
VH271144
6. Do any of the following people live in your home? Select one answer choice on each
row.
a. Mother
b. Stepmother
c. Foster mother or other female legal
guardian
d. Father
e. Stepfather
f. Foster father or other male legal guardian
Yes
No
A
B
VH271145
A
B
VH271146
A
B
VH271147
A
B
VH271148
A
B
VH271149
A
B
VH271150
VH591969
7. In this school year, how often did you use a laptop or desktop computer (including
Chromebooks) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
VH271276
8. In this school year, how often did you use a tablet (for example, Surface Pro, iPad,
Kindle Fire) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
34
VH733141
9. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I finish whatever I
begin.
b. I try very hard even
after making mistakes.
c. I keep working hard
even when I feel like
quitting.
d. I keep trying to
improve myself, even
when it takes a long
time to get there.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733142
A
B
C
D
E
VH733143
A
B
C
D
E
VH733145
A
B
C
D
E
VH733144
VH271367
10. In this school year, how often have you done each of the following? Select one answer
choice on each row.
a. I started working on
assignments right
away rather than
waiting until the last
minute.
b. I paid attention and
resisted distractions.
c. I stayed on task
without reminders
from my teacher.
d. I paid attention in
class even when I was
not interested.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271370
A
B
C
D
E
VH271372
A
B
C
D
E
VH271374
A
B
C
D
E
VH271375
35
VH733149
11. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I like complex
problems more than
easy problems.
b. I like activities that
challenge my thinking
abilities.
c. I enjoy situations
where I will have to
think about
something.
d. I enjoy thinking about
new solutions to
problems.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733150
A
B
C
D
E
VH733151
A
B
C
D
E
VH733155
A
B
C
D
E
VH733154
36
VH271934
12. In this school year, how often have you felt any of the following ways about your
school? Select one answer choice on each row.
a. I felt awkward and out
of place at school.
b. I felt happy at school.
c. I felt that I learned
something that I can
use in my daily life.
d. I worried about crime
and violence at my
school.
e. I felt my teachers
treated me fairly.
f. I felt safe on my way
to or from school.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271942
A
B
C
D
E
VH271944
A
B
C
D
E
VH336903
A
B
C
D
E
VH271940
A
B
C
D
E
VH853117
A
B
C
D
E
VH853118
VH240387
13. Are you Hispanic or Latino? Select one or more answer choices.
A No, I am not Hispanic or Latino.
B Yes, I am Mexican, Mexican American, or Chicano.
C Yes, I am Puerto Rican or Puerto Rican American.
D Yes, I am Cuban or Cuban American.
E Yes, I am from some other Hispanic or Latino background.
VH240388
14. Which of the following best describes you? Select one or more answer choices.
A White
B Black or African American
C Asian
D American Indian or Alaska Native
E Native Hawaiian or other Pacific Islander
37
Appendix K-1g: Spiral Map Grade 4 Core
38
Accnum
Grade
Grade 4 OMB PDF
Sequence Number
VH240186
VH880711
VH271105
VH336762
VH853088
VH853090
VH853089
VH354591
VH240190
VH240189
VH271144
VH271145
VH271146
VH271147
VH271148
VH271149
VH271150
VH591969
VH271276
VH733141
VH733142
VH733143
VH733145
VH733144
VH271367
VH271370
VH271372
VH271374
VH271375
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
01_00
02_00
02_01
02_02
02_03
02_04
02_05
03_00
04_00
05_00
06_00
06_01
06_02
06_03
06_04
06_05
06_06
07_00
08_00
09_00
09_01
09_02
09_03
09_04
10_00
10_01
10_02
10_03
10_04
Number of
Grade 4
booklets item
appears in
Grade 4 booklets item
appears in
3
2
2
2
2
2
2
3
1
1
2
2
2
2
2
2
2
1
1
2
2
2
2
2
2
2
2
2
2
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2, 3
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
39
VH271944
Grade
Grade 4 OMB PDF
Sequence Number
VH733149
VH733150
VH733151
VH733155
VH733154
VH271934
VH271942
VH336903
VH271940
VH853117
VH853118
VH240387
VH240388
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
11_00
11_01
11_02
11_03
11_04
12_00
12_01
12_02
12_03
12_04
12_05
13_00
14_00
Number of
Grade 4
booklets item
appears in
Grade 4 booklets item
appears in
1
1
1
1
1
2
2
2
2
2
2
3
3
3
3
3
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2, 3
1, 2, 3
40
Appendix K-1h: Summary of Changes Operational Grade 8 Core
41
2019 Operational Grade 8 Core Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Race/Ethnicity
Issue: Race/Ethnicity
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
42
2019 Operational Grade 8 Core Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
NC
Due to
concerns
about
content
relevance and
to keep
student
burden low,
sub-items b
and c were
dropped.
N/A
NC
N/A
NC
N/A
Issue: Socioeconomic Status
Issue: Technology Use
Issue: School Climate
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
43
2019 Operational Grade 8 Core Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
44
2019 Operational Grade 8 Core Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
R
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
N/A
Issue: Socioeconomic Status
Issue: Technology Use
Issue: Technology Use
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
45
2019 Operational Grade 8 Core Student
Previous item
2019 item
D/A/
R/NC+
Issue: Grit
Rationale
of the item
was dropped.
(2018 Grade 8)
(2018 Grade 8)
NC
N/A
R
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
Issue: Grit
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
46
2019 Operational Grade 8 Core Student
Previous item
2019 item
D/A/
R/NC+
Issue: Desire for Learning
Rationale
of the item
was dropped.
(2018 Grade 8)
NC
N/A
D
Due to the
time burden
associated
with
completing
this item and
to keep
student
burden low,
this item was
dropped.
(2018 Grade 8)
Issue: School Climate
N/A
(2018 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
47
2019 Operational Grade 8 Core Student
Previous item
(2016 Grade 8)
2019 item
D/A/
R/NC+
A
Issue: Educational Experiences
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
Rationale
This item was
adapted from
the arts
questionnaire
to assess
student
participation
in arts
coursework.
48
Appendix K-1i: Operational Grade 8 Core
49
VH260313
1. How easy or difficult was this test?
A Extremely difficult
B Quite difficult
C Somewhat difficult
D Somewhat easy
E Quite easy
F Extremely easy
VH333658
2. How much effort did you apply to succeed on this test?
A No effort at all
B Very little effort
C Some effort
D Quite a bit of effort
E A lot of effort
VH240387
3. Are you Hispanic or Latino? Select one or more answer choices.
A No, I am not Hispanic or Latino.
B Yes, I am Mexican, Mexican American, or Chicano.
C Yes, I am Puerto Rican or Puerto Rican American.
D Yes, I am Cuban or Cuban American.
E Yes, I am from some other Hispanic or Latino background.
50
VH240388
4. Which of the following best describes you? Select one or more answer choices.
A White
B Black or African American
C Asian
D American Indian or Alaska Native
E Native Hawaiian or other Pacific Islander
VH240186
5. About how many books are there in your home?
A Few (0–10)
B Enough to fill one shelf (11–25)
C Enough to fill one bookcase (26–100)
D Enough to fill several bookcases (more than 100)
51
VH271104
6. Do you have any of the following in your home? Select one answer choice on each row.
a. Access to the Internet
b. Your own bedroom
c. A desktop or laptop computer (including
Chromebooks) that you can use
d. A tablet (for example, Surface Pro, iPad,
Kindle Fire) that you can use
e. A smartphone (for example, iPhone,
Samsung Galaxy, HTC One) that you can
use
Yes
No
A
B
VH271105
A
B
VH336762
A
B
VH591976
A
B
VH271110
A
B
VH271112
VH354591
7. How often do you use the Internet for homework at home?
A Never
B About once or twice a month
C About once or twice a week
D Almost every day
E Every day
VH240190
8. How many days were you absent from school in the last month?
A None
B 1 or 2 days
C 3 or 4 days
D 5 to 10 days
E More than 10 days
52
VH240189
9. How often do you talk about things you have studied in school with someone in
your family?
A Never or hardly ever
B Once every few weeks
C About once a week
D Two or three times a week
E Every day
VH240192
10. How far in school did your mother go?
A She did not finish high school.
B She graduated from high school.
C She had some education after high school.
D She graduated from college.
E I don’t know.
VH240193
11. How far in school did your father go?
A He did not finish high school.
B He graduated from high school.
C He had some education after high school.
D He graduated from college.
E I don’t know.
53
VH336776
12. Does your mother work?
A Yes
B No
C I don’t know.
VH336779
13. Does your father work?
A Yes
B No
C I don’t know.
54
VH271144
14. Do any of the following people live in your home? Select one answer choice on each
row.
a. Mother
b. Stepmother
c. Foster mother or other female legal
guardian
d. Father
e. Stepfather
f. Foster father or other male legal guardian
Yes
No
A
B
VH271145
A
B
VH271146
A
B
VH271147
A
B
VH271148
A
B
VH271149
A
B
VH271150
VH591969
15. In this school year, how often did you use a laptop or desktop computer (including
Chromebooks) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
VH271276
16. In this school year, how often did you use a tablet (for example, Surface Pro, iPad,
Kindle Fire) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
55
VH733141
17. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I finish whatever I
begin.
b. I try very hard even
after making mistakes.
c. I keep working hard
even when I feel like
quitting.
d. I keep trying to
improve myself, even
when it takes a long
time to get there.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733142
A
B
C
D
E
VH733143
A
B
C
D
E
VH733145
A
B
C
D
E
VH733144
VH733149
18. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I like complex
problems more than
easy problems.
b. I like activities that
challenge my thinking
abilities.
c. I enjoy situations
where I will have to
think about
something.
d. I enjoy thinking about
new solutions to
problems.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733150
A
B
C
D
E
VH733151
A
B
C
D
E
VH733155
A
B
C
D
E
VH733154
56
VH271367
19. In this school year, how often have you done each of the following? Select one answer
choice on each row.
a. I started working on
assignments right
away rather than
waiting until the last
minute.
b. I paid attention and
resisted distractions.
c. I stayed on task
without reminders
from my teacher.
d. I paid attention in
class even when I was
not interested.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271370
A
B
C
D
E
VH271372
A
B
C
D
E
VH271374
A
B
C
D
E
VH271375
VH271934
20. In this school year, how often have you felt any of the following ways about your
school? Select one answer choice on each row.
a. I felt awkward and out
of place at school.
b. I felt happy at school.
c. I felt that I learned
something that I can
use in my daily life.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271942
A
B
C
D
E
VH271944
A
B
C
D
E
VH336903
VH852900
21. Are you taking an art course this school year (for example, drawing, painting, or
studio art)?
A Yes
B No
57
Appendix K-1j: Summary of Changes Pilot Grade 8 Core
58
2019 Pilot Grade 8 Core Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
R
Sub-items b
and c were
dropped to
keep student
burden low,
and sub-items
e, f, and g
were revised
to examine
performance
of alternative
item wording.
N/A
Issue: Race/Ethnicity
Issue: Race/Ethnicity
Issue: Socioeconomic Status
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
59
2019 Pilot Grade 8 Core Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Technology Use
Issue: School Climate
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
Issue: Socioeconomic Status
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
60
2019 Pilot Grade 8 Core Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Technology Use
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
61
2019 Pilot Grade 8 Core Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
The stem of
this item was
revised for
clarity.
NC
N/A
N/A
Issue: Technology Use
Issue: Grit
Issue: Grit
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
62
2019 Pilot Grade 8 Core Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
R
New subitems (d, e,
and f) were
added to
expand
measurement
of this
content.
D
Due to the
time burden
associated
with
completing
this item and
to keep
student
burden low,
The stem of
this item was
revised for
clarity.
Issue: Desire for Learning
(2017 Grade 8)
Issue: School Climate
N/A
(2017 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
63
2019 Pilot Grade 8 Core Student
Previous item
2019 item
D/A/
R/NC+
N/A
A
Issue: Educational Experiences
A
(2016 grade 8)
N/A
Issue: Educational Experiences
A
Issue: Educational Experiences
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
Rationale
this item was
dropped.
This item was
added to
assess
student
involvement
in coursework
on languages
(other than
English).
This item was
added to
assess
student
involvement
in art
coursework.
This item was
added to
assess
student
involvement
in music
coursework.
64
Appendix K-1k: Pilot Grade 8 Core
65
VH240186
1. About how many books are there in your home?
A Few (0–10)
B Enough to fill one shelf (11–25)
C Enough to fill one bookcase (26–100)
D Enough to fill several bookcases (more than 100)
VH880711
2. Do you have any of the following in your home? Select one answer choice on each row.
a. Access to the Internet
b. Your own bedroom
c. Your own desktop or laptop computer
(including Chromebooks)
d. Your own tablet (for example, Surface Pro,
iPad, or Kindle Fire)
e. Your own smartphone (for example,
iPhone, Samsung Galaxy, or HTC One)
Yes
No
A
B
VH271105
A
B
VH336762
A
B
VH853088
A
B
VH853090
A
B
VH853089
VH354591
3. How often do you use the Internet for homework at home?
A Never
B About once or twice a month
C About once or twice a week
D Almost every day
E Every day
66
VH240190
4. How many days were you absent from school in the last month?
A None
B 1 or 2 days
C 3 or 4 days
D 5 to 10 days
E More than 10 days
VH240189
5. How often do you talk about things you have studied in school with someone in
your family?
A Never or hardly ever
B Once every few weeks
C About once a week
D Two or three times a week
E Every day
VH240192
6. How far in school did your mother go?
A She did not finish high school.
B She graduated from high school.
C She had some education after high school.
D She graduated from college.
E I don’t know.
67
VH240193
7. How far in school did your father go?
A He did not finish high school.
B He graduated from high school.
C He had some education after high school.
D He graduated from college.
E I don’t know.
VH336776
8. Does your mother work?
A Yes
B No
C I don’t know.
VH336779
9. Does your father work?
A Yes
B No
C I don’t know.
68
VH271144
10. Do any of the following people live in your home? Select one answer choice on each
row.
a. Mother
b. Stepmother
c. Foster mother or other female legal
guardian
d. Father
e. Stepfather
f. Foster father or other male legal guardian
Yes
No
A
B
VH271145
A
B
VH271146
A
B
VH271147
A
B
VH271148
A
B
VH271149
A
B
VH271150
VH591969
11. In this school year, how often did you use a laptop or desktop computer (including
Chromebooks) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
VH271276
12. In this school year, how often did you use a tablet (for example, Surface Pro, iPad,
Kindle Fire) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
69
VH733141
13. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I finish whatever I
begin.
b. I try very hard even
after making mistakes.
c. I keep working hard
even when I feel like
quitting.
d. I keep trying to
improve myself, even
when it takes a long
time to get there.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733142
A
B
C
D
E
VH733143
A
B
C
D
E
VH733145
A
B
C
D
E
VH733144
VH271367
14. In this school year, how often have you done each of the following? Select one answer
choice on each row.
a. I started working on
assignments right
away rather than
waiting until the last
minute.
b. I paid attention and
resisted distractions.
c. I stayed on task
without reminders
from my teacher.
d. I paid attention in
class even when I was
not interested.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271370
A
B
C
D
E
VH271372
A
B
C
D
E
VH271374
A
B
C
D
E
VH271375
70
VH733149
15. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I like complex
problems more than
easy problems.
b. I like activities that
challenge my thinking
abilities.
c. I enjoy situations
where I will have to
think about
something.
d. I enjoy thinking about
new solutions to
problems.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733150
A
B
C
D
E
VH733151
A
B
C
D
E
VH733155
A
B
C
D
E
VH733154
71
VH271934
16. In this school year, how often have you felt any of the following ways about your
school? Select one answer choice on each row.
a. I felt awkward and out
of place at school.
b. I felt happy at school.
c. I felt that I learned
something that I can
use in my daily life.
d. I worried about crime
and violence at my
school.
e. I felt my teachers
treated me fairly.
f. I felt safe on my way
to or from school.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271942
A
B
C
D
E
VH271944
A
B
C
D
E
VH336903
A
B
C
D
E
VH271940
A
B
C
D
E
VH853117
A
B
C
D
E
VH853118
VH852895
17. Are you taking a language course other than English this school year (for example,
Spanish, French, or Chinese)?
A Yes
B No
VH852900
18. Are you taking an art course this school year (for example, drawing, painting, or
studio art)?
A Yes
B No
72
VH852901
19. Are you taking a music course this school year (for example, choir, band, or
orchestra)?
A Yes
B No
VH240387
20. Are you Hispanic or Latino? Select one or more answer choices.
A No, I am not Hispanic or Latino.
B Yes, I am Mexican, Mexican American, or Chicano.
C Yes, I am Puerto Rican or Puerto Rican American.
D Yes, I am Cuban or Cuban American.
E Yes, I am from some other Hispanic or Latino background.
VH240388
21. Which of the following best describes you? Select one or more answer choices.
A White
B Black or African American
C Asian
D American Indian or Alaska Native
E Native Hawaiian or other Pacific Islander
73
Appendix K-1l: Spiral Map Grade 8 Core
74
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
VH240186
VH880711
VH271105
VH336762
VH853088
VH853090
VH853089
VH354591
VH240190
VH240189
VH240192
VH240193
VH336776
VH336779
VH271144
VH271145
VH271146
VH271147
VH271148
VH271149
VH271150
VH591969
VH271276
VH733141
VH733142
VH733143
VH733145
VH733144
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
8, 12
8, 12
8, 12
8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
01_00
02_00
02_01
02_02
02_03
02_04
02_05
03_00
04_00
05_00
06_00
07_00
08_00
09_00
10_00
10_01
10_02
10_03
10_04
10_05
10_06
11_00
12_00
13_00
13_01
13_02
13_03
13_04
Number of
Grade 8
booklets item
appears in
Grade 8 booklets item
appears in
3
2
2
2
2
2
2
3
1
1
2
2
2
2
2
2
2
2
2
2
2
1
1
2
2
2
2
2
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2, 3
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
75
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
VH271367
VH271370
VH271372
VH271374
VH271375
VH733149
VH733150
VH733151
VH733155
VH733154
VH271934
VH271942
VH271944
VH336903
VH271940
VH853117
VH853118
VH852895
VH852900
VH852901
VH240387
VH240388
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
4, 8, 12
8, 12
8, 12
8, 12
4, 8, 12
4, 8, 12
14_00
14_01
14_02
14_03
14_04
15_00
15_01
15_02
15_03
15_04
16_00
16_01
16_02
16_03
16_04
16_05
16_06
17_00
18_00
19_00
20_00
21_00
Number of
Grade 8
booklets item
appears in
Grade 8 booklets item
appears in
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
2
2
2
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
1, 2
1, 2
1, 2
1, 2, 3
1, 2, 3
76
Appendix K-1m: Summary of Changes Operational Grade 12 Core
77
2019 Operational Grade 12 Core Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Race/Ethnicity
Issue: Race/Ethnicity
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
78
2019 Operational Grade 12 Core Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
NC
Due to
concerns
about
content
relevance and
to keep
student
burden low,
sub-items b
and c were
dropped.
N/A
NC
N/A
NC
N/A
Issue: Socioeconomic Status
Issue: Technology Use
Issue: School Climate
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
79
2019 Operational Grade 12 Core Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Socioeconomic Status
Issue: Socioeconomic Status
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
80
2019 Operational Grade 12 Core Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
Due to the
substantial
time burden
associated
with
completing
this item and
to keep
student
burden low,
this item was
dropped.
(2018 Grade 12)
(2018 Grade 12)
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
81
2019 Operational Grade 12 Core Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
Due to the
substantial
time burden
associated
with
completing
this item and
to keep
student
burden low,
this item was
dropped.
(2018 Grade 12)
(2018 Grade 12)
Issue: Socioeconomic Status
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
82
2019 Operational Grade 12 Core Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
R
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
of the item
was dropped.
N/A
Issue: Technology Use
Issue: Technology Use
Issue: Grit
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
83
2019 Operational Grade 12 Core Student
Previous item
2019 item
D/A/
R/NC+
Rationale
NC
N/A
R
After
examining
data from the
two versions
of this item
that were
administered
in the pilot,
one version
of the item
was dropped.
(2018 Grade 12)
(2018 Grade 12)
Issue: Grit
Issue: Desire for Learning
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
84
2019 Operational Grade 12 Core Student
Previous item
2019 item
D/A/
R/NC+
Rationale
NC
N/A
NC
N/A
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
Issue: School Climate
Issue: Post High School Preparation
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
85
2019 Operational Grade 12 Core Student
Previous item
(2018 Grade 12)
2019 item
Issue: Post High School Preparation
N/A
D/A/
R/NC+
NC
Rationale
D
Due to the
time burden
associated
with
completing
this item and
to keep
student
burden low,
this item was
dropped.
This item was
adapted from
the arts
questionnaire
to assess
student
participation
in arts
coursework.
(2018 Grade 12)
A
(2016 Grade 8)
Issue: Educational Experiences
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 9
N/A
86
Appendix K-1n: Operational Grade 12 Core
87
VH260313
1. How easy or difficult was this test?
A Extremely difficult
B Quite difficult
C Somewhat difficult
D Somewhat easy
E Quite easy
F Extremely easy
VH333658
2. How much effort did you apply to succeed on this test?
A No effort at all
B Very little effort
C Some effort
D Quite a bit of effort
E A lot of effort
VH240387
3. Are you Hispanic or Latino? Select one or more answer choices.
A No, I am not Hispanic or Latino.
B Yes, I am Mexican, Mexican American, or Chicano.
C Yes, I am Puerto Rican or Puerto Rican American.
D Yes, I am Cuban or Cuban American.
E Yes, I am from some other Hispanic or Latino background.
88
VH240388
4. Which of the following best describes you? Select one or more answer choices.
A White
B Black or African American
C Asian
D American Indian or Alaska Native
E Native Hawaiian or other Pacific Islander
VH240186
5. About how many books are there in your home?
A Few (0–10)
B Enough to fill one shelf (11–25)
C Enough to fill one bookcase (26–100)
D Enough to fill several bookcases (more than 100)
89
VH271104
6. Do you have any of the following in your home? Select one answer choice on each row.
a. Access to the Internet
b. Your own bedroom
c. A desktop or laptop computer (including
Chromebooks) that you can use
d. A tablet (for example, Surface Pro, iPad,
Kindle Fire) that you can use
e. A smartphone (for example, iPhone,
Samsung Galaxy, HTC One) that you can
use
Yes
No
A
B
VH271105
A
B
VH336762
A
B
VH591976
A
B
VH271110
A
B
VH271112
VH354591
7. How often do you use the Internet for homework at home?
A Never
B About once or twice a month
C About once or twice a week
D Almost every day
E Every day
VH240190
8. How many days were you absent from school in the last month?
A None
B 1 or 2 days
C 3 or 4 days
D 5 to 10 days
E More than 10 days
90
VH240189
9. How often do you talk about things you have studied in school with someone in
your family?
A Never or hardly ever
B Once every few weeks
C About once a week
D Two or three times a week
E Every day
VH240192
10. How far in school did your mother go?
A She did not finish high school.
B She graduated from high school.
C She had some education after high school.
D She graduated from college.
E I don’t know.
VH240193
11. How far in school did your father go?
A He did not finish high school.
B He graduated from high school.
C He had some education after high school.
D He graduated from college.
E I don’t know.
91
VH336776
12. Does your mother work?
A Yes
B No
C I don’t know.
VH336779
13. Does your father work?
A Yes
B No
C I don’t know.
92
VH271144
14. Do any of the following people live in your home? Select one answer choice on each
row.
a. Mother
b. Stepmother
c. Foster mother or other female legal
guardian
d. Father
e. Stepfather
f. Foster father or other male legal guardian
Yes
No
A
B
VH271145
A
B
VH271146
A
B
VH271147
A
B
VH271148
A
B
VH271149
A
B
VH271150
VH591969
15. In this school year, how often did you use a laptop or desktop computer (including
Chromebooks) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
VH271276
16. In this school year, how often did you use a tablet (for example, Surface Pro, iPad,
Kindle Fire) during your classes at school?
A Never
B In some classes
C In about half of the classes
D In more than half of the classes
E In all or almost all classes
93
VH733141
17. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I finish whatever I
begin.
b. I try very hard even
after making mistakes.
c. I keep working hard
even when I feel like
quitting.
d. I keep trying to
improve myself, even
when it takes a long
time to get there.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733142
A
B
C
D
E
VH733143
A
B
C
D
E
VH733145
A
B
C
D
E
VH733144
VH733149
18. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I like complex
problems more than
easy problems.
b. I like activities that
challenge my thinking
abilities.
c. I enjoy situations
where I will have to
think about
something.
d. I enjoy thinking about
new solutions to
problems.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Very much
like me
A
B
C
D
E
VH733150
A
B
C
D
E
VH733151
A
B
C
D
E
VH733155
A
B
C
D
E
VH733154
94
VH271367
19. In this school year, how often have you done each of the following? Select one answer
choice on each row.
a. I started working on
assignments right
away rather than
waiting until the last
minute.
b. I paid attention and
resisted distractions.
c. I stayed on task
without reminders
from my teacher.
d. I paid attention in
class even when I was
not interested.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271370
A
B
C
D
E
VH271372
A
B
C
D
E
VH271374
A
B
C
D
E
VH271375
VH271934
20. In this school year, how often have you felt any of the following ways about your
school? Select one answer choice on each row.
a. I felt awkward and out
of place at school.
b. I felt happy at school.
c. I felt that I learned
something that I can
use in my daily life.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH271942
A
B
C
D
E
VH271944
A
B
C
D
E
VH336903
VH852900
21. Are you taking an art course this school year (for example, drawing, painting, or
studio art)?
A Yes
B No
95
VH740697
22. During this school year, which of the following have you done? Select one answer on
each row.
a. Taken the SAT or ACT College Entrance
Exams
b. Submitted the Free Application for Federal
Student Aid (FAFSA)
c. Applied to a 2-year college
d. Been accepted to a 2-year college
e. Applied to a 4-year college
f. Been accepted to a 4-year college
g. Applied to a certificate or diploma program
at a school that provides occupational
training (such as electrician, beautician,
mechanic, computer programmer, etc.)
h. Been accepted to a technical training
program
i. Talked with a military recruiter
j. Enlisted in the military
k. Applied for a full-time job
l. Been interviewed for a full-time job
Yes
No
A
B
VH740702
A
B
VH740703
A
B
VH740704
A
B
VH740705
A
B
VH740706
A
B
VH740708
A
B
VH740709
A
B
VH740710
A
B
VH740711
A
B
VH740712
A
B
VH740713
A
B
VH740714
VH240194
23. Which of the following best describes your high school program?
A General
B Academic or college preparatory
C Vocational or technical
96
Appendix K-1o: Summary of Changes Operational Grade 4
Reading
97
2019 Operational Grade 4 Reading Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
NC
This item was
dropped to
keep student
burden low
and create
opportunity
for future
development.
N/A
NC
N/A
NC
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
Rationale
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
98
2019 Operational Grade 4 Reading Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
The word
“homework”
was removed.
R
The phrase
“classroom
library” was
added.
N/A
Issue: Organization of Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
99
2019 Operational Grade 4 Reading Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
The phrase “a
person like”
was removed
and two subitems were
added.
N/A
Issue: Student Factors
(2017 Grade 4)
100
2019 Operational Grade 4 Reading Student
Previous item
2019 item
D/A/
R/NC+
Rationale
R
The phrase “a
person like”
was removed.
NC
N/A
Issue: Student Factors
(2017 Grade 4)
(2017 Grade 4)
Issue: Student Factors
Issue: Student Factors
101
2019 Operational Grade 4 Reading Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Student Factors
102
Appendix K-1p: Operational Grade 4 Reading
103
VH332853
17. How often does your teacher ask you to discuss new or difficult vocabulary?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH332862
18. For school this year, how often do you work in pairs or small groups to talk about
something that you have read?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
104
VH332871
19. For school this year, how often do you have a class discussion about something
that the class has read?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH588774
20. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved
reading?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
VH598636
21. On a typical school day, how much time do you use a computer or other digital
device to do your English/language arts schoolwork?
A Less than 30 minutes
B About 30 minutes
C About 1 hour
D About 2 hours
E About 3 hours
F 4 or more hours
105
VH460301
22. In this school year, how often do you borrow reading materials (such as books or
magazines) from your classroom library, school library, or media center?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH337050
23. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Figure out the
meaning of a word you
don’t know by using
other words in the text
b. Explain the meaning
of something you have
read
c. Figure out the main
idea of a text
d. Find text in a reading
passage to help you
answer a question on a
test
e. Recognize when you
don’t understand
something you are
reading
f. Recognize the
difference between
fact and opinion in a
text
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260848
A
B
C
D
E
VH260849
A
B
C
D
E
VH260851
A
B
C
D
E
VH260859
A
B
C
D
E
VH260861
A
B
C
D
E
VH260863
106
VH844052
24. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
reading.
b. I want to show others
that my English/
language arts
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
English/language arts
class.
d. I want to get better
English/language arts
grades than most other
students in my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844065
A
B
C
D
E
VH844066
A
B
C
D
E
VH844068
A
B
C
D
E
VH844070
VH844081
25. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my English/language
arts class.
b. I want to become a
better reader this year.
c. I want to understand
as much as I can in my
English/language arts
class.
d. I want to master a lot
of new English/
language arts skills in
my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844096
A
B
C
D
E
VH844097
A
B
C
D
E
VH844098
A
B
C
D
E
VH844100
107
VH844168
26. How much does each of the following statements describe you? Select one answer
choice on each row.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844169
A
B
C
D
E
VH844170
A
B
C
D
E
VH844172
A
B
C
D
E
VH844171
a. Reading is one of my
favorite activities.
b. I like talking about
books with other
people.
c. I think reading is
important.
d. I enjoy going to a
bookstore or a library.
VH598686
27. Besides doing homework, how much time do you spend reading outside of school?
A Less than 30 minutes a day
B About 30 minutes a day
C About 1 hour a day
D About 2 hours a day
E About 3 hours a day
F 4 or more hours a day
VH332820
28. How often do you receive help from a tutor, family member, or friend with
English/language arts outside of school or after school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
108
VH260906
29. How often do you typically do each of the following things outside of school? Select
one answer choice on each row.
a. Talk about books
(print or online) with
other people
b. Go to my local library
to borrow books (print
or online)
c. Read blogs
d. Use social media (for
example, Facebook,
Twitter, Instagram)
e. Help friends with
reading homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH260907
A
B
C
D
E
VH260911
A
B
C
D
E
VH260913
A
B
C
D
E
VH333261
A
B
C
D
E
VH260917
109
Appendix K-1q: Summary of Changes Pilot Grade 4 Reading
110
2019 Pilot Grade 4 Reading Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
NC
This item was
dropped to
reduce
student
burden and
create
opportunity
for future
development.
N/A
NC
N/A
NC
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
Rationale
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
111
2019 Pilot Grade 4 Reading Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
The word
“homework”
was removed.
R
The phrase
“classroom
library” was
added and
“classroom
library, school
library, media
center” was
bolded.
N/A
Issue: Organization of Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
112
2019 Pilot Grade 4 Reading Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
R
The phrase “a
person like”
was removed
and two subitems were
added.
A sub-item
was added.
Issue: Student Factors
(2017 Grade 4)
113
2019 Pilot Grade 4 Reading Student
Previous item
2019 item
D/A/
R/NC+
Rationale
R
The phrase “a
person like”
was removed
and a subitem was
added.
NC
N/A
Issue: Student Factors
(2017 Grade 4)
(2017 Grade 4)
Issue: Student Factors
Issue: Student Factors
114
2019 Pilot Grade 4 Reading Student
Previous item
2019 item
N/A
(2017 Grade 4)
N/A
D/A/
R/NC+
D
A
Rationale
This item was
dropped to
reduce
student
burden and
create
opportunity
for future
development.
This item was
added.
Issue: Resources for Learning and Instruction
N/A
A
This item was
added.
Issue: Resources for Learning and Instruction
115
2019 Pilot Grade 4 Reading Student
Previous item
(2017 Grade 4)
2019 item
Issue: Student Factors
D/A/
R/NC+
R
Rationale
In the item
stem,
“things” was
replaced with
“activities”. In
sub-item “c”,
“Read blogs”
was replaced
with “Read
online about
topics I am
interested in”
and moved to
sub-item “a”.
In sub-item
“b”, “Go to
my local
library to
borrow books
(print or
online)” was
replaced with
“Borrow or
download
books from a
local library”
and moved to
sub-item “c”.
116
Appendix K-1r: Pilot Grade 4 Reading
117
VH332853
1. How often does your teacher ask you to discuss new or difficult vocabulary?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH332862
2. For school this year, how often do you work in pairs or small groups to talk about
something that you have read?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH332871
3. For school this year, how often do you have a class discussion about something
that the class has read?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
118
VH337050
4. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260848
A
B
C
D
E
VH260849
A
B
C
D
E
VH260851
A
B
C
D
E
VH260859
A
B
C
D
E
VH260861
A
B
C
D
E
VH260863
A
B
C
D
E
VH811215
a. Figure out the
meaning of a word you
don’t know by using
other words in the text
b. Explain the meaning
of something you have
read
c. Figure out the main
idea of a text
d. Find text in a reading
passage to help you
answer a question on a
test
e. Recognize when you
don’t understand
something you are
reading
f. Recognize the
difference between
fact and opinion in a
text
g. Use evidence from a
text to support your
answer
VH588774
5. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved
reading?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
119
VH598636
6. On a typical school day, how much time do you use a computer or other digital
device to do your English/language arts schoolwork?
A Less than 30 minutes
B About 30 minutes
C About 1 hour
D About 2 hours
E About 3 hours
F 4 or more hours
VH598686
7. Besides doing homework, how much time do you spend reading outside of school?
A Less than 30 minutes a day
B About 30 minutes a day
C About 1 hour a day
D About 2 hours a day
E About 3 hours a day
F 4 or more hours a day
120
VH811176
8. How often do you receive the following types of help with English/language arts
schoolwork outside of school or after school? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online
resources (for example,
websites or apps)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH811190
A
B
C
D
E
VH811192
A
B
C
D
E
VH811196
A
B
C
D
E
VH811200
VH811276
9. How useful do you find each of the following types of help to understand your
English/language arts schoolwork? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online resources
(for example, websites or
apps)
Not useful at
all
Somewhat
useful
Very useful
I don’t receive
that type of
help.
A
B
C
D
VH811287
A
B
C
D
VH811291
A
B
C
D
VH811302
A
B
C
D
VH811304
121
VH844168
10. How much does each of the following statements describe you? Select one answer
choice on each row.
a. Reading is one of my
favorite activities.
b. I like talking about
books with other
people.
c. I think reading is
important.
d. I enjoy going to a
bookstore or a library.
e. I enjoy finding things
to read online.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844169
A
B
C
D
E
VH844170
A
B
C
D
E
VH844172
A
B
C
D
E
VH844171
A
B
C
D
E
VH853415
VH853176
11. In this school year, how often do you borrow reading materials (such as books or
magazines) from your school (for example, a classroom library, school library, or
media center)?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
122
VH853652
12. How often do you typically do each of the following activities outside of school? Select
one answer choice on each row.
a. Read online about
topics I am
interested in
b. Talk about things I
read with other people
c. Borrow or download
books from a local
library
d. Use social media (for
example, Facebook,
Twitter, Instagram)
e. Help friends with
reading homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH853656
A
B
C
D
E
VH853657
A
B
C
D
E
VH853655
A
B
C
D
E
VH853654
A
B
C
D
E
VH853658
VH853747
13. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
reading.
b. I want to show others
that my English/
language arts
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
English/language arts
class.
d. I want to get better
English/language arts
grades than most other
students in my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853764
A
B
C
D
E
VH853765
A
B
C
D
E
VH853766
A
B
C
D
E
VH853776
123
VH853763
14. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my English/language
arts class.
b. I want to become a
better reader this year.
c. I want to understand
as much as I can in my
English/language arts
class.
d. I want to master a lot
of new English/
language arts skills in
my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853767
A
B
C
D
E
VH853777
A
B
C
D
E
VH853774
A
B
C
D
E
VH853770
124
Appendix K-1s: Spiral Map Grade 4 Reading
125
Accnum
Grade
VH853176
VH853652
VH853656
VH853657
VH853655
VH853654
VH853658
VH598636
VH844168
VH844169
VH844170
VH844172
VH844171
VH853415
VH811176
VH811190
VH811192
VH811196
VH811200
VH811276
VH811287
VH811291
VH811302
VH811304
VH598686
VH337050
VH260848
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4,8
4, 8
Grade 4 OMB PDF
Sequence Number
11_00
12_00
12_01
12_02
12_03
12_04
12_05
06_00
10_00
10_01
10_02
10_03
10_04
10_05
08_00
08_01
08_02
08_03
08_04
09_00
09_01
09_02
09_03
09_04
07_00
04_00
04_01
Number of
Grade 4
booklets item
appears in
Grade 4 booklets item
appears in
3
2
2
2
2
2
2
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
1
3
126
VH260849
04_02
4, 8
VH260851
VH260859
VH260861
3
1
1
3
3
1
3
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
04_03
4, 8
4, 8
04_04
04_05
4, 8
VH260863
VH811215
VH853747
VH853764
VH853765
VH853766
VH853776
VH853763
VH853767
VH853777
VH853774
VH853770
VH332853
VH332862
VH332871
VH588774
1
04_06
4, 8
4,8
4, 8
4, 8
4, 8
4, 8
4, 8
4,8
4, 8
4, 8
4, 8
4, 8
4
4
4
4, 8,12
04_07
13_00
13_01
13_02
13_03
13_04
14_00
14_01
14_02
14_03
14_04
01_00
02_00
03_00
05_00
127
Appendix K-1t: Summary of Changes Operational Grade 8 Reading
128
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
A sub-item
was dropped.
R
A sub-item
was dropped.
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
129
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
130
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Student Factors
Issue: Student Factors
131
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
R
The phrase “a
person like”
was removed.
The phrase “a
person like”
was removed
and two subitems were
added.
Issue: Student Factors
Issue: Student Factors
132
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
R
Sub-items
were
removed.
N/A
Issue: Student Factors
(2017 Grade 8)
Issue: Resources for Learning and Instruction
(2017 Grade 8)
Issue: Student Factors
133
2019 Operational Grade 8 Reading Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
N/A
Issue: Student Factors
134
Appendix K-1u: Operational Grade 8 Reading
135
VH332887
22. For your English/language arts class this year, how often do you do each of the
following? Select one answer choice on each row.
a. Have a class
discussion about
something that the
whole class has read
b. Work in pairs or small
groups to talk about
something that you
have read
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH332888
A
B
C
D
E
VH332889
VH260254
23. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
a. Evaluate the main
evidence in a
persuasive/argument
passage
b. Analyze the author’s
organization of
information in a
passage
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH260256
A
B
C
D
E
VH333142
136
VH333074
24. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH333075
A
B
C
D
E
VH333076
A
B
C
D
E
VH333079
A
B
C
D
E
VH333078
A
B
C
D
E
VH333094
a. Summarize the
passage
b. Interpret the meaning
of the passage
c. Question the motives
or feelings of the
characters
d. Identify the main ideas
of the passage
e. Identify the themes of
the passage
VH588774
25. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved
reading?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
137
VH598636
26. On a typical school day, how much time do you use a computer or other digital
device to do your English/language arts schoolwork?
A Less than 30 minutes
B About 30 minutes
C About 1 hour
D About 2 hours
E About 3 hours
F 4 or more hours
VH460301
27. In this school year, how often do you borrow reading materials (such as books or
magazines) from your classroom library, school library, or media center?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
138
VH260847
28. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Figure out the
meaning of a word you
don’t know by using
other words in the text
b. Explain the meaning
of something you have
read
c. Figure out the main
idea of a text
d. Find text in a reading
passage to help you
answer a question on a
test
e. Recognize when you
don’t understand
something you are
reading
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260848
A
B
C
D
E
VH260849
A
B
C
D
E
VH260851
A
B
C
D
E
VH260859
A
B
C
D
E
VH260861
139
VH611300
29. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Recognize the
difference between
fact and opinion in a
text
b. Judge the reliability of
sources (for example,
how a website might
be biased or
inaccurate)
c. Critique an author’s
craft or technique
d. Use evidence from a
text to support my
answer
e. Identify the author’s
perspective in a
persuasive text
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260863
A
B
C
D
E
VH260857
A
B
C
D
E
VH260866
A
B
C
D
E
VH616841
A
B
C
D
E
VH260868
VH844052
30. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
reading.
b. I want to show others
that my English/
language arts
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
English/language arts
class.
d. I want to get better
English/language arts
grades than most other
students in my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844065
A
B
C
D
E
VH844066
A
B
C
D
E
VH844068
A
B
C
D
E
VH844070
140
VH844081
31. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my English/language
arts class.
b. I want to become a
better reader this year.
c. I want to understand
as much as I can in my
English/language arts
class.
d. I want to master a lot
of new English/
language arts skills in
my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844096
A
B
C
D
E
VH844097
A
B
C
D
E
VH844098
A
B
C
D
E
VH844100
141
VH844168
32. How much does each of the following statements describe you? Select one answer
choice on each row.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844169
A
B
C
D
E
VH844170
A
B
C
D
E
VH844172
A
B
C
D
E
VH844171
a. Reading is one of my
favorite activities.
b. I like talking about
books with other
people.
c. I think reading is
important.
d. I enjoy going to a
bookstore or a library.
VH598686
33. Besides doing homework, how much time do you spend reading outside of school?
A Less than 30 minutes a day
B About 30 minutes a day
C About 1 hour a day
D About 2 hours a day
E About 3 hours a day
F 4 or more hours a day
142
VH261065
34. How often do you typically read each of the following outside of school (print or
online)? Select one answer choice on each row.
a.
b.
c.
d.
Stories or novels
E-mails
Text messages
Biographies
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH261066
A
B
C
D
E
VH261074
A
B
C
D
E
VH261075
A
B
C
D
E
VH617043
VH332820
35. How often do you receive help from a tutor, family member, or friend with
English/language arts outside of school or after school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
143
VH260906
36. How often do you typically do each of the following things outside of school? Select
one answer choice on each row.
a. Talk about books
(print or online) with
other people
b. Go to my local library
to borrow books (print
or online)
c. Read blogs
d. Use social media (for
example, Facebook,
Twitter, Instagram)
e. Help friends with
reading homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH260907
A
B
C
D
E
VH260911
A
B
C
D
E
VH260913
A
B
C
D
E
VH333261
A
B
C
D
E
VH260917
144
Appendix K-1v: Summary of Changes Pilot Grade 8 Reading
145
2019 Pilot Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
R
A sub-item
was removed.
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
146
2019 Pilot Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
The word
“homework”
was removed.
R
The phrase
“classroom
library” was
added and
“classroom
library, school
library, media
center” was
bolded.
N/A
Issue: Organization of Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
147
2019 Pilot Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
In sub-item
“d”, “my
answer” was
replaced with
“your
answer”.
N/A
Issue: Student Factors
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
148
2019 Pilot Grade 8 Reading Student
Previous item
2019 item
D/A/
R/NC+
R
(2017 Grade 8)
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
Rationale
The previous
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
on a total of
at least 4
items,
VH844052
and
VH844081
were added.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
149
2019 Pilot Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
D
This item was
dropped to
reduce
student
burden and
create
opportunity
for future
development.
The phrase “a
person like”
was removed
and a subitem was
added.
Issue: Student Factors
Issue: Student Factors
N/A
(2017 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
150
2019 Pilot Grade 8 Reading Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
R
In the item
stem,
“things” was
replaced with
“activities”. In
sub item “a”,
“Talk about
books (print
or online)
with other
people” was
replaced with
“Talk about
things I read
with other
people” and
was moved to
sub-item “b”.
In sub-item
“c”, “Read
blogs” was
replaced with
“Read online
about topics I
Sub-items
were
removed.
Issue: Student Factors
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
151
2019 Pilot Grade 8 Reading Student
Previous item
2019 item
D/A/
R/NC+
N/A
A
Rationale
am interested
in” and
moved to
sub-item “a”.
In sub-item
“b”, “Go to
my local
library to
borrow books
(print or
online)” was
replaced with
“Borrow or
download
books from a
local library”
and moved to
sub-item “c”.
This item was
added.
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
152
2019 Pilot Grade 8 Reading Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was
added.
This item was
added.
Issue: Resources for Learning and Instruction
N/A
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
153
Appendix K-1w: Pilot Grade 8 Reading
154
VH260254
1. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
a. Evaluate the main
evidence in a
persuasive/argument
passage
b. Analyze the author’s
organization of
information in a
passage
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH260256
A
B
C
D
E
VH333142
VH260847
2. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Figure out the
meaning of a word you
don’t know by using
other words in the text
b. Explain the meaning
of something you have
read
c. Figure out the main
idea of a text
d. Find text in a reading
passage to help you
answer a question on a
test
e. Recognize when you
don’t understand
something you are
reading
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260848
A
B
C
D
E
VH260849
A
B
C
D
E
VH260851
A
B
C
D
E
VH260859
A
B
C
D
E
VH260861
155
VH261065
3. How often do you typically read each of the following outside of school (print or
online)? Select one answer choice on each row.
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
a. Stories or novels
A
B
C
D
E
VH261066
b. Biographies
c. E-mails
d. Text messages
A
B
C
D
E
VH617043
A
B
C
D
E
VH261074
A
B
C
D
E
VH261075
VH332887
4. For your English/language arts class this year, how often do you do each of the
following? Select one answer choice on each row.
a. Have a class
discussion about
something that the
whole class has read
b. Work in pairs or small
groups to talk about
something that we
have read
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH332888
A
B
C
D
E
VH652035
156
VH333074
5. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH333075
A
B
C
D
E
VH333076
A
B
C
D
E
VH333079
A
B
C
D
E
VH333078
A
B
C
D
E
VH333094
a. Summarize the
passage
b. Interpret the meaning
of the passage
c. Question the motives
or feelings of the
characters
d. Identify the main ideas
of the passage
e. Identify the themes of
the passage
VH598636
6. On a typical school day, how much time do you use a computer or other digital
device to do your English/language arts schoolwork?
A Less than 30 minutes
B About 30 minutes
C About 1 hour
D About 2 hours
E About 3 hours
F 4 or more hours
157
VH598686
7. Besides doing homework, how much time do you spend reading outside of school?
A Less than 30 minutes a day
B About 30 minutes a day
C About 1 hour a day
D About 2 hours a day
E About 3 hours a day
F 4 or more hours a day
VH611300
8. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Recognize the
difference between
fact and opinion in a
text
b. Judge the reliability of
sources (for example,
how a website might
be biased or
inaccurate)
c. Critique an author’s
craft or technique
d. Use evidence from a
text to support your
answer
e. Identify the author’s
perspective in a
persuasive text
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260863
A
B
C
D
E
VH260857
A
B
C
D
E
VH260866
A
B
C
D
E
VH811215
A
B
C
D
E
VH260868
VH811176
9. How often do you receive the following types of help with English/language arts
schoolwork outside of school or after school? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online
resources (for example,
websites or apps)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH811190
A
B
C
D
E
VH811192
A
B
C
D
E
VH811196
A
B
C
D
E
VH811200
158
VH811222
10. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Recognize the author’s
use of figurative
language (for example,
symbolism, similes,
metaphors, or
personification)
b. Evaluate the author’s
use of features in a
text (for example,
figurative language,
voice, or transition
words)
c. Recognize tools the
author is using (for
example, rhyme,
imagery, examples, or
repetition)
d. Evaluate the strength
and quality of
evidence used by the
author to support his
or her position
e. Evaluate the author’s
use of multimedia or
non-print text (e.g.,
texts including
images, infographics,
or animations)
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH811229
A
B
C
D
E
VH811227
A
B
C
D
E
VH811231
A
B
C
D
E
VH811233
A
B
C
D
E
VH811237
159
VH811276
11. How useful do you find each of the following types of help to understand your
English/language arts schoolwork? Select one answer choice on each row.
Not useful at
all
Somewhat
useful
Very useful
I don’t receive
that type of
help.
A
B
C
D
VH811287
A
B
C
D
VH811291
A
B
C
D
VH811302
A
B
C
D
VH811304
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online resources
(for example, websites or
apps)
VH844168
12. How much does each of the following statements describe you? Select one answer
choice on each row.
a. Reading is one of my
favorite activities.
b. I like talking about
books with other
people.
c. I think reading is
important.
d. I enjoy going to a
bookstore or a library.
e. I enjoy finding things
to read online.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844169
A
B
C
D
E
VH844170
A
B
C
D
E
VH844172
A
B
C
D
E
VH844171
A
B
C
D
E
VH853415
VH853176
13. In this school year, how often do you borrow reading materials (such as books or
magazines) from your school (for example, a classroom library, school library, or
media center)?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
160
VH853652
14. How often do you typically do each of the following activities outside of school? Select
one answer choice on each row.
a. Read online about
topics I am
interested in
b. Talk about things I
read with other people
c. Borrow or download
books from a local
library
d. Use social media (for
example, Facebook,
Twitter, Instagram)
e. Help friends with
reading homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH853656
A
B
C
D
E
VH853657
A
B
C
D
E
VH853655
A
B
C
D
E
VH853654
A
B
C
D
E
VH853658
VH853747
15. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
reading.
b. I want to show others
that my English/
language arts
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
English/language arts
class.
d. I want to get better
English/language arts
grades than most other
students in my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853764
A
B
C
D
E
VH853765
A
B
C
D
E
VH853766
A
B
C
D
E
VH853776
161
VH853763
16. How much does each of the following statements describe you? Select one answer
choice on each row.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853767
A
B
C
D
E
VH853777
A
B
C
D
E
VH853774
A
B
C
D
E
VH853770
a. I want to learn as
much as possible in
my English/language
arts class.
b. I want to become a
better reader this year.
c. I want to understand
as much as I can in my
English/language arts
class.
d. I want to master a lot
of new English/
language arts skills in
my class.
VH588774
17. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved
reading?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
162
Appendix K-1x: Spiral Map Grade 8 Reading
163
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
VH853176
VH853652
VH853656
VH853657
VH853655
VH853654
VH853658
VH598636
VH844168
VH844169
VH844170
VH844172
VH844171
VH853415
VH811176
VH811190
VH811192
VH811196
VH811200
VH811276
VH811287
VH811291
VH811302
VH811304
VH598686
VH332887
VH332888
VH652035
VH260254
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
8
8
8
8
13_00
14_00
14_01
14_02
14_03
14_04
14_05
06_00
12_00
12_01
12_02
12_03
12_04
12_05
09_00
09_01
09_02
09_03
09_04
11_00
11_01
11_02
11_03
11_04
07_00
04_00
04_01
04_02
01_00
Number of
Grade 8
booklets item
appears in
Grade 8 booklets item
appears in
3
2
2
2
2
2
2
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
3
3
3
164
VH260256
VH333142
VH333074
VH333075
VH333076
VH333079
VH333078
VH333094
VH261065
VH261066
VH617043
VH261074
VH261075
VH260847
VH260848
VH260849
VH260851
VH260859
VH260861
VH611300
VH260863
VH260857
VH260866
VH811215
VH260868
VH853747
VH853764
VH853765
VH853766
VH853776
VH853763
VH853767
VH853777
VH853774
8
8
8
8
8
8
8
8
8
8
8
8
8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
8
4, 8
8
8
4, 8
8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
01_01
01_02
05_00
05_01
05_02
05_03
05_04
05_05
03_00
03_01
03_02
03_03
03_04
02_00
02_01
02_02
02_03
02_04
02_05
08_00
08_01
08_02
08_03
08_04
08_05
15_00
15_01
15_02
15_03
15_04
16_00
16_01
16_02
16_03
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
165
VH853770
VH588774
VH811222
VH811229
VH811227
VH811231
VH811233
VH811237
4, 8
4, 8, 12
8
8
8
8
8
8
16_04
17_00
10_00
10_01
10_02
10_03
10_04
10_05
1
1
2
2
2
2
2
2
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
166
Appendix K-1y: Summary of Changes Operational Grade 12
Reading
167
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
168
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Resources for Learning and Instruction
169
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Student Factors
170
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
R
The phrase “a
person like”
was removed
and two subitems were
added.
N/A
Issue: Student Factors
(2018 Grade 12)
171
2019 Operational Grade 12 Reading Student
Previous item
2019 item
D/A/
R/NC+
Rationale
R
The phrase “a
person like”
was removed.
NC
N/A
Issue: Student Factors
(2018 Grade 12)
(2018 Grade 12)
Issue: Student Factors
Issue: Student Factors
172
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Student Factors
Issue: Student Factors
173
2019 Operational Grade 12 Reading Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
174
Appendix K-1z: Operational Grade 12 Reading
175
VH731527
24. For your English/language arts class so far this year, how many times have you done
each of the following? Select one answer choice on each row.
a. Made a presentation to
the class about
something that you
have read
b. Done a project about
something that you
have read (for example,
written a play, created
a website)
2 or 3 times 4 or 5 times
6 or more
times
Never
Once
A
B
C
D
E
VH731530
A
B
C
D
E
VH731529
VH882575
25. For your English/language arts class this year, how often do you do each of the
following? Select one answer choice on each row.
a. Have a class
discussion about
something that the
whole class has read
b. Work in pairs or small
groups to talk about
something that we
have read
c. Discuss different
interpretations of what
we have read
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH332888
A
B
C
D
E
VH652035
A
B
C
D
E
VH652037
176
VH882582
26. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
a. Evaluate the main
evidence in a
persuasive/argument
passage
b. Analyze the author’s
organization of
information in a
passage
c. Critique the author’s
craft or technique
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH260256
A
B
C
D
E
VH333142
A
B
C
D
E
VH333144
177
VH882547
27. In your English/language arts class this year, when reading a story, article, or other
passage, how often does your teacher ask you to do the following? Select one answer
choice on each row.
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH333075
A
B
C
D
E
VH333076
A
B
C
D
E
VH333079
A
B
C
D
E
VH333078
A
B
C
D
E
VH333094
A
B
C
D
E
VH333077
a. Summarize the
passage
b. Interpret the meaning
of the passage
c. Question the motives
or feelings of the
characters
d. Identify the main ideas
of the passage
e. Identify the themes of
the passage
f. Analyze two or more
texts on the same
topic
VH588774
28. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved
reading?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
178
VH598636
29. On a typical school day, how much time do you use a computer or other digital
device to do your English/language arts schoolwork?
A Less than 30 minutes
B About 30 minutes
C About 1 hour
D About 2 hours
E About 3 hours
F 4 or more hours
VH460301
30. In this school year, how often do you borrow reading materials (such as books or
magazines) from your classroom library, school library, or media center?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
179
VH260847
31. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Figure out the
meaning of a word you
don’t know by using
other words in the text
b. Explain the meaning
of something you have
read
c. Figure out the main
idea of a text
d. Find text in a reading
passage to help you
answer a question on a
test
e. Recognize when you
don’t understand
something you are
reading
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260848
A
B
C
D
E
VH260849
A
B
C
D
E
VH260851
A
B
C
D
E
VH260859
A
B
C
D
E
VH260861
180
VH611300
32. Do you think you would be able to do each of the following when reading? Select one
answer choice on each row.
a. Recognize the
difference between
fact and opinion in a
text
b. Judge the reliability of
sources (for example,
how a website might
be biased or
inaccurate)
c. Critique an author’s
craft or technique
d. Use evidence from a
text to support my
answer
e. Identify the author’s
perspective in a
persuasive text
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH260863
A
B
C
D
E
VH260857
A
B
C
D
E
VH260866
A
B
C
D
E
VH616841
A
B
C
D
E
VH260868
VH844052
33. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
reading.
b. I want to show others
that my English/
language arts
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
English/language arts
class.
d. I want to get better
English/language arts
grades than most other
students in my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844065
A
B
C
D
E
VH844066
A
B
C
D
E
VH844068
A
B
C
D
E
VH844070
181
VH844081
34. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my English/language
arts class.
b. I want to become a
better reader this year.
c. I want to understand
as much as I can in my
English/language arts
class.
d. I want to master a lot
of new English/
language arts skills in
my class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844096
A
B
C
D
E
VH844097
A
B
C
D
E
VH844098
A
B
C
D
E
VH844100
182
VH844168
35. How much does each of the following statements describe you? Select one answer
choice on each row.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844169
A
B
C
D
E
VH844170
A
B
C
D
E
VH844172
A
B
C
D
E
VH844171
a. Reading is one of my
favorite activities.
b. I like talking about
books with other
people.
c. I think reading is
important.
d. I enjoy going to a
bookstore or a library.
VH332820
36. How often do you receive help from a tutor, family member, or friend with
English/language arts outside of school or after school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH598686
37. Besides doing homework, how much time do you spend reading outside of school?
A Less than 30 minutes a day
B About 30 minutes a day
C About 1 hour a day
D About 2 hours a day
E About 3 hours a day
F 4 or more hours a day
183
VH882561
38. How often do you typically read each of the following outside of school (print or
online)? Select one answer choice on each row.
a.
b.
c.
d.
e.
f.
g.
h.
Stories or novels
Poems
Plays
Biographies
Comic books
Magazines
E-mails
Text messages
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH261066
A
B
C
D
E
VH261067
A
B
C
D
E
VH261068
A
B
C
D
E
VH617043
A
B
C
D
E
VH261070
A
B
C
D
E
VH261071
A
B
C
D
E
VH261074
A
B
C
D
E
VH261075
VH260906
39. How often do you typically do each of the following things outside of school? Select
one answer choice on each row.
a. Talk about books
(print or online) with
other people
b. Go to my local library
to borrow books (print
or online)
c. Read blogs
d. Use social media (for
example, Facebook,
Twitter, Instagram)
e. Help friends with
reading homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH260907
A
B
C
D
E
VH260911
A
B
C
D
E
VH260913
A
B
C
D
E
VH333261
A
B
C
D
E
VH260917
184
VH240398
40. Are you currently enrolled in or have you taken an Advanced Placement
(AP®) course in English/language arts? Select all that apply.
A Yes, I am enrolled in or have taken Advanced Placement (AP) English Language and
Composition.
B Yes, I am enrolled in or have taken Advanced Placement (AP) English Literature and
Composition.
C No, I have never taken an Advanced Placement (AP) English/language arts course.
VH240006
41. Are you currently enrolled in or have you taken the International Baccalaureate®
(IB) Language A1 course?
A Yes
B No
VH240007
42. Are you currently enrolled in or have you taken any online English/language arts
courses for high school or college credit?
A Yes
B No
185
Appendix K-1aa: Summary of Changes Operational Grade 4
Mathematics
186
2019 Operational Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
Issue: Organization of Instruction
N/A
D
This item was
dropped
based on the
ADC’s
recommendat
ion.
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
187
2019 Operational Grade 4 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
NC
N/A
NC
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
This item was
dropped
based on
NCES’s review
of
technologyuse items.
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
188
2019 Operational Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
189
2019 Operational Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
The previous
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
on a total of
at least 4
items,
VH844882
and
VH845114
N/A
Issue: Student Factors
Issue: Student Factors
190
2019 Operational Grade 4 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Rationale
were added
from the
2016 pilot
assessment.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
191
Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
Issue: Student Factors
Issue: Resources for Learning and Instruction
192
Appendix K-1ab: Operational Grade 4 Mathematics
193
VH350115
17. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved math?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
VH267415
18. This school year, how often did the following things happen in your math class? Select
one answer choice on each row.
a. My teacher used
computers or other
digital devices when
teaching math to my
class.
b. My teacher required us
to use computers or
other digital devices to
complete math
assignments.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH588077
A
B
C
D
E
VH267419
194
VH336231
19. How often do you use a calculator?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH268936
20. How often do you use math in everyday life outside of school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH268945
21. How often do you participate in each of the following activities outside of
school? Select one answer choice on each row.
a. Talk about math
problems with your
friends
b. Play an instrument
and read music
c. Go to websites for
help with your math
homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH268946
A
B
C
D
E
VH268961
A
B
C
D
E
VH268962
195
VH336233
22. How often do you receive help or tutoring with math outside of school or after
school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH460329
23. How often do you play digital games (for example, apps, video games, or computer
games) outside of school that involve math?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH336085
24. Have you ever helped your friends with their math homework?
A Yes
B No
VH269037
25. Over the past seven days, how many days have you helped your friends with their
math homework? Enter the number of days.
196
VH267672
26. Thinking about math, do you think that you would be able to do each of the
following? Do not actually solve the problems. Select one answer choice on each row.
a. Estimate the weight of
5 apples using pounds
(lbs.)
b. Divide 42 stickers
among 6 students
c. Find the amount of
carpet needed to cover
a rectangular floor if
you know its length
and width
d. Know when to take a
turkey out of the oven
if it goes in at 10:00
A.M. and it takes 3
hours and 45 minutes
to cook
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH267674
A
B
C
D
E
VH617317
A
B
C
D
E
VH267682
A
B
C
D
E
VH267683
VH844870
27. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
math.
b. I want to show others
that my math
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
math class.
d. I want to get better
grades than most other
students in my math
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844871
A
B
C
D
E
VH844872
A
B
C
D
E
VH844873
A
B
C
D
E
VH844882
197
VH845110
28. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my math class.
b. I want to master a lot
of new skills in my
math class.
c. I want to become
better in math this
year.
d. I want to understand
as much as I can in my
math class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH845117
A
B
C
D
E
VH845114
A
B
C
D
E
VH845115
A
B
C
D
E
VH845118
198
VH844769
29. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy doing math.
b. I look forward to my
math class.
c. I am interested in the
things I learn in math.
d. I think making an
effort in math is
worthwhile.
e. I think math will help
me even when I am
not in school.
f. I think it is important
to do well in math.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844770
A
B
C
D
E
VH844771
A
B
C
D
E
VH844775
A
B
C
D
E
VH844772
A
B
C
D
E
VH844777
A
B
C
D
E
VH844774
199
Appendix K-1ac: Summary of Changes Pilot Grade 4 Mathematics
200
2019 Pilot Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
Issue: Organization of Instruction
N/A
D
This item was
dropped
based on the
ADC’s
recommendat
ion.
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
201
2019 Pilot Grade 4 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
D
This item was
dropped in
place of
keeping
VH853724, as
per similar
recommendat
ions made for
Reading
based on
pretesting
and to ensure
consistency
across
subjects.
(2017 Grade 4)
(2017 Grade 4)
Issue: Resources for Learning and Instruction
N/A
(2017 Grade 4)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
This item was
dropped
based on
NCES’s review
of
technologyuse items.
202
2019 Pilot Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
NC
N/A
NC
N/A
The wording
for both subitems was
revised to
focus more
on assessing
what the
students are
utilizing the
technology
for.
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
203
2019 Pilot Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
R
Sub-item “a”
was revised
from “lbs” to
“lb”; sub-item
“b” was
revised;
previous subitem “d” was
replaced with
an alternate
version.
R
The previous
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
N/A
Issue: Resources for Learning and Instruction
Issue: Student Factors
(2017 Grade 4)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
204
2019 Pilot Grade 4 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Issue: Student Factors
R
(2017 Grade 4)
Rationale
on a total of
at least 4
items,
VH844882
VH853961
and
VH8451314
were added
from the
2016 pilot
assessment.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
205
2019 Pilot Grade 4 Mathematics Student
Previous item
(2017 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
A
This item was
added in
place of
VH336233.
This item was
pretested and
kept in
Reading, and
to ensure
consistency,
the same
decision was
made for
math.
This item was
added in
place of
VH336233.
This item was
pretested and
kept in
Reading, and
to ensure
consistency,
the same
decision was
N/A
Issue: Resources for Learning and Instruction
N/A
Issue: Resources for Learning and Instruction
N/A
A
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
206
2019 Pilot Grade 4 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Rationale
made for
math.
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
207
Appendix K-1ad: Pilot Grade 4 Mathematics
208
VH268945
1. How often do you participate in each of the following activities outside of
school? Select one answer choice on each row.
a. Talk about math
problems with your
friends
b. Play an instrument
and read music
c. Go to websites for
help with your math
homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH268946
A
B
C
D
E
VH268961
A
B
C
D
E
VH268962
VH269037
2. Over the past seven days, how many days have you helped your friends with their
math homework? Enter the number of days.
VH336085
3. Have you ever helped your friends with their math homework?
A Yes
B No
209
VH336231
4. How often do you use a calculator?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH350115
5. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved math?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
VH460329
6. How often do you play digital games (for example, apps, video games, or computer
games) outside of school that involve math?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
210
VH853724
7. How often do you receive the following types of help with math schoolwork outside
of school or after school? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online
resources (for example,
websites or apps)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH853725
A
B
C
D
E
VH853726
A
B
C
D
E
VH853728
A
B
C
D
E
VH853729
VH853732
8. How useful do you find each of the following types of help to understand your math
schoolwork? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online resources
(for example, websites or
apps)
Not useful at
all
Somewhat
useful
Very useful
I don’t receive
that type of
help.
A
B
C
D
VH853733
A
B
C
D
VH853734
A
B
C
D
VH853736
A
B
C
D
VH853737
211
VH853944
9. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible
about math in my
class.
b. I want to master a lot
of new math skills in
my class.
c. I want to become a
better math student
this year.
d. I want to understand
as much as I can in my
math class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853957
A
B
C
D
E
VH853961
A
B
C
D
E
VH853949
A
B
C
D
E
VH853952
212
VH854028
10. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy doing math.
b. I look forward to my
math class.
c. I am interested in the
things I learn in math.
d. I think making an
effort in math is
worthwhile.
e. I think math will help
me even when I am
not in school.
f. I think it is important
to do well in math.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH854029
A
B
C
D
E
VH854030
A
B
C
D
E
VH854034
A
B
C
D
E
VH854031
A
B
C
D
E
VH854036
A
B
C
D
E
VH854033
VH854116
11. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am a good
math student.
b. I want to show others
that my math
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
math class.
d. I want to get better
math grades than most
other students in my
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH854117
A
B
C
D
E
VH854118
A
B
C
D
E
VH854119
A
B
C
D
E
VH854134
213
VH882494
12. This school year, how often did the following things happen in your math class? Select
one answer choice on each row.
a. My teacher used
computers or other
digital devices to go on
websites or use apps
when teaching math
to my class.
b. My teacher required us
to use computers or
other digital devices to
go on websites or use
apps to complete math
assignments.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH810476
A
B
C
D
E
VH810477
VH882502
13. Thinking about math, do you think that you would be able to do each of the
following? Do not actually solve the problems. Select one answer choice on each row.
a. Estimate the weight of
5 apples using pounds
(lb)
b. Share 42 stickers
equally among
6 students
c. Find the amount of
carpet needed to cover
a rectangular floor if
you know its length
and width
d. Calculate what time
the movie ends if it
starts at 11:00 AM and
lasts for 2 hours and
45 minutes.
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH858273
A
B
C
D
E
VH810864
A
B
C
D
E
VH267682
A
B
C
D
E
VH810865
214
VH268936
14. How often do you use math in everyday life outside of school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
215
Appendix K-1ae: Spiral Map Grade 4 Mathematics
216
Accnum
Grade
Grade 4 OMB PDF
Sequence Number
VH350115
VH336231
VH268936
VH460329
VH854116
VH854117
VH854118
VH854119
VH854134
VH853944
VH853957
VH853961
VH853949
VH853952
VH854028
VH854029
VH854030
VH854034
VH854031
VH854036
VH854033
VH336085
VH269037
VH853724
VH853725
VH853726
VH853728
VH853729
4, 8
4
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
05_00
04_00
14_00
06_00
11_00
11_01
11_02
11_03
11_04
09_00
09_01
09_02
09_03
09_04
10_00
10_01
10_02
10_03
10_04
10_05
10_06
03_00
02_00
07_00
07_01
07_02
07_03
07_04
Number of
Grade 4
booklets item
appears in
Grade 4 booklets item
appears in
1
1
3
3
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
3
3
2
2
2
2
2
3
3
1, 2, 3
1, 2, 3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
1, 2, 3
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
217
Accnum
Grade
Grade 4 OMB PDF
Sequence Number
VH853732
VH853733
VH853734
VH853736
VH853737
VH882494
VH810476
VH810477
VH882502
VH858273
VH810864
VH267682
VH810865
VH268945
VH268946
VH268961
VH268962
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4
4
4
4, 8
4
4, 8
4, 8
4, 8
4, 8
08_00
08_01
08_02
08_03
08_04
12_00
12_01
12_02
13_00
13_01
13_02
13_03
13_04
01_00
01_01
01_02
01_03
Number of
Grade 4
booklets item
appears in
Grade 4 booklets item
appears in
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
3
3
218
Appendix K-1af: Summary of Changes Operational Grade 8
Mathematics
219
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
220
2019 Operational Grade 8 Mathematics Student
Previous item
2019 item
Rationale
N/A
D/A/
R/NC+
D
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
NC
N/A
NC
N/A
This item was
dropped
based on the
ADC’s
recommendat
ion.
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
221
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
Issue: Resources for Learning and Instruction
N/A
D/A/
R/NC+
NC
Rationale
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
Issue: Resources for Learning and Instruction
222
2019 Operational Grade 8 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
NC
N/A
NC
N/A
NC
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
This item was
dropped
based on
NCES’s review
of
technologyuse items.
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
223
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
Items
VH267674,
VH617317,
VH267681,
VH267683,
VH460348,
VH460355,
VH460381,
VH460386,
VH460389,
VH460391,
VH460398,
VH460900,
and
VH460912
were dropped
based on
NCES’s review
of selfefficacy items
for grade 8.
N/A
Issue: Resources for Learning and Instruction
224
2019 Operational Grade 8 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Rationale
Issue: Student factors
(2017 Grade 8)
225
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Issue: Student factors
R
(2017 Grade 8)
Rationale
The previous
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
on a total of
at least 4
items,
VH844882
and
VH845114
were added
from the
2016 pilot
assessment.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
Issue: Student Factors
226
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
Issue: Student Factors
D/A/
R/NC+
R
Rationale
The stem
wording was
revised to
remove the
word
“solving” as
per ADC
feedback that
the stem did
not match
rows E and F
in the
previous
phrasing.
Additionally,
"problems"
was replaced
with
"activities" to
better match
the sub-item
content. This
revision was
made based
on coglab
data gathered
on this item
for the 2021
administratio
n.
227
2019 Operational Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
Issue: Resources for Learning and Instruction
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
NC
N/A
NC
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
N/A
Issue: Student factors
Issue: Student factors
228
2019 Operational Grade 8 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
N/A
D
(2017 Grade 8)
(2017 Grade 8)
Rationale
This item was
dropped
based on the
ADC's
recommendat
ion.
This item was
dropped
based on the
ADC's
recommendat
ion.
229
Appendix K-1ag: Operational Grade 8 Mathematics
230
VH266769
22. What math class are you taking this year? Select one or more answer choices.
A Eighth-grade math
B General eighth-grade math
C Algebra I course
D First year of a two-year algebra course
E Second year of a two-year algebra course
F Algebra I (one-year course)
G Algebra II
H Geometry
I Other
VH240046
23. What math class do you expect to take next year?
A Geometry
B Algebra II
C Algebra I (one-year course)
D First year of a two-year Algebra I course
E Second year of a two-year Algebra I course
F Introduction to algebra or pre-algebra
G Basic or general math
H Business or consumer math
I Other math class
J I don’t know.
VH350115
24. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved math?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
231
VH266808
25. In your math class this year, how often have you used the following types of
calculators? Select one answer choice on each row.
a. Basic calculator
b. Graphing calculator
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH266809
A
B
C
D
E
VH266810
VH589166
26. This school year, how often did the following things happen in your math class? Select
one answer choice on each row.
a. My teacher used
computers or other
digital devices to show
us how to work
through math
problems.
b. I used the Internet for
my math work.
c. My teacher used
computers or other
digital devices when
teaching math to my
class.
d. My teacher required us
to use computers or
other digital devices to
complete math
assignments.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH267416
A
B
C
D
E
VH267417
A
B
C
D
E
VH588077
A
B
C
D
E
VH267419
232
VH336037
27. In this school year, how often have you used a computer or other digital device
(excluding handheld calculators) to look online for resources for help with your
math assignments?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH268936
28. How often do you use math in everyday life outside of school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
233
VH589204
29. How often do you participate in each of the following activities outside of
school? Select one answer choice on each row.
a. Talk about math
problems with your
friends
b. Program computers
c. Play an instrument
and read music
d. Go to websites for
help with your math
homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH268946
A
B
C
D
E
VH268949
A
B
C
D
E
VH268961
A
B
C
D
E
VH268962
VH336233
30. How often do you receive help or tutoring with math outside of school or after
school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH336085
31. Have you ever helped your friends with their math homework?
A Yes
B No
VH269037
32. Over the past seven days, how many days have you helped your friends with their
math homework? Enter the number of days.
234
VH460923
33. Have you ever participated in a math study group outside of school?
A Yes
B No
VH460925
34. Over the past seven days, how many days have you participated in a math study
group outside of school? Enter the number of days.
VH460329
35. How often do you play digital games (for example, apps, video games, or computer
games) outside of school that involve math?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
235
VH460345
36. Thinking about math, do you think that you would be able to do each of the
following? Do not actually solve the problems. Select one answer choice on each row.
a. List all of the different
possible outcomes
when a coin is flipped
three times
b. Create an expression
that represents the
average number of
miles you run in a
week if you run 100
miles in w weeks
c. Determine a 20
percent tip of a
67-dollar restaurant
dinner bill
d. Find the amount of
carpet needed to cover
a rectangular floor if
you know its length
and width
e. Give an example to
show that a math
statement is false
f. Explain to your
classmate how you
solved a math problem
g. Use correct
mathematical words
and symbols when
showing your work
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH460382
A
B
C
D
E
VH460383
A
B
C
D
E
VH267679
A
B
C
D
E
VH267682
A
B
C
D
E
VH460399
A
B
C
D
E
VH460910
A
B
C
D
E
VH460902
236
VH844870
37. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
math.
b. I want to show others
that my math
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
math class.
d. I want to get better
grades than most other
students in my math
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844871
A
B
C
D
E
VH844872
A
B
C
D
E
VH844873
A
B
C
D
E
VH844882
VH845110
38. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my math class.
b. I want to master a lot
of new skills in my
math class.
c. I want to become
better in math this
year.
d. I want to understand
as much as I can in my
math class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH845117
A
B
C
D
E
VH845114
A
B
C
D
E
VH845115
A
B
C
D
E
VH845118
237
VH844769
39. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy doing math.
b. I look forward to my
math class.
c. I am interested in the
things I learn in math.
d. I think making an
effort in math is
worthwhile.
e. I think math will help
me even when I am
not in school.
f. I think it is important
to do well in math.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844770
A
B
C
D
E
VH844771
A
B
C
D
E
VH844775
A
B
C
D
E
VH844772
A
B
C
D
E
VH844777
A
B
C
D
E
VH844774
238
VH844743
40. How much do you enjoy each of the following types of math activities? Select one
answer choice on each row.
a. Addition, subtraction,
multiplication, and
division
b. Finding areas of shapes
and figures
c. Solving for
probabilities and
events (for example,
card, coin, marble, and
spinner problems)
d. Solving equations or
simplifying
expressions
e. Constructing and
building different
types of graphs (for
example, bar graph,
line graph, or box and
whisker plots)
f. Working with
geometric figures like
rectangles and squares
Enjoy not at
all
Enjoy a
little bit
Enjoy
somewhat
Enjoy quite
a bit
Enjoy a lot
A
B
C
D
E
VH844744
A
B
C
D
E
VH844745
A
B
C
D
E
VH844746
A
B
C
D
E
VH844750
A
B
C
D
E
VH844748
A
B
C
D
E
VH844749
239
Appendix K-1ah: Summary of Changes Pilot Grade 8 Mathematics
240
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
R
This item’s
response
options were
revised based
on cognitive
interviews
and as
recommende
d by NCES.
NC
N/A
This item’s
response
options were
revised based
on cognitive
interviews
and as
recommende
d by NCES.
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
241
2019 Pilot Grade 8 Mathematics Student
Previous item
2019 item
Rationale
N/A
D/A/
R/NC+
D
N/A
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
N/A
D
This item was
dropped in
place of
keeping
VH853724, as
per similar
recommendat
ions made for
Reading
based on
pretesting
and to ensure
consistency
across
subjects.
This item was
dropped
based on the
ADC’s
recommendat
ion.
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
242
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
R
Previous subitems “a” and
“c” were
revised to
focus more
on assessing
what the
students are
utilizing the
technology
for. These are
current subitems “c” and
“d”.
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
Sub-item “a”
was revised
to give
examples of
what is meant
by a basic
calculator.
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
N/A
(2017 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
243
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
D
This item was
dropped
based on
NCES’s review
of
technologyuse items.
NC
N/A
R
Sub-item “b”
was revised.
The item
stem was
revised.
Issue: Resources for learning and instruction
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
244
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
245
2019 Pilot Grade 8 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
R
Rationale
Current subitem “b” was
revised.
Current subitems “d”, “f”,
“g”, and “h”
were
administered
in coglabs
and retained
for pilot.
Issue: Student factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
246
2019 Pilot Grade 8 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Rationale
R
The previous
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
on a total of
at least 4
items,
VH853961
(2017 Grade 8)
(2017 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
247
2019 Pilot Grade 8 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
Issue: Student Factors
R
(2017 Grade 8)
Rationale
and
VH845134
were added
from the
2016 pilot
assessment.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
The stem was
revised from
“describe a
person like
you” to
“describe
you”.
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
248
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
Issue: Student Factors
The stem
wording was
revised to
remove the
word
“solving” as
per ADC
feedback that
the stem did
not match
rows E and F
in the
previous
phrasing.
Additionally,
"problems"
was replaced
with
"activities".
Sub-items
“d”, “e” and
“f” were
revised.
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 9
249
2019 Pilot Grade 8 Mathematics Student
Previous item
(2017 Grade 8)
(2017 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
A
This item was
added in
place of
VH336233.
This item was
pretested and
kept in
Reading, and
to ensure
consistency,
the same
decision was
made for
math.
A
This item was
added in
place of
VH336233.
This item was
pretested and
kept in
Reading, and
to ensure
consistency,
N/A
Issue: Student factors
Issue: Student factors
N/A
Issue: Resources for Learning and Instruction
N/A
Issue: Resources for Learning and Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 10
250
2019 Pilot Grade 8 Mathematics Student
Previous item
2019 item
D/A/
R/NC+
R
(2017 Grade 8)
Rationale
the same
decision was
made for
math.
Previous subitems “a”,
“d”, and “f”
were
dropped.
Issue: Student factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 11
251
Appendix K-1ai: Pilot Grade 8 Mathematics
252
VH268936
1. How often do you use math in everyday life outside of school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH269037
2. Over the past seven days, how many days have you helped your friends with their
math homework? Enter the number of days.
VH336085
3. Have you ever helped your friends with their math homework?
A Yes
B No
VH350115
4. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved math?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
253
VH460329
5. How often do you play digital games (for example, apps, video games, or computer
games) outside of school that involve math?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH460923
6. Have you ever participated in a math study group outside of school?
A Yes
B No
VH460925
7. Over the past seven days, how many days have you participated in a math study
group outside of school? Enter the number of days.
VH810501
8. What math class are you taking this year? Select one or more answer choices.
A Eighth-grade math
B Introduction to algebra or pre-algebra
C Algebra I
D Geometry
E Algebra II
F Other math class. Please specify:
254
VH810507
9. What math class do you expect to take next year?
A Basic or general math
B Introduction to algebra or pre-algebra
C Algebra I
D Geometry
E Algebra II
F Other math class. Please specify:
G I don’t know.
VH810512
10. In this school year, how often have you looked online for resources for help with
your math assignments?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
255
VH810625
11. How much do you enjoy each of the following types of math activities? Select one
answer choice on each row.
a. Adding, subtracting,
multiplying, and
dividing fractions
b. Finding areas of shapes
and figures
c. Solving for
probabilities and
events (for example,
card, coin, marble, and
spinner problems)
d. Solving problems
about ratios and rates
(for example, if
4 inches of rain fell in
16 hours, how many
inches fell in 1 hour?)
e. Constructing and
building different
types of graphs (for
example, a bar graph
or line graph)
f. Moving geometric
figures from one set of
points to another (for
example, rotating a
rectangle 90 degrees)
Enjoy not at
all
Enjoy a
little bit
Enjoy
somewhat
Enjoy quite
a bit
Enjoy a lot
A
B
C
D
E
VH810635
A
B
C
D
E
VH853661
A
B
C
D
E
VH853662
A
B
C
D
E
VH853665
A
B
C
D
E
VH853674
A
B
C
D
E
VH853671
256
VH853682
12. Thinking about math, do you think that you would be able to do each of the
following? Do not actually solve the problems. Select one answer choice on each row.
a. Find the amount of
carpet needed to cover
a rectangular floor if
you know its length
and width
b. Determine a 20% tip
of a $55 restaurant
dinner bill
c. List all of the different
possible outcomes
when a coin is flipped
three times
d. Determine the likely
number of red faces a
cube has if the red face
lands up 130 out of
400 times the cube is
rolled. The 6 faces of
the cube are painted
red, yellow, or blue.
e. Create an expression
that represents the
average number of
miles you run in a
week if you run
100 miles in w weeks
f. Calculate how many
cats a pet store has if
the ratio of cats to
dogs is 5 to 4, and the
total number of cats
and dogs the store
has is 27
g. Write an equation
with a variable to
solve a problem (for
example, if pizza costs
$2 per slice, then
x number of slices can
be bought for $16)
h. Find the total sum of
the interior angles of a
pentagon with
5 equal sides
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH267682
A
B
C
D
E
VH853690
A
B
C
D
E
VH853692
A
B
C
D
E
VH853683
A
B
C
D
E
VH853693
A
B
C
D
E
VH853685
A
B
C
D
E
VH853713
A
B
C
D
E
VH853714
257
VH853724
13. How often do you receive the following types of help with math schoolwork outside
of school or after school? Select one answer choice on each row.
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online
resources (for example,
websites or apps)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH853725
A
B
C
D
E
VH853726
A
B
C
D
E
VH853728
A
B
C
D
E
VH853729
VH853732
14. How useful do you find each of the following types of help to understand your math
schoolwork? Select one answer choice on each row.
Not useful at
all
Somewhat
useful
Very useful
I don’t receive
that type of
help.
A
B
C
D
VH853733
A
B
C
D
VH853734
A
B
C
D
VH853736
A
B
C
D
VH853737
a. Help from a teacher
b. Help from a tutor
c. Help from a family
member or friend
d. Help from online resources
(for example, websites or
apps)
VH853944
15. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible
about math in my
class.
b. I want to master a lot
of new math skills in
my class.
c. I want to become a
better math student
this year.
d. I want to understand
as much as I can in my
math class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH853957
A
B
C
D
E
VH853961
A
B
C
D
E
VH853949
A
B
C
D
E
VH853952
258
VH854028
16. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy doing math.
b. I look forward to my
math class.
c. I am interested in the
things I learn in math.
d. I think making an
effort in math is
worthwhile.
e. I think math will help
me even when I am
not in school.
f. I think it is important
to do well in math.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH854029
A
B
C
D
E
VH854030
A
B
C
D
E
VH854034
A
B
C
D
E
VH854031
A
B
C
D
E
VH854036
A
B
C
D
E
VH854033
VH854116
17. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am a good
math student.
b. I want to show others
that my math
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
math class.
d. I want to get better
math grades than most
other students in my
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH854117
A
B
C
D
E
VH854118
A
B
C
D
E
VH854119
A
B
C
D
E
VH854134
259
VH882452
18. How often do you participate in each of the following activities outside of
school? Select one answer choice on each row.
a. Talk about math
problems with your
friends
b. Write a computer
program
c. Play an instrument
and read music
d. Go to websites for
help with your math
homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH268946
A
B
C
D
E
VH858371
A
B
C
D
E
VH268961
A
B
C
D
E
VH268962
VH882460
19. In your math class this year, how often have you used the following types of
calculators? Select one answer choice on each row.
a. Basic calculator (for
example, four function
or scientific)
b. Graphing calculator
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH853523
A
B
C
D
E
VH266810
260
VH882471
20. This school year, how often did the following things happen in your math class? Select
one answer choice on each row.
a. My teacher used
computers or other
digital devices to show
us how to work
through math
problems.
b. I used the Internet for
my math work.
c. My teacher used
computers or other
digital devices to go on
websites or use apps
when teaching math
to my class.
d. My teacher required us
to use computers or
other digital devices to
go on websites or use
apps to complete math
assignments.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH267416
A
B
C
D
E
VH267417
A
B
C
D
E
VH810476
A
B
C
D
E
VH810477
VH882480
21. Thinking about math, do you think that you would be able to do each of the
following? Select one answer choice on each row.
a. Give an example to
show that a math
statement is false
b. Explain to your
classmate how you
solved a math problem
c. Use correct
mathematical words
and symbols when
showing your work
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH460399
A
B
C
D
E
VH460910
A
B
C
D
E
VH460902
261
Appendix K-1aj: Spiral Map Grade 8 Mathematics
262
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
VH350115
VH268936
VH460329
VH854116
VH854117
VH854118
VH854119
VH854134
VH853944
VH853957
VH853961
VH853949
VH853952
VH854028
VH854029
VH854030
VH854034
VH854031
VH854036
VH854033
VH336085
VH269037
VH853724
VH853725
VH853726
VH853728
VH853729
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
4, 8
04_00
01_00
05_00
17_00
17_01
17_02
17_03
17_04
15_00
15_01
15_02
15_03
15_04
16_00
16_01
16_02
16_03
16_04
16_05
16_06
03_00
02_00
13_00
13_01
13_02
13_03
13_04
Number of
Grade 8
booklets item
appears in
Grade 8 booklets item
appears in
1
3
3
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
3
3
2
2
2
2
2
3
1 ,2, 3
1, 2, 3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
1, 2, 3
1, 2, 3
1, 2
1, 2
1, 2
1, 2
1, 2
263
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
VH853732
VH853733
VH853734
VH853736
VH853737
VH810501
VH810507
VH882460
VH853523
VH266810
VH882471
VH267416
VH267417
VH810476
VH810477
VH810512
VH810625
VH810635
VH853661
VH853662
VH853665
VH853674
VH853671
VH853682
VH267682
VH853690
VH853692
VH853683
VH853693
4, 8
4, 8
4, 8
4, 8
4, 8
8
8
8
8
8
4, 8
8
8
4, 8
4, 8
8
8
8
8
8
8
8
8
8
4, 8
8
8
8
8
14_00
14_01
14_02
14_03
14_04
08_00
09_00
19_00
19_01
19_02
20_00
20_01
20_02
20_03
20_04
10_00
11_00
11_01
11_02
11_03
11_04
11_05
11_06
12_00
12_01
12_02
12_03
12_04
12_05
Number of
Grade 8
booklets item
appears in
Grade 8 booklets item
appears in
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
2
2
2
2
2
2
2
2
2
2
2
2
2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
3
3
3
3
3
3
3
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
264
VH853685
8
12_06
2
1, 2
Grade 8 booklets item
appears in
1, 2
1, 2
1, 2
1, 2
1, 2
1, 2
3
3
3
3
3
1, 2, 3
1, 2, 3
Accnum
Grade
Grade 8 OMB PDF
Sequence Number
Number of
Grade 8
booklets item
appears in
VH853713
VH853714
VH882480
VH460399
VH460910
VH460902
VH882452
VH268946
VH858371
VH268961
VH268962
VH460923
VH460925
8
8
8
8
8
8
4, 8
4, 8
8
4, 8
4, 8
8
8
12_07
12_08
21_00
21_01
21_02
21_03
18_00
18_01
18_02
18_03
18_04
06_00
07_00
2
2
2
2
2
2
1
1
1
1
1
3
3
265
Appendix K-1ak: Summary of Changes Operational Grade 12
Mathematics
266
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
Sub-item “p”
was dropped
since "Other"
is not an
option
preferred to
be included
for student
operational
administratio
n.
Issue: Student factors
267
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
268
2019 Operational Grade 12 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
Rationale
R
The version of
the item that
uses
“describe
you” in the
stem was
retained for
operational.
This item was
dropped in
lieu of
keeping item
VH731852.
(2018 Grade 12)
(2018 Grade 12)
Issue: Student factors
269
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
Issue: Organization of Instruction
N/A
D
N/A
D
This item was
dropped to
keep in line
with the
ADC’s
recommendat
ion for grades
4 and 8.
This item was
dropped to
keep in line
with NCES’s
review of
technologyuse items for
grades 4 and
8.
Issue: Organization of Instruction
(2018 Grade 12)
(2018 Grade 12)
N/A
270
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
271
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
2019 item
Issue: Resources for Learning and Instruction
N/A
D/A/
R/NC+
NC
Rationale
D
This item was
dropped to
keep in line
with NCES’s
review of
technologyuse items for
grades 4 and
8.
N/A
(2018 Grade 12)
NC
(2018 Grade 12)
N/A
Issue: Resources for Learning and Instruction
272
2019 Operational Grade 12 Mathematics Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
NC
This item was
dropped to
keep in line
with NCES’s
review of
technologyuse items for
grades 4 and
8.
N/A
NC
N/A
NC
N/A
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
Rationale
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
Issue: Resources for Learning and Instruction
273
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
R
A subset of
items was
selected from
the previous
two matrices
to be
included in
the selfefficacy
matrix for
operational.
N/A
Issue: Resources for Learning and Instruction
Issue: Student factors
(2018 Grade 12)
274
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
2019 item
Issue: Student factors
D/A/
R/NC+
R
Rationale
The version of
the item that
uses
“describe
you” in the
stem was
retained for
operational.
The single
matrix was
separated
into two
matrices of
achievement
goals items
(performance
and mastery).
In order to
create indices
for both
performance
and mastery
goals based
on a total of
at least 4
items,
VH844882
and
VH845114
were added
from the
2016 pilot
assessment.
275
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
D
This item was
dropped to
keep in line
with NCES’s
review of
technologyuse items for
grades 4 and
8.
Previous subitems “a” –
“c” were
dropped.
Issue: Solving equations
Issue: Resources for Learning and Instruction
N/A
276
2019 Operational Grade 12 Mathematics Student
Previous item
2019 item
N/A
(2018 Grade 12)
D/A/
R/NC+
D
Rationale
This item was
dropped to
keep in line
with NCES’s
review of
technologyuse items for
grades 4 and
8.
277
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
NC
N/A
Issue: Student factors
N/A
D
N/A
D
This item was
dropped
based on the
ADC's
recommendat
ion for grades
4 and 8.
This item was
dropped
based on the
ADC's
Previous subitem “d” was
dropped.
Issue: Student factors
Issue: Student factors
(2018 Grade 12)
278
2019 Operational Grade 12 Mathematics Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
Rationale
recommendat
ion for grades
4 and 8.
279
Appendix K-1al: Operational Grade 12 Mathematics
280
VH240819
24. Which courses have you taken from eighth grade to the present? If you have taken a
course more than once, give the most recent year you took it. INCLUDE courses
taken in summer school, but DO NOT INCLUDE topics that were only taught as
part of a longer course (such as trigonometry taught in drafting class or computer
programming taught in Algebra II). Select one answer choice on each row.
I have
I took this I took this I took this I took this I took this
never
course in
in course in course in course in
taken this or before course
Grade
9.
Grade 10. Grade 11. Grade 12.
course.
Grade 8.
a. Basic or general
mathematics
course
b. Tech-prep
mathematics,
business
mathematics,
consumer
mathematics, or
other applied
mathematics
course
c. Introduction to
algebra or
pre-algebra course
d. Algebra I course
e. Geometry course
f. Algebra II course,
with or without
trigonometry
g. Trigonometry (as a
separate course)
h. Pre-calculus course
(also called
introductory
analysis)
i. Integrated
mathematics 1
(first year of a
multi-year course)
j. Integrated
mathematics 2
(second year of a
multi-year course)
k. Integrated
mathematics 3
(third year of a
multi-year course)
A
B
C
D
E
F
VH240820
A
B
C
D
E
F
VH240844
A
B
C
D
E
F
VH240822
A
B
C
D
E
F
VH240823
A
B
C
D
E
F
VH240824
A
B
C
D
E
F
VH240825
A
B
C
D
E
F
VH240826
A
B
C
D
E
F
VH240833
A
B
C
D
E
F
VH240841
A
B
C
D
E
F
VH240842
A
B
C
D
E
F
VH240843
281
I have
I took this I took this I took this I took this I took this
never
course in
in course in course in course in
taken this or before course
Grade
9.
Grade 10. Grade 11. Grade 12.
course.
Grade 8.
l. Integrated
mathematics 4
(fourth year of a
multi-year course)
m. Probability or
statistics course
n. Calculus course
o. Computer
programming
course (such as
C⫹⫹, Visual Basic,
etc.)
A
B
C
D
E
F
VH240821
A
B
C
D
E
F
VH240836
A
B
C
D
E
F
VH240829
A
B
C
D
E
F
VH240835
VH250444
25. Are you currently enrolled in or have you taken any of the following Advanced
Placement (AP®) courses? Select all that apply.
A Yes, I am enrolled in or have taken Advanced Placement (AP) Calculus AB.
B Yes, I am enrolled in or have taken Advanced Placement (AP) Calculus BC.
C Yes, I am enrolled in or have taken Advanced Placement (AP) Statistics.
D No, I have not taken any of the courses listed above.
VH240048
26. Are you currently enrolled in or have you taken an International Baccalaureate®
(IB) mathematics course?
A Yes
B No
282
VH240049
27. Are you currently enrolled in or have you taken any online mathematics courses
for high school or college credit?
A Yes
B No
VH240050
28. Was there a mathematics course that you would have liked to have taken this
school year but did not take?
A Yes, but my school does not offer the course.
B Yes, but the course was full.
C Yes, but I did not have the necessary prerequisites.
D Yes, but my schedule was full.
E No, there was no other course that I wanted to take.
VH240051
29. Are you currently taking a mathematics course?
A Yes
B No
VH350115
30. For school this year, how often have you been asked to write long answers (several
sentences or paragraphs) to questions on tests or assignments that involved math?
A Never
B Once
C Two or three times
D Four or five times
E More than five times
283
VH266808
31. In your math class this year, how often have you used the following types of
calculators? Select one answer choice on each row.
a. Basic calculator
b. Graphing calculator
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH266809
A
B
C
D
E
VH266810
VH589166
32. This school year, how often did the following things happen in your math class? Select
one answer choice on each row.
a. My teacher used
computers or other
digital devices to show
us how to work
through math
problems.
b. I used the Internet for
my math work.
c. My teacher used
computers or other
digital devices when
teaching math to my
class.
d. My teacher required us
to use computers or
other digital devices to
complete math
assignments.
Never or
hardly ever
Less than
half of the
time
About half
of the time
More than
half of the
time
All or
almost all of
the time
A
B
C
D
E
VH267416
A
B
C
D
E
VH267417
A
B
C
D
E
VH588077
A
B
C
D
E
VH267419
284
VH336037
33. In this school year, how often have you used a computer or other digital device
(excluding handheld calculators) to look online for resources for help with your
math assignments?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH844870
34. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good at
math.
b. I want to show others
that my math
schoolwork is easy for
me.
c. I want to look smart in
comparison to the
other students in my
math class.
d. I want to get better
grades than most other
students in my math
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH844871
A
B
C
D
E
VH844872
A
B
C
D
E
VH844873
A
B
C
D
E
VH844882
285
VH845110
35. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my math class.
b. I want to master a lot
of new skills in my
math class.
c. I want to become
better in math this
year.
d. I want to understand
as much as I can in my
math class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH845117
A
B
C
D
E
VH845114
A
B
C
D
E
VH845115
A
B
C
D
E
VH845118
VH613511
36. Thinking about math, do you think that you would be able to do each of the
following? Do not actually solve the problems. Select one answer choice on each row.
a. Create an expression
that represents the
average number of
miles you run in a
week if you run 100
miles in w weeks
b. Determine a 20
percent tip of a
67-dollar restaurant
dinner bill
c. Describe the
properties shared by
every isosceles right
triangle
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH460383
A
B
C
D
E
VH267679
A
B
C
D
E
VH267681
286
VH613523
37. Thinking about math, do you think that you would be able to do each of the
following? Select one answer choice on each row.
a. Decide if your
classmate’s math work
is correct
b. Give an example to
show that a math
statement is false
c. Explain to your
classmate how you
solved a math problem
d. Use correct
mathematical words
and symbols when
showing your work
e. Use definitions of
geometric shapes to
support an argument
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH460398
A
B
C
D
E
VH460399
A
B
C
D
E
VH460910
A
B
C
D
E
VH460902
A
B
C
D
E
VH460912
VH860646
38. How much do you enjoy each of the following types of math activities? Select one
answer choice on each row.
a. Solving equations or
simplifying
expressions
b. Constructing and
building different
types of graphs (for
example, bar graph,
line graph, or box and
whisker plots)
c. Working with
geometric figures like
rectangles and squares
Enjoy not at
all
Enjoy a
little bit
Enjoy
somewhat
Enjoy quite
a bit
Enjoy a lot
A
B
C
D
E
VH860653
A
B
C
D
E
VH860651
A
B
C
D
E
VH860652
287
VH268936
39. How often do you use math in everyday life outside of school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH460329
40. How often do you play digital games (for example, apps, video games, or computer
games) outside of school that involve math?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH589204
41. How often do you participate in each of the following activities outside of
school? Select one answer choice on each row.
a. Talk about math
problems with your
friends
b. Program computers
c. Play an instrument
and read music
d. Go to websites for
help with your math
homework
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH268946
A
B
C
D
E
VH268949
A
B
C
D
E
VH268961
A
B
C
D
E
VH268962
288
VH336233
42. How often do you receive help or tutoring with math outside of school or after
school?
A Never
B About once or twice a year
C About once or twice a month
D About once or twice a week
E Every day or almost every day
VH336085
43. Have you ever helped your friends with their math homework?
A Yes
B No
VH269037
44. Over the past seven days, how many days have you helped your friends with their
math homework? Enter the number of days.
VH460923
45. Have you ever participated in a math study group outside of school?
A Yes
B No
VH460925
46. Over the past seven days, how many days have you participated in a math study
group outside of school? Enter the number of days.
289
VH731852
47. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy doing math.
b. I look forward to my
math class.
c. I am interested in the
things I learn in math.
d. I think making an
effort in math is
worthwhile.
e. I think math will help
me even when I am
not in school.
f. I think it is important
to do well in math.
g. I take mathematics
because it will help
me in the future.
h. I take mathematics to
meet my high school
graduation
requirements.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH731853
A
B
C
D
E
VH731854
A
B
C
D
E
VH731858
A
B
C
D
E
VH731855
A
B
C
D
E
VH731860
A
B
C
D
E
VH731857
A
B
C
D
E
VH731859
A
B
C
D
E
VH731856
290
Appendix K-1am: Summary of Changes Operational Grade 4
Science
291
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
292
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
293
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
Issue: Organization of Instruction
N/A
D
N/A
D
N/A
D
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
(2018 Grade 4)
(2018 Grade 4)
(2018 Grade 4)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
N/A
294
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
2019 item
D/A/
R/NC+
R
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-item g
was dropped.
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
295
2019 Operational Grade 4 Science Student
Previous item
2019 item
D/A/
R/NC+
R
(2018 Grade 4)
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
Rationale
This item was
divided into
two items to
reduce
scrolling and
align
presentation
with similar
items in other
subjects.
Additionally,
the wording
of sub-items
d and h (now
sub-item d in
the second
matrix) have
been revised,
with the word
“science”
moved to
before the
word “class”.
296
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
2019 item
D/A/
R/NC+
R
Issue: Student Factors
NC
(2018 Grade 4)
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-item b
was dropped.
Additionally,
the verbs at
the beginning
of the original
sub-items a
and c have
been changed
to past tense
for
consistency
with the item
stem.
N/A
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
297
2019 Operational Grade 4 Science Student
Previous item
(2018 Grade 4)
(2018 Grade 4)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
298
Appendix K-1an: Operational Grade 4 Science
299
VH639012
17. In your science class this year, how often have you learned about living things (for
example, plants, animals, or bacteria)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
VH639027
18. In your science class this year, how often have you learned about electricity (for
example, circuits, batteries, or light bulbs)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
300
VH639033
19. In your science class this year, how often have you learned about chemicals (for
example, vinegar, baking soda, or hydrogen peroxide)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
VH639037
20. In your science class this year, how often have you learned about rocks or minerals
(for example, diamond, iron, or lava rock)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
VH639043
21. In your science class this year, how often have you done science activities using
scientific tools (for example, microscopes, thermometers, beakers, or weighing
scales)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Always or almost always
301
VH639047
22. In your science class this year, how often have you read from a science textbook
(print or digital)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Always or almost always
VH639055
23. In your science class this year, how often have you learned about science topics on
the Internet?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Always or almost always
VH639057
24. In your science class this year, how often have you watched a short video clip,
movie, or video about science topics?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Always or almost always
302
VH639060
25. In your science class this year, how often have you been asked to write about
science topics (for example, a science journal, lab report, or essay)?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Always or almost always
VH639149
26. In this school year, how often have you done the following activities in your science
class? Select one answer choice on each row.
a. Made a drawing that
explains why or how
something happens
b. Used a science
experiment to answer
a question
c. Put information you
collected into a table
or graph
d. Used evidence to
explain why
something happens
e. Found news articles
about science on the
Internet
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH639156
A
B
C
D
E
VH639162
A
B
C
D
E
VH639164
A
B
C
D
E
VH639166
A
B
C
D
E
VH639169
303
VH638866
27. Thinking about science, do you think that you would be able to do each of the
following activities? Select one answer choice on each row.
a. Describe different
ways to heat or cool
water
b. Describe how the
length of a vibrating
string affects the
sound it makes
c. Design an experiment
to show how sunlight
affects the growth
of a plant
d. Use examples to show
how one living thing
has helped another to
survive
e. Describe what would
happen to the number
of frogs at a pond if all
the insects were
removed from the
pond
f. Decide which tool to
use if you want to
measure wind speed
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH638868
A
B
C
D
E
VH638870
A
B
C
D
E
VH638872
A
B
C
D
E
VH638875
A
B
C
D
E
VH638876
A
B
C
D
E
VH638883
304
VH639079
28. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good
at science.
b. I want to show
others that science
schoolwork is easy
for me.
c. I want to look smart
in comparison to the
other students in my
science class.
d. I want to get better
grades than most other
students in my science
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly
like me
A
B
C
D
E
VH639080
A
B
C
D
E
VH639082
A
B
C
D
E
VH639084
A
B
C
D
E
VH860366
VH859155
29. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my science class.
b. I want to become
better in science
this year.
c. I want to understand
as much as I can in
my science class.
d. I want to master a lot
of new skills in my
science class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639086
A
B
C
D
E
VH639087
A
B
C
D
E
VH639089
A
B
C
D
E
VH860369
305
VH638951
30. In this school year, how often have you done each of the following activities outside
of school? Select one answer choice on each row.
a. Worked on
science-related
projects (for example,
making a volcano,
growing plants from
seeds, or building
simple rockets)
b. Used scientific tools
(for example,
microscopes,
thermometers,
beakers, or weighing
scales)
c. Read about science
topics in books or
magazines (print or
digital)
d. Attended clubs or
programs that include
science or engineering
activities (for example
chemistry club,
robotics club, or
coding programs)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH859162
A
B
C
D
E
VH891927
A
B
C
D
E
VH638987
A
B
C
D
E
VH893268
306
VH639115
31. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy science
activities.
b. I look forward to my
science class.
c. I am interested in the
things I learn in
science class.
d. I think making an
effort in science class
is worthwhile.
e. I think science will
help me even when I
am not in school.
f. I think it is important
to do well on science
assignments.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639117
A
B
C
D
E
VH639120
A
B
C
D
E
VH639122
A
B
C
D
E
VH639125
A
B
C
D
E
VH639127
A
B
C
D
E
VH639128
VH743438
32. How often do you talk about things you have learned in science class with
someone in your family?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
307
Appendix K-1ao: Summary of Changes Operational Grade 8
Science
308
2019 Operational Grade 8 Science Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
N/A
D
N/A
D
(2018 Grade 8)
(2018 Grade 8)
(2018 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
Rationale
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
309
2019 Operational Grade 8 Science Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
R
To simplify
wording
based on
stakeholder
feedback,
sub-item e
was revised.
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
310
2019 Operational Grade 8 Science Student
Previous item
(2018 Grade 8)
2019 item
D/A/
R/NC+
R
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-items a,
d, and g were
dropped.
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
311
2019 Operational Grade 8 Science Student
Previous item
(2018 Grade 8)
2019 item
D/A/
R/NC+
R
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
Rationale
This item was
divided into
two items to
reduce
scrolling and
align
presentation
with similar
items in other
subjects.
Additionally,
the wording
of sub-items
d and h (now
sub-item d in
the second
matrix) have
been revised,
with the word
“science”
moved to
before the
word “class”.
312
2019 Operational Grade 8 Science Student
Previous item
(2018 Grade 8)
2019 item
D/A/
R/NC+
R
Issue: Student Factors
NC
(2018 Grade 8)
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-item b
was dropped.
Additionally,
the verbs at
the beginning
of the original
sub-items a
and c have
been changed
to past tense
for
consistency
with the item
stem.
N/A
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
313
2019 Operational Grade 8 Science Student
Previous item
(2018 Grade 8)
(2018 Grade 8)
2019 item
D/A/
R/NC+
NC
Rationale
N/C
N/A
N/A
Issue: Organization of Instruction
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
314
Appendix K-1ap: Operational Grade 8 Science
315
VH639071
22. In your science class this year, how often have you done hands-on activities or
projects on any of the following topics? Select one answer choice on each row.
a. Living things (for
example, plants,
animals, or bacteria)
b. Electricity (for
example, circuits,
batteries, or light
bulbs)
c. Chemicals (for
example, vinegar,
baking soda, or
hydrogen peroxide)
d. Rocks or minerals (for
example, diamond,
iron, or lava rock)
e. Technology and
engineering (for
example, robots,
pulley systems, or
ramps)
Never or
hardly ever
Once in a
while
Sometimes
Often
Very often
A
B
C
D
E
VH639072
A
B
C
D
E
VH639074
A
B
C
D
E
VH639073
A
B
C
D
E
VH639077
A
B
C
D
E
VH639076
316
VH639311
23. In your science class this year, how often have you done each of the following
activities? Select one answer choice on each row.
a. Read from a science
textbook (print or
digital)
b. Read a book or
magazine (print or
digital) about science
topics
c. Used the Internet to
learn about science
topics
d. Watched a short video
clip, movie, or video
about science topics
e. Used a magnifying
glass or microscope
f. Used a thermometer
or weighing scale for
making measurements
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH639313
A
B
C
D
E
VH639315
A
B
C
D
E
VH639314
A
B
C
D
E
VH639312
A
B
C
D
E
VH887984
A
B
C
D
E
VH639078
317
VH882513
24. Thinking about science, do you think that you would be able to do each of the
following activities? Select one answer choice on each row.
a. Describe how the
length of a vibrating
string affects the
sound it makes
b. Design an experiment
to show how sunlight
affects the growth
of a plant
c. Describe what would
happen to the number
of frogs at a pond if all
the insects were
removed from the
pond
d. Decide which tool to
use if you want to
measure wind speed
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH638870
A
B
C
D
E
VH638872
A
B
C
D
E
VH638876
A
B
C
D
E
VH638883
VH639079
25. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good
at science.
b. I want to show
others that science
schoolwork is easy
for me.
c. I want to look smart
in comparison to the
other students in my
science class.
d. I want to get better
grades than most other
students in my science
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly
like me
A
B
C
D
E
VH639080
A
B
C
D
E
VH639082
A
B
C
D
E
VH639084
A
B
C
D
E
VH860366
318
VH859155
26. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my science class.
b. I want to become
better in science
this year.
c. I want to understand
as much as I can in
my science class.
d. I want to master a lot
of new skills in my
science class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639086
A
B
C
D
E
VH639087
A
B
C
D
E
VH639089
A
B
C
D
E
VH860369
VH638951
27. In this school year, how often have you done each of the following activities outside
of school? Select one answer choice on each row.
a. Worked on
science-related
projects (for example,
making a volcano,
growing plants from
seeds, or building
simple rockets)
b. Used scientific tools
(for example,
microscopes,
thermometers,
beakers, or weighing
scales)
c. Read about science
topics in books or
magazines (print or
digital)
d. Attended clubs or
programs that include
science or engineering
activities (for example
chemistry club,
robotics club, or
coding programs)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH859162
A
B
C
D
E
VH891927
A
B
C
D
E
VH638987
A
B
C
D
E
VH893268
319
VH639115
28. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy science
activities.
b. I look forward to my
science class.
c. I am interested in the
things I learn in
science class.
d. I think making an
effort in science class
is worthwhile.
e. I think science will
help me even when I
am not in school.
f. I think it is important
to do well on science
assignments.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639117
A
B
C
D
E
VH639120
A
B
C
D
E
VH639122
A
B
C
D
E
VH639125
A
B
C
D
E
VH639127
A
B
C
D
E
VH639128
320
VH639733
29. In this school year, how often have you done the following activities in your science
class? Select one answer choice on each row.
a. Came up with
research questions to
explore how
something works
b. Made drawings that
explain why or how
something happens
c. Came up with
experiments that you
could use to answer a
research question
d. Used tables or graphs
to identify
relationships between
variables
e. Used math equations
to explain or support
scientific conclusions
f. Used evidence from
experiments to explain
why something
happens
g. Used information to
disagree with someone
about a scientific idea
h. Combined information
about science from
multiple sources (for
example, books,
websites, or articles)
for an assignment
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH639744
A
B
C
D
E
VH639749
A
B
C
D
E
VH639753
A
B
C
D
E
VH639760
A
B
C
D
E
VH639763
A
B
C
D
E
VH639765
A
B
C
D
E
VH639770
A
B
C
D
E
VH639777
321
VH743438
30. How often do you talk about things you have learned in science class with
someone in your family?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
322
Appendix K-1aq: Summary of Changes Operational Grade 12
Science
323
2019 Operational Grade 12 Science Student
Previous item
2019 item
N/A
D/A/
R/NC+
D
N/A
D
N/A
D
(2018 Grade 12)
(2018 Grade 12)
(2018 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
Rationale
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
Due to
overlap with
new content
and to keep
student
burden low,
this item was
dropped.
324
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
R
To simplify
wording
based on
stakeholder
feedback,
sub-item e
was revised.
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
325
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
The “Other
(Please
specify)”
response
option was
removed. This
response
option is only
used in pilot
administratio
ns.
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
326
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
Issue: Organization of Instruction
Issue: Organization of Instruction
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
327
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-items a,
d, e, f, and g
were
dropped.
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
328
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
Rationale
This item was
divided into
two items to
reduce
scrolling and
align
presentation
with similar
items in other
subjects.
Additionally,
the wording
of sub-items
d and h (now
sub-item d in
the second
matrix) have
been revised,
with the word
“science”
moved to
before the
word “class”.
329
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Issue: Student Factors
NC
(2018 Grade 12)
Rationale
Due to a lack
of response
variability and
to keep
student
burden low,
sub-item b
was dropped.
Additionally,
the verbs at
the beginning
of the original
sub-items a
and c have
been changed
to past tense
for
consistency
with the item
stem.
N/A
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
330
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
NC
Rationale
N/C
N/A
N/A
Issue: Organization of Instruction
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
331
2019 Operational Grade 12 Science Student
Previous item
(2018 Grade 12)
(2018 Grade 12)
2019 item
D/A/
R/NC+
R
Rationale
NC
N/A
To keep
student
burden low,
sub-items a,
b, c, d, e, h,
and k were
dropped.
Issue: Student Factors
Issue: Student Factors
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 9
332
Appendix K-1ar: Operational Grade 12 Science
333
VH241146
24. Which courses have you taken from eighth grade to the present? If you have taken a course more
than once, give the most recent year you took it. Select one answer choice on each row.
INCLUDE courses taken in summer school, but DO NOT INCLUDE topics that were only taught
as part of a longer course.
I did not
take this
course.
a. General science
b. First-year biology
c. Second-year
biology
d. Life science (other
than biology)
e. First-year
chemistry
f. Second-year
chemistry
g. First-year physics
h. Second-year
physics
i. Physical science
(other than
chemistry or
physics)
j. Earth and space
science
k. Engineering and
technology
I am
taking
or
I took this I took this I took this I took this
have
course in course in course in course in
this
Grade 8.
Grade 9. Grade 10. Grade 11. taken
course in
Grade 12.
A
B
C
D
E
F
VH241150
A
B
C
D
E
F
VH241151
A
B
C
D
E
F
VH241159
A
B
C
D
E
F
VH241148
A
B
C
D
E
F
VH241154
A
B
C
D
E
F
VH241155
A
B
C
D
E
F
VH241156
A
B
C
D
E
F
VH241157
A
B
C
D
E
F
VH241149
A
B
C
D
E
F
VH241147
A
B
C
D
E
F
VH241158
VH240111
25. Are you currently enrolled in or have you taken any online science courses for
high school or college credit?
A Yes
B No
334
VH240377
26. Are you currently enrolled in or have you taken an Advanced Placement® course
in science? Select all that apply.
A Yes, I am enrolled in or have taken Advanced Placement Biology.
B Yes, I am enrolled in or have taken Advanced Placement Environmental Science.
C Yes, I am enrolled in or have taken Advanced Placement Chemistry.
D Yes, I am enrolled in or have taken Advanced Placement Physics C.
E Yes, I am enrolled in or have taken Advanced Placement Physics 1.
F Yes, I am enrolled in or have taken Advanced Placement Physics 2.
G Yes, I am enrolled in or have taken Advanced Placement Computer Science A.
H Yes, I am enrolled in or have taken Advanced Placement Computer Science Principles.
I No, I have never taken an Advanced Placement science course.
VH240112
27. Are you currently taking a science course?
A Yes
B No
335
VH639071
28. In your science class this year, how often have you done hands-on activities or
projects on any of the following topics? Select one answer choice on each row.
a. Living things (for
example, plants,
animals, or bacteria)
b. Electricity (for
example, circuits,
batteries, or light
bulbs)
c. Chemicals (for
example, vinegar,
baking soda, or
hydrogen peroxide)
d. Rocks or minerals (for
example, diamond,
iron, or lava rock)
e. Technology and
engineering (for
example, robots,
pulley systems, or
ramps)
Never or
hardly ever
Once in a
while
Sometimes
Often
Very often
A
B
C
D
E
VH639072
A
B
C
D
E
VH639074
A
B
C
D
E
VH639073
A
B
C
D
E
VH639077
A
B
C
D
E
VH639076
336
VH639311
29. In your science class this year, how often have you done each of the following
activities? Select one answer choice on each row.
a. Read from a science
textbook (print or
digital)
b. Read a book or
magazine (print or
digital) about science
topics
c. Used the Internet to
learn about science
topics
d. Watched a short video
clip, movie, or video
about science topics
e. Used a magnifying
glass or microscope
f. Used a thermometer
or weighing scale for
making measurements
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH639313
A
B
C
D
E
VH639315
A
B
C
D
E
VH639314
A
B
C
D
E
VH639312
A
B
C
D
E
VH887984
A
B
C
D
E
VH639078
337
VH639733
30. In this school year, how often have you done the following activities in your science
class? Select one answer choice on each row.
a. Came up with
research questions to
explore how
something works
b. Made drawings that
explain why or how
something happens
c. Came up with
experiments that you
could use to answer a
research question
d. Used tables or graphs
to identify
relationships between
variables
e. Used math equations
to explain or support
scientific conclusions
f. Used evidence from
experiments to explain
why something
happens
g. Used information to
disagree with someone
about a scientific idea
h. Combined information
about science from
multiple sources (for
example, books,
websites, or articles)
for an assignment
Never or
hardly ever
Once in a
while
Sometimes
Often
Always or
almost
always
A
B
C
D
E
VH639744
A
B
C
D
E
VH639749
A
B
C
D
E
VH639753
A
B
C
D
E
VH639760
A
B
C
D
E
VH639763
A
B
C
D
E
VH639765
A
B
C
D
E
VH639770
A
B
C
D
E
VH639777
338
VH639079
31. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want other students
to think I am good
at science.
b. I want to show
others that science
schoolwork is easy
for me.
c. I want to look smart
in comparison to the
other students in my
science class.
d. I want to get better
grades than most other
students in my science
class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly
like me
A
B
C
D
E
VH639080
A
B
C
D
E
VH639082
A
B
C
D
E
VH639084
A
B
C
D
E
VH860366
VH859155
32. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I want to learn as
much as possible in
my science class.
b. I want to become
better in science
this year.
c. I want to understand
as much as I can in
my science class.
d. I want to master a lot
of new skills in my
science class.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639086
A
B
C
D
E
VH639087
A
B
C
D
E
VH639089
A
B
C
D
E
VH860369
339
VH639115
33. How much does each of the following statements describe you? Select one answer
choice on each row.
a. I enjoy science
activities.
b. I look forward to my
science class.
c. I am interested in the
things I learn in
science class.
d. I think making an
effort in science class
is worthwhile.
e. I think science will
help me even when I
am not in school.
f. I think it is important
to do well on science
assignments.
Not at all
like me
A little bit
like me
Somewhat
like me
Quite a bit
like me
Exactly like
me
A
B
C
D
E
VH639117
A
B
C
D
E
VH639120
A
B
C
D
E
VH639122
A
B
C
D
E
VH639125
A
B
C
D
E
VH639127
A
B
C
D
E
VH639128
340
VH638951
34. In this school year, how often have you done each of the following activities outside
of school? Select one answer choice on each row.
a. Worked on
science-related
projects (for example,
making a volcano,
growing plants from
seeds, or building
simple rockets)
b. Used scientific tools
(for example,
microscopes,
thermometers,
beakers, or weighing
scales)
c. Read about science
topics in books or
magazines (print or
digital)
d. Attended clubs or
programs that include
science or engineering
activities (for example
chemistry club,
robotics club, or
coding programs)
Never
About once
or twice a
year
About once
or twice a
month
About once Every day or
or twice a
almost
week
every day
A
B
C
D
E
VH859162
A
B
C
D
E
VH891927
A
B
C
D
E
VH638987
A
B
C
D
E
VH893268
341
VH651609
35. Thinking about science, do you think that you would be able to do each of the
following activities? Select one answer choice on each row.
a. Describe how the
length of a vibrating
string affects the
sound it makes
b. Design an experiment
to show how sunlight
affects the growth
of a plant
c. Decide which tool to
use if you want to
measure wind speed
d. Design an experiment
to test how the growth
of a plant is affected by
light, water, and soil
quality
e. Create a diagram that
shows how bees and
plants need each other
for survival
f. Describe how the
combination of
parental genes can
result in different
traits in their offspring
(for example, eye or
hair color)
I definitely
can’t
I probably
can’t
Maybe
I probably
can
I definitely
can
A
B
C
D
E
VH638870
A
B
C
D
E
VH638872
A
B
C
D
E
VH638883
A
B
C
D
E
VH638877
A
B
C
D
E
VH638878
A
B
C
D
E
VH638879
342
VH743438
36. How often do you talk about things you have learned in science class with
someone in your family?
A Never or hardly ever
B Once in a while
C Sometimes
D Often
E Very often
VH639871
37. How likely are you to pursue a career in science?
A Not at all likely
B Not likely
C Somewhat likely
D Quite likely
E Extremely likely
VH640721
38. In this school year, have you done any of the following activities to prepare for a
career in science? Select one answer choice on each row.
a. Spoken with a guidance counselor or
teacher about science-related careers
b. Spoken with a guidance counselor or
teacher about science-related college
programs
c. Shadowed a person who does
science-related work at his or her job
d. Worked as an intern or employee doing
science-related work
Yes
No
A
B
VH640754
A
B
VH640757
A
B
VH640771
A
B
VH640773
343
Appendix K-1as: Summary of Changes Operational Grade 4 NIES
344
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
345
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
346
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
347
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
Rationale
NC
N/A
NC
N/A
NC
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
348
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
349
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
350
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
Rationale
NC
N/A
NC
N/A
NC
N/A
(2015 Grade 4)
(2015 Grade 8)
(2015 Grade 4)
(2015 Grade 4)
351
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
352
2019 Operational Grade 4 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
(2015 Grade 4)
353
Appendix K-1at: Operational Grade 4 NIES
354
VH240128
1. How much do you know about your American Indian tribe or Alaska Native
group? For example, you may know about the history, traditions, or arts and crafts
of your tribe or group.
A Nothing
B A little
C Some
D A lot
VH240129
2. Who taught you most of what you know about American Indian or Alaska Native
history?
A No one has taught me about American Indian or Alaska Native history.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH240130
3. Who taught you most of what you know about American Indian or Alaska Native
traditions (ways of life, customs)?
A No one has taught me about American Indian or Alaska Native traditions.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
355
VH240131
4. Who taught you most of what you know about American Indian or Alaska Native
arts and crafts?
A No one has taught me about American Indian or Alaska Native arts and crafts.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH240132
5. How often do you go to American Indian or Alaska Native ceremonies and
gatherings?
A Never
B Every few years
C At least once a year
D Several times a year
VH240133
6. How often do members of your family talk to each other in your American Indian
or Alaska Native language?
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
356
VH240134
7. How often do people in your school talk to each other in your American Indian or
Alaska Native language?
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
VH240135
8. How often do you attend classes in school that are taught in an American Indian or
Alaska Native language?
A My school does not offer classes that are taught in an American Indian or Alaska Native
language.
B Never or hardly ever
C Once or twice a month
D Once or twice a week
E Every day or almost every day
VH240136
9. How do you rate yourself in speaking an American Indian or Alaska Native
language?
A I cannot speak an American Indian or Alaska Native language.
B I can speak a few words or phrases.
C I can speak well.
VH240137
10. How do you rate yourself in reading an American Indian or Alaska Native
language?
A I cannot read in an American Indian or Alaska Native language.
B I can read a few words or phrases.
C I can read well.
357
VH240138
11. Who taught you most of what you know about an American Indian or Alaska
Native language?
A No one has taught me about an American Indian or Alaska Native language.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH240139
12. During 4th grade, have you attended school field trips to museums, traditional
villages, or other places to learn about American Indian or Alaska Native people?
A Yes
B No
VH240140
13. During 4th grade, have you used books, videos, or other materials (including
Internet resources) about American Indian or Alaska Native people in school?
A Yes, once or twice
B Yes, three or more times
C No
VH240141
14. During 4th grade, have you used books, videos, or other materials (including
Internet resources) about American Indian or Alaska Native people
outside of school?
A Yes, once or twice
B Yes, three or more times
C No
358
VH240142
15. In school, do you have access to a library, media center, or resource center with
books, videos, or other materials (including Internet resources) about American
Indian or Alaska Native people?
A Yes
B No
VH240143
16. When my teacher talks about American Indian or Alaska Native history or culture,
I try to read more about it.
A This is not like me.
B This is a little like me.
C This is a lot like me.
VH240144
17. I enjoy reading about American Indian or Alaska Native people.
A This is not like me.
B This is a little like me.
C This is a lot like me.
VH240145
18. I enjoy reading about people who have different traditions and cultures (ways of
life, customs) than I have.
A This is not like me.
B This is a little like me.
C This is a lot like me.
359
VH240146
19. I put a lot of effort into my schoolwork.
A This is not like me.
B This is a little like me.
C This is a lot like me.
VH240147
20. I want to be one of the best students in my class.
A This is not like me.
B This is a little like me.
C This is a lot like me.
VH240148
21. I enjoy being challenged in my classes.
A This is not like me.
B This is a little like me.
C This is a lot like me.
VH240149
22. I feel that I belong at school.
A This is not like me.
B This is a little like me.
C This is a lot like me.
360
VH240150
23. If I put in enough effort, I will succeed in school.
A Strongly disagree
B Disagree
C Agree
D Strongly agree
VH240151
24. Trying hard in school will help me live a good life when I grow up.
A Strongly disagree
B Disagree
C Agree
D Strongly agree
VH240152
25. How often does a parent or someone else from your family help you with your
schoolwork? For example, they might help you to study for a test, help you with a
school project, or go over your homework with you.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
361
VH240153
26. How often does a teacher or another adult from your school help you with your
schoolwork? For example, they might help you to study for a test, help you with a
school project, or go over your homework with you.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
VH240154
27. How often does another student from your school help you with your schoolwork?
For example, they might help you to study for a test, help you with a school
project, or go over your homework with you.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
VH240155
28. How often do you help other students from your school with their schoolwork?
For example, you might help other students to study for a test, help them with a
school project, or go over their homework with them.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
362
VH240156
29. How much do you like school?
A Not at all
B A little
C Somewhat
D Very much
VH240157
30. Do you know the name of the American Indian tribe or Alaska Native group you
belong to or are enrolled in?
A Yes
B No
C I’m not sure.
VH242881
31. If you know the name of the American Indian tribe or Alaska Native group that
you belong to or are enrolled in, or if you think you know it, please print it on the
line below. Do not worry about spelling. If you belong to more than one American
Indian tribe or Alaska Native group, write the names of as many as you know.
363
VH242882
32. What else would you like to say about yourself, your school, or about American
Indian or Alaska Native people? Use these lines to write your ideas.
364
Appendix K-1au: Summary of Changes Operational Grade 8 NIES
365
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
NC
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
366
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
N/A
(2015 Grade 8)
(2015 Grade 8)
NC
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
367
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
368
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
369
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
NC
N/A
NC
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
370
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
(2015 Grade 8)
NC
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
Rationale
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line to show
whether the
sentence
describes a
person like
you." was
adapted to
“Select one
answer
choice on
each row."
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line to show
whether the
sentence
describes a
person like
you." was
adapted to
“Select one
answer
choice on
each row."
371
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
NC
N/A
NC
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
372
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
N/A
(2015 Grade 8)
(2015 Grade 8)
NC
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
373
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
R
Rationale
This item was
revised in
item type and
sentence
structure of
this item
based on the
structure for
Core
household
possession
item.
The in-line
direction was
adapted from
PBA to DBA:
"Fill in as
many ovals as
apply." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 8)
NC
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 9
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
374
2019 Operational Grade 8 National Indian Education Study (NIES) Student
Previous item
2019 item
D/A/
R/NC+
Rationale
NC
“Select one
answer
choice on
each row."
N/A
NC
N/A
NC
N/A
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
(2015 Grade 8)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 10
375
Appendix K-1av: Operational Grade 8 NIES
376
VH241514
1. How much do you know about each of the following? Select one answer choice on
each row.
a. Your American Indian or
Alaska Native history
b. Your American Indian or
Alaska Native traditions
and culture (way of life,
customs)
c. Issues today that are
important to American
Indian or Alaska Native
people
Nothing
A little
Some
A lot
A
B
C
D
VH241515
A
B
C
D
VH241517
A
B
C
D
VH241516
VH240129
2. Who taught you most of what you know about American Indian or Alaska Native
history?
A No one has taught me about American Indian or Alaska Native history.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH240130
3. Who taught you most of what you know about American Indian or Alaska Native
traditions (ways of life, customs)?
A No one has taught me about American Indian or Alaska Native traditions.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
377
VH240158
4. Who taught you most of what you know about issues today that are important to
American Indian or Alaska Native people?
A No one has taught me about issues today that are important to American Indian or Alaska
Native people.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH241518
5. How often have you participated in each of the following? Select one answer choice on
each row.
a. Ceremonies and gatherings
for people from your
American Indian tribe or
Alaska Native group
b. Ceremonies and gatherings
that bring people together
from many different
American Indian tribes or
Alaska Native groups
c. Other American Indian or
Alaska Native activities
Never
Every few
years
At least once a Several times
year
a year
A
B
C
D
VH241519
A
B
C
D
VH241521
A
B
C
D
VH241520
VH240133
6. How often do members of your family talk to each other in your American Indian
or Alaska Native language?
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
378
VH240134
7. How often do people in your school talk to each other in your American Indian or
Alaska Native language?
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
VH240135
8. How often do you attend classes in school that are taught in an American Indian or
Alaska Native language?
A My school does not offer classes that are taught in an American Indian or Alaska Native
language.
B Never or hardly ever
C Once or twice a month
D Once or twice a week
E Every day or almost every day
VH240136
9. How do you rate yourself in speaking an American Indian or Alaska Native
language?
A I cannot speak an American Indian or Alaska Native language.
B I can speak a few words or phrases.
C I can speak well.
VH240137
10. How do you rate yourself in reading an American Indian or Alaska Native
language?
A I cannot read in an American Indian or Alaska Native language.
B I can read a few words or phrases.
C I can read well.
379
VH240138
11. Who taught you most of what you know about an American Indian or Alaska
Native language?
A No one has taught me about an American Indian or Alaska Native language.
B Family members
C Friends
D Teachers
E Tribal representatives or elders
F Someone else (please specify):
VH240159
12. During 8th grade, how often have any of your teachers talked to your class about
the history, traditions, and cultures (ways of life, customs) of American Indian or
Alaska Native people?
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
380
VH241522
13. During 8th grade, have you attended any of the following activities organized by
your school? Select one answer choice on each row.
a. Presentations by American Indian or
Alaska Native people about their traditions
and cultures (ways of life, customs)
b. American Indian or Alaska Native art and
craft demonstrations
c. Traditional American Indian or Alaska
Native music and/or dance performances
d. Field trips to museums, traditional villages,
or other places to learn about American
Indian or Alaska Native people
Yes
No
A
B
VH241523
A
B
VH241526
A
B
VH241525
A
B
VH241524
VH241527
14. During 8th grade, have you participated in any of the following activities organized
by your school? Select one answer choice on each row.
a. Sports team
b. Music club, orchestra, or band
c. Cultural dances or other American Indian
or Alaska Native activities (for example,
drum groups)
d. Academic club (for example, math club)
Yes
No
A
B
VH241528
A
B
VH241532
A
B
VH241531
A
B
VH241530
VH240160
15. During 8th grade, have you used books, videos, or other materials (including
Internet resources) about American Indian or Alaska Native people in school?
A Yes, once or twice
B Yes, three or more times
C No
381
VH240161
16. During 8th grade, have you used books, videos, or other materials (including
Internet resources) about American Indian or Alaska Native people
outside of school?
A Yes, once or twice
B Yes, three or more times
C No
VH240142
17. In school, do you have access to a library, media center, or resource center with
books, videos, or other materials (including Internet resources) about American
Indian or Alaska Native people?
A Yes
B No
18. Here are some sentences about reading. Fill in one oval on each line to show whether the
sentence describes a person like you.
a. When my teacher talks about
American Indian or Alaska
Native history or culture, I try to
read more about it.
b. I enjoy reading about American
Indian or Alaska Native people.
c. I enjoy reading about people who
have different traditions and
cultures (ways of life, customs)
than I have.
VH241533
This is not like
me.
This is a little
like me.
This is a lot like
me.
A
B
C
VH241536
A
B
C
VH241538
A
B
C
VH241537
382
VH241539
19. Here are some sentences about your school. Fill in one oval on each line to show whether the
sentence describes a person like you.
This is not like
me.
This is a little
like me.
This is a lot like
me.
A
B
C
VH241540
A
B
C
VH241543
A
B
C
VH241542
A
B
C
VH241541
a. I put a lot of effort into my
schoolwork.
b. I want to be one of the best
students in my class.
c. I enjoy being challenged in my
classes.
d. I feel that I belong at school.
VH241544
20. How much do you agree with each of the following statements? Select one answer
choice on each row.
Strongly
disagree
Disagree
Agree
Strongly agree
A
B
C
D
VH241545
A
B
C
D
VH241547
A
B
C
D
VH241546
a. If I put in enough effort, I
will succeed in school.
b. If I put in enough effort in
school, I will get into
college.
c. If I put in enough effort in
school, I will get a good
job.
VH240156
21. How much do you like school?
A Not at all
B A little
C Somewhat
D Very much
383
VH240162
22. How much are the things you are learning in school preparing you for the life you
want to lead?
A Not at all
B A little
C A fair amount
D Very much
VH240163
23. During 8th grade, how often have you talked with any of your teachers outside of
regular class periods? For example, to get extra help with your assignments, to talk
about issues that matter to you, or just to visit.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
VH240155
24. How often do you help other students from your school with their schoolwork?
For example, you might help other students to study for a test, help them with a
school project, or go over their homework with them.
A Never or hardly ever
B Once or twice a month
C Once or twice a week
D Every day or almost every day
384
VH241548
25. How often do any of the following people help you with your schoolwork? For
example, they might help you to study for a test, help you with a school project, or
go over your homework with you. Select one answer choice on each row.
Never or
hardly ever
a. A parent or someone else
from my family
b. A teacher or another adult
from my school
c. Another student
d. A tribal representative or
elder
Once or twice Once or twice
a month
a week
Every day or
almost every
day
A
B
C
D
VH241549
A
B
C
D
VH241550
A
B
C
D
VH241553
A
B
C
D
VH241551
VH241554
26. During 8th grade, how many times have you talked to each of the following people
about the classes you should take in high school or about what you want to do after
high school? Select one answer choice on each row.
a.
b.
c.
d.
e.
A family member
A teacher
A school counselor
Another student
A tribal representative or
elder
f. Someone else who lives in
my community or is a
friend of my family
Never
One time
Two or three
times
Four or more
times
A
B
C
D
VH241555
A
B
C
D
VH241556
A
B
C
D
VH241557
A
B
C
D
VH241561
A
B
C
D
VH241560
A
B
C
D
VH241558
385
VH241562
27. Do you plan to do any of the following in your first year after high school? Select one
answer choice on each row.
a. Go to college full time
b. Go to college part time
c. Go to another school (for example, career
training, technical, or trade/vocational) full
time
d. Go to another school (for example, career
training, technical, or trade/vocational) part
time
e. Join the military
f. Work full time
g. Work part time
h. Travel
i. Care for family
j. I don’t know.
Yes
No
A
B
VH241563
A
B
VH241564
A
B
VH241565
A
B
VH241566
A
B
VH241572
A
B
VH241568
A
B
VH241569
A
B
VH241570
A
B
VH241571
A
B
VH241567
386
VH241573
28. To what extent is each of the following a problem in your school? Select one answer
choice on each row.
a. Student tardiness
b. Student health problems
c. Student misbehavior in
class
d. Physical conflicts among
students
e. Bullying
f. Low student motivation
Not at all
Small extent
Moderate
extent
Large extent
A
B
C
D
VH241574
A
B
C
D
VH241575
A
B
C
D
VH241576
A
B
C
D
VH241580
A
B
C
D
VH241578
A
B
C
D
VH241579
VH240157
29. Do you know the name of the American Indian tribe or Alaska Native group you
belong to or are enrolled in?
A Yes
B No
C I’m not sure.
387
VH242881
30. If you know the name of the American Indian tribe or Alaska Native group that
you belong to or are enrolled in, or if you think you know it, please print it on the
line below. Do not worry about spelling. If you belong to more than one American
Indian tribe or Alaska Native group, write the names of as many as you know.
VH242882
31. What else would you like to say about yourself, your school, or about American
Indian or Alaska Native people? Use these lines to write your ideas.
388
Appendix K-1aw: Summary of Changes Operational Grade 4 CAFS
389
2019 Operational Grade 4 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
390
2019 Operational Grade 4 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
391
2019 Operational Grade 4 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 4 )
(2017 Grade 4)
(2017 Grade 4)
392
2019 Operational Grade 4 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
393
2019 Operational Grade 4 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 4)
(2017 Grade 4)
(2017 Grade 4)
394
Appendix K-1ax: Operational Grade 4 CAFS
395
VH270138
1. At home, do you have any of the following? Select one answer choice on each row.
Yes
No
A
B
VH270141
A
B
VH270142
A
B
VH270139
A
B
VH270140
A
B
VH270143
A
B
VH270144
a. A laptop or desktop computer that is only
for your use
b. A laptop or desktop computer that is
shared between you and others
c. A tablet that is only for your use
d. A tablet that is shared between you and
others
e. Wi-Fi or some other Internet connection
you can use
f. A smartphone that is only for your use
VH270100
2. When did you first use a laptop or desktop computer?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth grade
VH270092
3. When did you first use a tablet?
A Never until this assessment
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth grade
396
VH270101
4. When did you first use a smartphone?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth grade
VH270147
5. On a weekday, about how many hours do you use a laptop or desktop computer for
doing schoolwork, including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
VH270148
6. On a weekday, about how many hours do you use a tablet for doing schoolwork,
including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
397
VH597657
7. Were you taught any of the following at school? Select one answer choice on each row.
a. How to type on a computer keyboard using
the correct fingers
b. How to write sentences and paragraphs
using a computer
c. How to edit text using a computer
d. How to search for information on the
Internet
e. How to use a tablet
f. How to look up the meaning of a word
using a computer
Yes
No
A
B
VH270150
A
B
VH270151
A
B
VH270164
A
B
VH270152
A
B
VH270156
A
B
VH270157
VH270165
8. Which of the following are true about the ways in which you and your teachers use computers at
school? Select one answer choice on each row.
a. In most of my classes there are laptop or
desktop computers that I can use for
schoolwork.
b. In most of my classes there are tablets that
I can use for schoolwork.
c. There is Wi-Fi or some other Internet
connection that I can use for schoolwork.
d. Most of my teachers use computers when
teaching my classes.
e. Most of my teachers require us to use
computers in the classroom.
Yes
No
A
B
VH270166
A
B
VH270167
A
B
VH270170
A
B
VH270169
A
B
VH270168
VH270116
9. Has your school assigned you a laptop or desktop computer that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me (laptop only).
398
VH270117
10. Has your school assigned you a tablet that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me.
11. This school year, how often have you used a laptop or desktop computer to do each of the
following? Select one answer choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
every
A few times Once
few weeks
VH597710
About once More than
a week
once a week
A
B
C
D
E
VH270172
A
B
C
D
E
VH270173
A
B
C
D
E
VH270174
A
B
C
D
E
VH270181
A
B
C
D
E
VH270177
A
B
C
D
E
VH270175
399
VH597752
12. This school year, how often have you used a tablet to do each of the following? Select one answer
choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
every
A few times Once
few weeks
About once More than
a week
once a week
A
B
C
D
E
VH270183
A
B
C
D
E
VH270188
A
B
C
D
E
VH270184
A
B
C
D
E
VH270185
A
B
C
D
E
VH270186
A
B
C
D
E
VH270192
VH270130
13. Which best describes the way you type on a computer keyboard?
A I don’t know how to type using a computer keyboard.
B I can type with one or two fingers, but I have to search for where the letter keys are.
C I can type with one or two fingers, and I know where most of the letter keys are.
D I can type with all ten fingers when I look at the keyboard.
E I can type with all ten fingers without looking at the keyboard.
VH270132
14. Would you rather take a test at school using paper and pencil or using a computer?
A Paper and pencil
B Computer
400
VH597769
15. Do you think you would be able to do each of the following? Select one answer choice on each
row.
a. Write sentences and
paragraphs using a
computer
b. Edit text using a computer
c. Use a touchscreen on a
computer, tablet, or
smartphone
d. Look up the meaning of a
word using a computer
e. Draw a picture using a
computer
I definitely
can’t.
I probably
can’t.
I probably can.
I definitely
can.
A
B
C
D
VH270229
A
B
C
D
VH270218
A
B
C
D
VH270230
A
B
C
D
VH270225
A
B
C
D
VH270226
401
VH597794
16. How familiar are you with each of the following? Select one answer choice on each row.
Never heard of
Heard of it
it
once or twice
a.
b.
c.
d.
e.
f.
g.
h.
i.
j.
k.
Wi-Fi
Firewall
Neuro-digital computing
Instant messaging
Cut and paste
Pyramidal browser
Spreadsheet
Limbic wire
Spinalbyte
Server
Callosum board
Heard of it
often
Know it well,
understand
the concept
A
B
C
D
VH270196
A
B
C
D
VH270197
A
B
C
D
VH270199
A
B
C
D
VH270200
A
B
C
D
VH270203
A
B
C
D
VH270204
A
B
C
D
VH270206
A
B
C
D
VH270207
A
B
C
D
VH270208
A
B
C
D
VH270210
A
B
C
D
VH270214
402
Appendix K-1ay: Summary of Changes Operational Grade 8 CAFS
403
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
404
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
405
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
406
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
N/A
(2017 Grade 8)
407
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
(2017 Grade 8)
408
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
N/A
(2017 Grade 8)
409
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
410
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
411
2019 Operational Grade 8 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2017 Grade 8)
(2017 Grade 8)
412
Appendix K-1az: Operational Grade 8 CAFS
413
VH270138
1. At home, do you have any of the following? Select one answer choice on each row.
Yes
No
A
B
VH270141
A
B
VH270142
A
B
VH270139
A
B
VH270140
A
B
VH270143
A
B
VH270144
a. A laptop or desktop computer that is only
for your use
b. A laptop or desktop computer that is
shared between you and others
c. A tablet that is only for your use
d. A tablet that is shared between you and
others
e. Wi-Fi or some other Internet connection
you can use
f. A smartphone that is only for your use
VH270145
2. When did you first use a laptop or desktop computer?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
VH270090
3. When did you first use a tablet?
A Never until this assessment
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
414
VH270146
4. When did you first use a smartphone?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
VH270147
5. On a weekday, about how many hours do you use a laptop or desktop computer for
doing schoolwork, including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
VH270148
6. On a weekday, about how many hours do you use a tablet for doing schoolwork,
including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
415
VH270149
7. Were you taught any of the following at school? Select one answer choice on each row.
a. How to type on a computer keyboard using
the correct fingers
b. How to write sentences and paragraphs
using a computer
c. How to edit text using a computer
d. How to search for information on the
Internet
e. How to use a tablet
f. How to look up the meaning of a word
using a computer
g. How to create a spreadsheet using a
computer
h. How to create a presentation using a
computer
i. How to run simulations using a computer
j. How to write a computer program or app
k. How to create a graph or chart using a
computer
l. How to troubleshoot problems with a
computer
Yes
No
A
B
VH270150
A
B
VH270151
A
B
VH270164
A
B
VH270152
A
B
VH270156
A
B
VH270157
A
B
VH270154
A
B
VH270155
A
B
VH270159
A
B
VH270160
A
B
VH270161
A
B
VH270158
416
VH270165
8. Which of the following are true about the ways in which you and your teachers use computers at
school? Select one answer choice on each row.
a. In most of my classes there are laptop or
desktop computers that I can use for
schoolwork.
b. In most of my classes there are tablets that
I can use for schoolwork.
c. There is Wi-Fi or some other Internet
connection that I can use for schoolwork.
d. Most of my teachers use computers when
teaching my classes.
e. Most of my teachers require us to use
computers in the classroom.
Yes
No
A
B
VH270166
A
B
VH270167
A
B
VH270170
A
B
VH270169
A
B
VH270168
VH270116
9. Has your school assigned you a laptop or desktop computer that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me (laptop only).
VH270117
10. Has your school assigned you a tablet that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me.
417
11. This school year, how often have you used a laptop or desktop computer to do each of the
following? Select one answer choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
g. Create a map
h. Work on a website or
blog that you maintain
i. Create a multimedia
presentation on your
own
j. Work collaboratively
with a team of
students to create a
multimedia
presentation
every
A few times Once
few weeks
VH270171
About once More than
a week
once a week
A
B
C
D
E
VH270172
A
B
C
D
E
VH270173
A
B
C
D
E
VH270174
A
B
C
D
E
VH270181
A
B
C
D
E
VH270177
A
B
C
D
E
VH270175
A
B
C
D
E
VH270178
A
B
C
D
E
VH270179
A
B
C
D
E
VH270180
A
B
C
D
E
VH270176
418
VH270182
12. This school year, how often have you used a tablet to do each of the following? Select one answer
choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
g. Create a map
h. Work on a website or
blog that you maintain
i. Create a multimedia
presentation on your
own
j. Work collaboratively
with a team of
students to create a
multimedia
presentation
every
A few times Once
few weeks
About once More than
a week
once a week
A
B
C
D
E
VH270183
A
B
C
D
E
VH270188
A
B
C
D
E
VH270184
A
B
C
D
E
VH270185
A
B
C
D
E
VH270186
A
B
C
D
E
VH270192
A
B
C
D
E
VH270189
A
B
C
D
E
VH270190
A
B
C
D
E
VH270191
A
B
C
D
E
VH270187
VH270130
13. Which best describes the way you type on a computer keyboard?
A I don’t know how to type using a computer keyboard.
B I can type with one or two fingers, but I have to search for where the letter keys are.
C I can type with one or two fingers, and I know where most of the letter keys are.
D I can type with all ten fingers when I look at the keyboard.
E I can type with all ten fingers without looking at the keyboard.
419
VH270132
14. Would you rather take a test at school using paper and pencil or using a computer?
A Paper and pencil
B Computer
420
VH270215
15.. Do you think you would be able to do each of the following? Select one answer choice on each
row.
a. Write sentences and
paragraphs using a
computer
b. Edit text using a computer
c. Use a touchscreen on a
computer, tablet, or
smartphone
d. Look up the meaning of a
word using a computer
e. Draw a picture using a
computer
f. View or download digital
media
g. Create a presentation using
a computer
h. Create a spreadsheet using
a computer
i. Install new software or
apps
j. Participate in online
discussions, forums, social
networking sites, or virtual
communities
k. Maintain a website or blog
l. Search for information on
the Internet
m. Run simulations using a
computer
n. Create a graph or chart
using a computer
o. Write a computer program
or app
p. Troubleshoot a problem
with a computer
q. Figure out how to use new
functions of a digital device
that I am not yet familiar
with
I definitely
can’t.
I probably
can’t.
I probably can.
I definitely
can.
A
B
C
D
VH270229
A
B
C
D
VH270218
A
B
C
D
VH270230
A
B
C
D
VH270225
A
B
C
D
VH270226
A
B
C
D
VH270216
A
B
C
D
VH270228
A
B
C
D
VH270231
A
B
C
D
VH270219
A
B
C
D
VH270220
A
B
C
D
VH270221
A
B
C
D
VH270222
A
B
C
D
VH270223
A
B
C
D
VH270224
A
B
C
D
VH270227
A
B
C
D
VH270232
A
B
C
D
VH270217
421
VH270233
16. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices are you?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
422
VH270236
17. Please read the descriptions of the following four eighth-grade students. After you
read each description, you will be asked to answer a question about each student
based on the information provided.
Linda often uses apps to talk to her friends or to play games. She does some of her
homework on her laptop and knows how to write and create tables using a
computer. Linda cannot type with 10 fingers but is pretty fast with two fingers and
mostly finds the right keys.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Linda is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
423
VH270237
18. Tom often uses apps to talk to his friends or to play games. He does most of his
homework on a computer and knows how to write and edit papers on a computer
and how to create complex tables or charts. He also created a few presentations
using a computer. Tom can type pretty accurately using ten fingers when looking
at the computer keyboard.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Tom is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
424
VH270238
19. Susan often uses apps on a smartphone or tablet and does most of her homework
on a laptop. She is good at writing and editing papers on her computer and has
experience with creating complex tables and charts. Susan can type fast and
accurately with 10 fingers without looking at the computer keyboard. She also
knows a couple of programming languages. This school year, she built her first
app.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Susan is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
425
VH270239
20. Kevin sometimes plays games on his smartphone or a computer, but he usually
does not use a computer for his homework. He used a computer a couple of times
to write a paper but never used a computer to create tables, charts, or
presentations. Kevin can type with one or two fingers but has to search to find the
correct keys on the computer keyboard.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Kevin is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
426
VH270194
21. How familiar are you with each of the following? Select one answer choice on each row.
Never heard of
Heard of it
it
once or twice
a. E-reader
b. Wi-Fi
c. Firewall
d. Hyperlink
e. Neuro-digital computing
f. Instant messaging
g. CPU
h. Cut and paste
i. Pyramidal browser
j. Spreadsheet
k. Limbic wire
l. Spinalbyte
m. Cloud computing
n. Server
o. Compiler
p. Callosum board
Heard of it
often
Know it well,
understand
the concept
A
B
C
D
VH270195
A
B
C
D
VH270196
A
B
C
D
VH270197
A
B
C
D
VH270198
A
B
C
D
VH270199
A
B
C
D
VH270200
A
B
C
D
VH270201
A
B
C
D
VH270203
A
B
C
D
VH270204
A
B
C
D
VH270206
A
B
C
D
VH270207
A
B
C
D
VH270208
A
B
C
D
VH270209
A
B
C
D
VH270210
A
B
C
D
VH270212
A
B
C
D
VH270214
427
Appendix K-1ba: Summary of Changes Operational Grade 12
CAFS
428
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
D
N/A
(2015 Grade 12)
NC
Rationale
This item was
dropped
because it
was not
correlated
with
achievement,
and was not
conceptually
central to the
study.
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 1
429
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
R
For DBA
response
option “A” is
adapted to
“Never until
this
assessment”
to account for
the fact that
students are
taking the
eNAEP
assessment
on the tablet.
N/A
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 2
430
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 3
431
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
N/A
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 4
432
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
R
Rationale
Previous subitems “f”,
“m”, “n” were
dropped.
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 5
433
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
NC
N/A
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 6
434
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 7
435
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 8
436
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
D
N/A
(2015 Grade 12)
NC
Rationale
This item was
dropped
because it
was not
correlated
with
achievement,
and was not
conceptually
central to the
study.
N/A
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 9
437
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 10
438
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 11
439
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
N/A
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 12
440
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
NC
Rationale
NC
N/A
N/A
(2015 Grade 12)
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 13
441
2019 Operational Grade 12 Computer and Familiarity Study (CAFS) Student
Previous item
2019 item
D/A/
R/NC+
R
Rationale
Previous subitems “h”,
“k”, “q”, “s”
were
dropped.
The in-line
direction was
adapted from
PBA to DBA:
"Fill in one
oval on each
line." was
adapted to
“Select one
answer
choice on
each row."
(2015 Grade 12)
+ This column indicates whether the item was dropped (D), added (A), revised (R), or there was no change (NC).
Page 14
442
Appendix K-1bb: Operational Grade 12 CAFS
443
VH270138
1. At home, do you have any of the following? Select one answer choice on each row.
Yes
No
A
B
VH270141
A
B
VH270142
A
B
VH270139
A
B
VH270140
A
B
VH270143
A
B
VH270144
a. A laptop or desktop computer that is only
for your use
b. A laptop or desktop computer that is
shared between you and others
c. A tablet that is only for your use
d. A tablet that is shared between you and
others
e. Wi-Fi or some other Internet connection
you can use
f. A smartphone that is only for your use
VH270234
2. When did you first use a laptop or desktop computer?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
G When I was in high school
VH270089
3. When did you first use a tablet?
A Never until this assessment
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
G When I was in high school
444
VH270235
4. When did you first use a smartphone?
A I have never used one.
B Before I was in kindergarten
C When I was in kindergarten
D When I was in first, second, or third grade
E When I was in fourth or fifth grade
F When I was in sixth, seventh, or eighth grade
G When I was in high school
VH270147
5. On a weekday, about how many hours do you use a laptop or desktop computer for
doing schoolwork, including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
VH270148
6. On a weekday, about how many hours do you use a tablet for doing schoolwork,
including homework?
A None
B Less than an hour
C 1 to 2 hours
D 2 to 3 hours
E 3 to 4 hours
F More than 4 hours
445
VH270149
7. Were you taught any of the following at school? Select one answer choice on each row.
a. How to type on a computer keyboard using
the correct fingers
b. How to write sentences and paragraphs
using a computer
c. How to edit text using a computer
d. How to search for information on the
Internet
e. How to use a tablet
f. How to look up the meaning of a word
using a computer
g. How to create a spreadsheet using a
computer
h. How to create a presentation using a
computer
i. How to run simulations using a computer
j. How to write a computer program or app
k. How to create a graph or chart using a
computer
l. How to troubleshoot problems with a
computer
Yes
No
A
B
VH270150
A
B
VH270151
A
B
VH270164
A
B
VH270152
A
B
VH270156
A
B
VH270157
A
B
VH270154
A
B
VH270155
A
B
VH270159
A
B
VH270160
A
B
VH270161
A
B
VH270158
446
VH270165
8. Which of the following are true about the ways in which you and your teachers use computers at
school? Select one answer choice on each row.
a. In most of my classes there are laptop or
desktop computers that I can use for
schoolwork.
b. In most of my classes there are tablets that
I can use for schoolwork.
c. There is Wi-Fi or some other Internet
connection that I can use for schoolwork.
d. Most of my teachers use computers when
teaching my classes.
e. Most of my teachers require us to use
computers in the classroom.
Yes
No
A
B
VH270166
A
B
VH270167
A
B
VH270170
A
B
VH270169
A
B
VH270168
VH270116
9. Has your school assigned you a laptop or desktop computer that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me (laptop only).
VH270117
10. Has your school assigned you a tablet that only you can use?
A No
B Yes, but I cannot take it home with me.
C Yes, and I can take it home with me.
447
11. This school year, how often have you used a laptop or desktop computer to do each of the
following? Select one answer choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
g. Create a map
h. Work on a website or
blog that you maintain
i. Create a multimedia
presentation on your
own
j. Work collaboratively
with a team of
students to create a
multimedia
presentation
every
A few times Once
few weeks
VH270171
About once More than
a week
once a week
A
B
C
D
E
VH270172
A
B
C
D
E
VH270173
A
B
C
D
E
VH270174
A
B
C
D
E
VH270181
A
B
C
D
E
VH270177
A
B
C
D
E
VH270175
A
B
C
D
E
VH270178
A
B
C
D
E
VH270179
A
B
C
D
E
VH270180
A
B
C
D
E
VH270176
448
VH270182
12. This school year, how often have you used a tablet to do each of the following? Select one answer
choice on each row.
Never
a. Write a short paper
(less than a page) for
school
b. Write a paper for
school that was longer
than a page
c. Search the Internet for
a school project
d. Practice things in
mathematics that you
were having trouble
learning
e. Practice things in
reading that you were
having trouble
learning
f. Take a test
g. Create a map
h. Work on a website or
blog that you maintain
i. Create a multimedia
presentation on your
own
j. Work collaboratively
with a team of
students to create a
multimedia
presentation
every
A few times Once
few weeks
About once More than
a week
once a week
A
B
C
D
E
VH270183
A
B
C
D
E
VH270188
A
B
C
D
E
VH270184
A
B
C
D
E
VH270185
A
B
C
D
E
VH270186
A
B
C
D
E
VH270192
A
B
C
D
E
VH270189
A
B
C
D
E
VH270190
A
B
C
D
E
VH270191
A
B
C
D
E
VH270187
449
VH270130
13. Which best describes the way you type on a computer keyboard?
A I don’t know how to type using a computer keyboard.
B I can type with one or two fingers, but I have to search for where the letter keys are.
C I can type with one or two fingers, and I know where most of the letter keys are.
D I can type with all ten fingers when I look at the keyboard.
E I can type with all ten fingers without looking at the keyboard.
VH270132
14. Would you rather take a test at school using paper and pencil or using a computer?
A Paper and pencil
B Computer
450
VH270215
15. Do you think you would be able to do each of the following? Select one answer choice on each
row.
a. Write sentences and
paragraphs using a
computer
b. Edit text using a computer
c. Use a touchscreen on a
computer, tablet, or
smartphone
d. Look up the meaning of a
word using a computer
e. Draw a picture using a
computer
f. View or download digital
media
g. Create a presentation using
a computer
h. Create a spreadsheet using
a computer
i. Install new software or
apps
j. Participate in online
discussions, forums, social
networking sites, or virtual
communities
k. Maintain a website or blog
l. Search for information on
the Internet
m. Run simulations using a
computer
n. Create a graph or chart
using a computer
o. Write a computer program
or app
p. Troubleshoot a problem
with a computer
q. Figure out how to use new
functions of a digital device
that I am not yet familiar
with
I definitely
can’t.
I probably
can’t.
I probably can.
I definitely
can.
A
B
C
D
VH270229
A
B
C
D
VH270218
A
B
C
D
VH270230
A
B
C
D
VH270225
A
B
C
D
VH270226
A
B
C
D
VH270216
A
B
C
D
VH270228
A
B
C
D
VH270231
A
B
C
D
VH270219
A
B
C
D
VH270220
A
B
C
D
VH270221
A
B
C
D
VH270222
A
B
C
D
VH270223
A
B
C
D
VH270224
A
B
C
D
VH270227
A
B
C
D
VH270232
A
B
C
D
VH270217
451
VH270233
16. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices are you?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
452
VH270240
17. Please read the descriptions of the following four twelfth-grade students. After you
read each description, you will be asked to answer a question about each student
based on the information provided.
Linda often uses apps to talk to her friends or to play games. She does some of her
homework on her laptop and knows how to write and create tables using a
computer. Linda cannot type with 10 fingers but is pretty fast with two fingers and
mostly finds the right keys.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Linda is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
453
VH270237
18. Tom often uses apps to talk to his friends or to play games. He does most of his
homework on a computer and knows how to write and edit papers on a computer
and how to create complex tables or charts. He also created a few presentations
using a computer. Tom can type pretty accurately using ten fingers when looking
at the computer keyboard.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Tom is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
454
VH270238
19. Susan often uses apps on a smartphone or tablet and does most of her homework
on a laptop. She is good at writing and editing papers on her computer and has
experience with creating complex tables and charts. Susan can type fast and
accurately with 10 fingers without looking at the computer keyboard. She also
knows a couple of programming languages. This school year, she built her first
app.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Susan is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
455
VH270239
20. Kevin sometimes plays games on his smartphone or a computer, but he usually
does not use a computer for his homework. He used a computer a couple of times
to write a paper but never used a computer to create tables, charts, or
presentations. Kevin can type with one or two fingers but has to search to find the
correct keys on the computer keyboard.
On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how
familiar with using computers and other digital devices do you think Kevin is?
A 0
B 1
C 2
D 3
E 4
F 5
G 6
H 7
I 8
J 9
K 10
456
VH270194
21. How familiar are you with each of the following? Select one answer choice on each row.
Never heard of
Heard of it
it
once or twice
a. E-reader
b. Wi-Fi
c. Firewall
d. Hyperlink
e. Neuro-digital computing
f. Instant messaging
g. CPU
h. Cut and paste
i. Pyramidal browser
j. Spreadsheet
k. Limbic wire
l. Spinalbyte
m. Cloud computing
n. Server
o. Compiler
p. Callosum board
Heard of it
often
Know it well,
understand
the concept
A
B
C
D
VH270195
A
B
C
D
VH270196
A
B
C
D
VH270197
A
B
C
D
VH270198
A
B
C
D
VH270199
A
B
C
D
VH270200
A
B
C
D
VH270201
A
B
C
D
VH270203
A
B
C
D
VH270204
A
B
C
D
VH270206
A
B
C
D
VH270207
A
B
C
D
VH270208
A
B
C
D
VH270209
A
B
C
D
VH270210
A
B
C
D
VH270212
A
B
C
D
VH270214
457
Appendix K-1bc: Summary of Changes Operational Grade 4 ESQ
458
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
459
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
A
Issue: Socioeconomic Status
460
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
461
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
462
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
463
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include:
mother, second
mother, stepmother,
foster mother,
grandmother or
female relative , the
female adult taking
care of you, father,
second father,
stepfather, foster
father, grandfather or
male relative, the male
adult taking care of
you
464
2019 Operational Grade 4 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include: your
mother, your second
mother, your
stepmother, your
foster mother, your
grandmother or
female relative , the
female adult taking
care of you, your
father, your second
father, your
stepfather, your foster
father, your
grandfather or male
relative, the male adult
taking care of you
465
Appendix K-1bd: Operational Grade 4 ESQ
466
VH863709
1. In the last month, how many different homes have you been living in? (If you have
moved in the last month, do not count the home where you used to live.)
A Zero homes
B One home
C Two homes
D Three or more homes
VH894192
2. Think about all the people who live with you in your home. Not including you,
how many children 17 years or younger live with you?
A 0
B 1
C 2
D More than 2
VH894196
3. How many adults 18 years and older live with you?
A 1
B 2
C More than 2
VH894198
4. You said you live in more than one home. Think about all the people who live
with you in one of these homes (you can tell us about up to two homes). We will
call it Home #1. Not including you, how many children 17 years or younger live
with you in Home #1?
A 0
B 1
C 2
D More than 2
467
VH894202
5. How many adults 18 years and older live with you in Home #1?
A 1
B 2
C More than 2
VH894204
6. You have told us about the people in one of your homes. Now think about all the
people who live with you in your other home. We will call it Home #2. Not
including you, how many children 17 years or younger live with you in Home #2?
A 0
B 1
C 2
D More than 2
VH894209
7. How many adults 18 years and older live with you in Home #2?
A 1
B 2
C More than 2
VH863933
8. Now think about all of the adults in all of your homes. How many of the adults
that live with you are taking care of you?
A 1
B 2
C 3
D 4
E More than 4
468
VH863771
9. You said one adult is taking care of you. Who is this adult?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
VH863781
10. You said more than one adult is taking care of you. Think about the first adult (you
can tell us about up to four adults). We will call them Adult #1. Who is Adult #1?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
469
VH863784
11. Think about the second adult taking care of you. We will call them Adult #2. Who
is Adult #2?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
470
VH863791
12. Think about the third adult taking care of you. We will call them Adult #3. Who is
Adult #3?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
471
VH863795
13. Think about the fourth adult taking care of you. We will call them Adult #4. Who
is Adult #4?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
VH863863
14. In the last month, has your mother worked for pay?
A Yes
B No
C I don’t know.
VH863875
15. In the last month, has your second mother worked for pay?
A Yes
B No
C I don’t know.
472
VH863867
16. In the last month, has your stepmother worked for pay?
A Yes
B No
C I don’t know.
VH863871
17. In the last month, has your foster mother worked for pay?
A Yes
B No
C I don’t know.
VH863873
18. In the last month, has your grandmother or female relative worked for pay?
A Yes
B No
C I don’t know.
VH863877
19. In the last month, has the female adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
473
VH863882
20. In the last month, has your father worked for pay?
A Yes
B No
C I don’t know.
VH863898
21. In the last month, has your second father worked for pay?
A Yes
B No
C I don’t know
VH863885
22. In the last month, has your stepfather worked for pay?
A Yes
B No
C I don’t know.
VH863890
23. In the last month, has your foster father worked for pay?
A Yes
B No
C I don’t know.
474
VH863894
24. In the last month, has your grandfather or male relative worked for pay?
A Yes
B No
C I don’t know
VH863899
25. In the last month, has the male adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
VH863907
26. In the last month, did your mother work at one job, or did this adult work at two
or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863916
27. In the last month, did your second mother work at one job, or did this adult work
at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
475
VH863909
28. In the last month, did your stepmother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863911
29. In the last month, did your foster mother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863913
30. In the last month, did your grandmother or female relative work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863918
31. In the last month, did the female adult taking care of you work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
476
VH863919
32. In the last month, did your father work at one job, or did this adult work at two or
more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863929
33. In the last month, did your second father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863920
34. In the last month, did your stepfather work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863924
35. In the last month, did your foster father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
477
VH863927
36. In the last month, did your grandfather or male relative work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863930
37. In the last month, did the male adult taking care of you work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
478
Appendix K-1be: Summary of Changes Operational Grade 8 ESQ
479
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
A
Issue: Socioeconomic Status
480
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
A
Issue: Socioeconomic Status
481
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
482
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
483
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
484
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include: your
mother / your second
mother / your
stepmother / your
foster mother / your
grandmother or
female relative / the
female adult taking
care of you / your
father / your second
father / your
stepfather / your
foster father / your
grandfather or male
relative / the male
adult taking care of
you
485
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include:
mother, second
mother, stepmother,
foster mother,
grandmother or
female relative , the
female adult taking
care of you, father,
second father,
stepfather, foster
father, grandfather or
male relative, the male
adult taking care of
you
486
2019 Operational Grade 8 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include: your
mother, your second
mother, your
stepmother, your
foster mother, your
grandmother or
female relative , the
female adult taking
care of you, your
father, your second
father, your
stepfather, your foster
father, your
grandfather or male
relative, the male adult
taking care of you
487
Appendix K-1bf: Operational Grade 8 ESQ
488
VH863709
1. In the last month, how many different homes have you been living in? (If you have
moved in the last month, do not count the home where you used to live.)
A Zero homes
B One home
C Two homes
D Three or more homes
VH894192
2. Think about all the people who live with you in your home. Not including you,
how many children 17 years or younger live with you?
A 0
B 1
C 2
D More than 2
VH894196
3. How many adults 18 years and older live with you?
A 1
B 2
C More than 2
VH894198
4. You said you live in more than one home. Think about all the people who live
with you in one of these homes (you can tell us about up to two homes). We will
call it Home #1. Not including you, how many children 17 years or younger live
with you in Home #1?
A 0
B 1
C 2
D More than 2
489
VH894202
5. How many adults 18 years and older live with you in Home #1?
A 1
B 2
C More than 2
VH894204
6. You have told us about the people in one of your homes. Now think about all the
people who live with you in your other home. We will call it Home #2. Not
including you, how many children 17 years or younger live with you in Home #2?
A 0
B 1
C 2
D More than 2
VH894209
7. How many adults 18 years and older live with you in Home #2?
A 1
B 2
C More than 2
VH863933
8. Now think about all of the adults in all of your homes. How many of the adults
that live with you are taking care of you?
A 1
B 2
C 3
D 4
E More than 4
490
VH863771
9. You said one adult is taking care of you. Who is this adult?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
VH863781
10. You said more than one adult is taking care of you. Think about the first adult (you
can tell us about up to four adults). We will call them Adult #1. Who is Adult #1?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
491
VH863784
11. Think about the second adult taking care of you. We will call them Adult #2. Who
is Adult #2?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
492
VH863791
12. Think about the third adult taking care of you. We will call them Adult #3. Who is
Adult #3?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
493
VH863795
13. Think about the fourth adult taking care of you. We will call them Adult #4. Who
is Adult #4?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
VH863810
14. How far in school did your mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
494
VH863822
15. How far in school did your second mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863814
16. How far in school did your stepmother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863816
17. How far in school did your foster mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
495
VH863820
18. How far in school did your grandmother or female relative go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863825
19. How far in school did the female adult taking care of you go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863841
20. How far in school did your father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
496
VH863856
21. How far in school did your second father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863846
22. How far in school did your stepfather go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863849
23. How far in school did your foster father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
497
VH863851
24. How far in school did your grandfather or male relative go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863859
25. How far in school did the male adult taking care of you go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863863
26. In the last month, has your mother worked for pay?
A Yes
B No
C I don’t know.
VH863875
27. In the last month, has your second mother worked for pay?
A Yes
B No
C I don’t know.
498
VH863867
28. In the last month, has your stepmother worked for pay?
A Yes
B No
C I don’t know.
VH863871
29. In the last month, has your foster mother worked for pay?
A Yes
B No
C I don’t know.
VH863873
30. In the last month, has your grandmother or female relative worked for pay?
A Yes
B No
C I don’t know.
VH863877
31. In the last month, has the female adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
499
VH863882
32. In the last month, has your father worked for pay?
A Yes
B No
C I don’t know.
VH863898
33. In the last month, has your second father worked for pay?
A Yes
B No
C I don’t know
VH863885
34. In the last month, has your stepfather worked for pay?
A Yes
B No
C I don’t know.
VH863890
35. In the last month, has your foster father worked for pay?
A Yes
B No
C I don’t know.
500
VH863894
36. In the last month, has your grandfather or male relative worked for pay?
A Yes
B No
C I don’t know
VH863899
37. In the last month, has the male adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
VH863907
38. In the last month, did your mother work at one job, or did this adult work at two
or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863916
39. In the last month, did your second mother work at one job, or did this adult work
at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
501
VH863909
40. In the last month, did your stepmother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863911
41. In the last month, did your foster mother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863913
42. In the last month, did your grandmother or female relative work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863918
43. In the last month, did the female adult taking care of you work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
502
VH863919
44. In the last month, did your father work at one job, or did this adult work at two or
more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863929
45. In the last month, did your second father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863920
46. In the last month, did your stepfather work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863924
47. In the last month, did your foster father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
503
VH863927
48. In the last month, did your grandfather or male relative work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863930
49. In the last month, did the male adult taking care of you work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
504
Appendix K-1bg: Summary of Changes Operational Grade 12 ESQ
505
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
N/A
A
Issue: Socioeconomic Status
506
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Issue: Socioeconomic Status
N/A
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
A
Issue: Socioeconomic Status
N/A
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
507
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
508
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
A
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
N/A
Issue: Socioeconomic Status
509
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Issue: Socioeconomic Status
510
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include: your
mother / your second
mother / your
stepmother / your
foster mother / your
grandmother or
female relative / the
female adult taking
care of you / your
father / your second
father / your
stepfather / your
foster father / your
grandfather or male
relative / the male
adult taking care of
you
511
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include:
mother, second
mother, stepmother,
foster mother,
grandmother or
female relative , the
female adult taking
care of you, father,
second father,
stepfather, foster
father, grandfather or
male relative, the male
adult taking care of
you
512
2019 Operational Grade 12 Extended Student Questionnaire (ESQ) Student
Previous item
2019 item
N/A
Issue: Socioeconomic Status
D/A/
R/NC+
A
Rationale
This item was added as
part of the ESQ special
study for enhanced
measurement of socioeconomic status and
household
composition.
Please note that this
item includes the
caregiver title provided
by the respondent in a
prior item. Possible
answers include: your
mother, your second
mother, your
stepmother, your
foster mother, your
grandmother or
female relative , the
female adult taking
care of you, your
father, your second
father, your
stepfather, your foster
father, your
grandfather or male
relative, the male adult
taking care of you
513
Appendix K-1bh: Operational Grade 12 ESQ
514
VH863709
1. In the last month, how many different homes have you been living in? (If you have
moved in the last month, do not count the home where you used to live.)
A Zero homes
B One home
C Two homes
D Three or more homes
VH894192
2. Think about all the people who live with you in your home. Not including you,
how many children 17 years or younger live with you?
A 0
B 1
C 2
D More than 2
VH894194
3. Not including you, how many adults 18 years and older live with you?
A 1
B 2
C More than 2
VH894198
4. You said you live in more than one home. Think about all the people who live
with you in one of these homes (you can tell us about up to two homes). We will
call it Home #1. Not including you, how many children 17 years or younger live
with you in Home #1?
A 0
B 1
C 2
D More than 2
515
VH894200
5. Not including you, how many adults 18 years and older live with you in Home #1?
A 1
B 2
C More than 2
VH894204
6. You have told us about the people in one of your homes. Now think about all the
people who live with you in your other home. We will call it Home #2. Not
including you, how many children 17 years or younger live with you in Home #2?
A 0
B 1
C 2
D More than 2
VH894207
7. Not including you, how many adults 18 years and older live with you in Home #2?
A 1
B 2
C More than 2
VH863933
8. Now think about all of the adults in all of your homes. How many of the adults
that live with you are taking care of you?
A 1
B 2
C 3
D 4
E More than 4
516
VH863771
9. You said one adult is taking care of you. Who is this adult?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
VH863781
10. You said more than one adult is taking care of you. Think about the first adult (you
can tell us about up to four adults). We will call them Adult #1. Who is Adult #1?
A Mother
B Stepmother
C Foster mother
D Grandmother or female relative
E Other female adult (Please specify:
)
F Father
G Stepfather
H Foster father
I Grandfather or male relative
J Other male adult (Please specify:
)
517
VH863784
11. Think about the second adult taking care of you. We will call them Adult #2. Who
is Adult #2?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
518
VH863791
12. Think about the third adult taking care of you. We will call them Adult #3. Who is
Adult #3?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
519
VH863795
13. Think about the fourth adult taking care of you. We will call them Adult #4. Who
is Adult #4?
A Mother
B Second mother
C Stepmother
D Foster mother
E Grandmother or female relative
F Other female adult (Please specify:
)
G Father
H Second father
I Stepfather
J Foster father
K Grandfather or male relative
L Other male adult (Please specify:
)
VH863810
14. How far in school did your mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
520
VH863822
15. How far in school did your second mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863814
16. How far in school did your stepmother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863816
17. How far in school did your foster mother go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
521
VH863820
18. How far in school did your grandmother or female relative go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863825
19. How far in school did the female adult taking care of you go?
A She did not finish high school.
B She graduated from high school or has a high school degree.
C She had some college but did not graduate.
D She graduated from college.
E I don’t know.
VH863841
20. How far in school did your father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
522
VH863856
21. How far in school did your second father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863846
22. How far in school did your stepfather go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863849
23. How far in school did your foster father go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
523
VH863851
24. How far in school did your grandfather or male relative go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863859
25. How far in school did the male adult taking care of you go?
A He did not finish high school.
B He graduated from high school or has a high school degree.
C He had some college but did not graduate.
D He graduated from college.
E I don’t know.
VH863863
26. In the last month, has your mother worked for pay?
A Yes
B No
C I don’t know.
VH863875
27. In the last month, has your second mother worked for pay?
A Yes
B No
C I don’t know.
524
VH863867
28. In the last month, has your stepmother worked for pay?
A Yes
B No
C I don’t know.
VH863871
29. In the last month, has your foster mother worked for pay?
A Yes
B No
C I don’t know.
VH863873
30. In the last month, has your grandmother or female relative worked for pay?
A Yes
B No
C I don’t know.
VH863877
31. In the last month, has the female adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
525
VH863882
32. In the last month, has your father worked for pay?
A Yes
B No
C I don’t know.
VH863898
33. In the last month, has your second father worked for pay?
A Yes
B No
C I don’t know
VH863885
34. In the last month, has your stepfather worked for pay?
A Yes
B No
C I don’t know.
VH863890
35. In the last month, has your foster father worked for pay?
A Yes
B No
C I don’t know.
526
VH863894
36. In the last month, has your grandfather or male relative worked for pay?
A Yes
B No
C I don’t know
VH863899
37. In the last month, has the male adult taking care of you worked for pay?
A Yes
B No
C I don’t know.
VH863907
38. In the last month, did your mother work at one job, or did this adult work at two
or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863916
39. In the last month, did your second mother work at one job, or did this adult work
at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
527
VH863909
40. In the last month, did your stepmother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863911
41. In the last month, did your foster mother work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863913
42. In the last month, did your grandmother or female relative work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863918
43. In the last month, did the female adult taking care of you work at one job, or did
this adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
528
VH863919
44. In the last month, did your father work at one job, or did this adult work at two or
more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863929
45. In the last month, did your second father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863920
46. In the last month, did your stepfather work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863924
47. In the last month, did your foster father work at one job, or did this adult work at
two or more jobs?
A One job
B Two or more jobs
C I don’t know.
529
VH863927
48. In the last month, did your grandfather or male relative work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
VH863930
49. In the last month, did the male adult taking care of you work at one job, or did this
adult work at two or more jobs?
A One job
B Two or more jobs
C I don’t know.
530
| File Type | application/pdf |
| Author | Stainthorpe, Anne E |
| File Modified | 2019-07-17 |
| File Created | 2018-07-25 |