NAEP Update 2 Changes Memo

U NITED STATES DEPARTMENT OF EDUCATION

National Center for Education Statistics

July 23, 2019

MEMORANDUM

To: Robert Sivinski, OMB

From: Linda Hamilton, NCES

Through: Kashka Kubzdela, NCES

Re: National Assessment of Educational Progress (NAEP) 2019 and 2020 Long-Term Trend (LTT) Update 2 Changes to Materials (OMB# 1850-0928 v.16)

The National Assessment of Educational Progress (NAEP), conducted by the National Center for Education Statistics (NCES), is a federally authorized survey of student achievement at grades 4, 8, and 12 in various subject areas, such as mathematics, reading, writing, science, U.S. history, civics, geography, economics, technology and engineering literacy (TEL), and the arts. The National Assessment of Educational Progress Authorization Act (Public Law 107-279 Title III, section 303) requires the assessment to collect data on specified student groups and characteristics, including information organized by race/ethnicity, gender, socio-economic status, disability, and limited English proficiency. It requires fair and accurate presentation of achievement data and permits the collection of background, noncognitive, or descriptive information that is related to academic achievement and aids in fair reporting of results. The intent of the law is to provide representative sample data on student achievement for the nation, the states, and subpopulations of students and to monitor progress over time. The nature of NAEP is that burden alternates from a relatively low burden in national-level administration years to a substantial burden increase in state-level administration years when the sample has to allow for estimates for individual states and some of the large urban districts.

The request to conduct NAEP 2019 and 2020 was approved in September 2018 with the latest update to the NAEP 2020 plan, consisting of the Long Term Trend (LTT) assessment to be conducted during the 2019-20 school year, approved in June 2019 (OMB# 1850-0928 v.10-15). The LTT assessments are based on nationally representative samples of 9-, 13-, and 17-year old students, and have been used by NAEP since the early 1970s to provide measures of students’ educational progress over long time periods to allow for analyses of national trends in students’ performance in mathematics and reading. NAEP 2019 data collection has been concluded.

This request updates for the 2019-2020 LTT: (a) supporting statements Parts A and B, (b) communication materials (Appendix D3), (c) instructions for entering student information (Appendix H2), and (d) the SD and ELL section of the MyNAEP System (Appendix J5), and provides for the 2019-2020 LTT: (e) the Spanish Bilingual Student Questionnaires (Appendix K-4-S) translated from the approved in June 2019 (OMB# 1850-0928 v.15) English-language versions of the LTT Student Questionnaires (Appendix K4). The final version of the 2019-2020 LTT Content of the MyNAEP System (Appendix J5) will be submitted to OMB for approval as a non-substantive change request by August 2019.

The table below details the changes for review in this submission that were made to each of the documents as compared to those approved in June 2019 (OMB# 1850-0928 v.15). These revisions do not alter the approved respondent burden nor the actual cost to the federal government for conducting this study.

Document	Changes
Part A	Updated references to new Appendix K-4-S (LTT Spanish translations of applicable questionnaires) Removed references to a June 2019 update Updated contractor information per the new contract awarded Updated the Cost to the Federal Government section (A.10) to align how equivalent costs are reflected in clearance packages for other NCES studies – this is change due to this alignment, not an actual change in NCES costs for the 2019 and 2020 NAEP Added reference to NAEP 2019 and LTT 2020 student universe Made other non-substantive updates to reflect this Update 2 submission
Part B	In B1 clarified the student universe for NAEP 2019 and LTT 2020 In B.2.a- updated location for the LTT NCES letter to Chiefs, SD and ELL Templates, Parent Notification and Best Practices In B.3.b-revised paragraph to include age 17 and location for LTT Best Practices, Appendix D3-18 Removed references to a June 2019 update
Part C	No changes
Appendix A - External Advisory Committees	No changes
Appendix B1 – NAEP 2013 Weighting Procedures	No changes
Appendix B2 – LTT 2012 Weighting Procedures	No changes
Appendix C1 – NAEP 2019 Sampling Memo	No changes
Appendix C2 – LTT 2020 Sampling Memo	No changes
Appendix D1 – NAEP 2019 Communications and Recruitment Materials Part 1	No changes
Appendix D2 – NAEP 2019 Communications and Recruitment Materials Part 2	No changes
Appendix D3- LTT 2020 Communication Materials	Added: Appendix D3-15, Facts for Teachers Appendix D3-16, Templates for State Specific SD Inclusion Policy Appendix D3-17, Templates for State Specific ELL Inclusion Policy Appendix D3-18, Best Practices for Students age 17 Appendix D3-19, References for Best Practices Appendix D3-20, Spanish version of Parent/Guardian Letter, Public Schools Appendix D3-21, Spanish version of parent/Guardian, Private Schools Appendix D3-22, 2020 NCES Letter to Chiefs
Appendix E1 – NAEP 2019 Assessment Feedback Forms	No changes
Appendix E2 – LTT 2020 Assessment Feedback Forms	No changes
Appendix F - Item Library for NAEP 2019 & 2020 Survey Questionnaires	No changes
Appendix G1 - NAEP 2013 Sampling Design	No changes
Appendix G2 - LTT 2012 Sampling Design	No changes
Appendix H1- NAEP 2019 Instructions for Entering Student Data	No changes
Appendix H2- LTT 2020 Instructions for Entering Student Information	Made small revisions to the instructions and provided the finalized screenshots Separated instructions for each age group into 6 different versions: (a) for a choice of three different numbers of columns – selected based on what the school uses to report race/ethnicity data to SEA and (b) for schools that can report National School Lunch Program data to LTT 2020 at the time of E-Filing vs. for schools that cannot – each school will only see one version of the instructions that are appropriate for them, as determined by the NAEP State Coordinator (NSC)
Appendix I- 2019 HSTS and MSTS Data Collection Instruments	No changes
Appendix J1- NAEP 2019 Content of MyNAEP System	No changes
Appendix J2- NAEP 2019 Spanish Content of MyNAEP System for Puerto Rico	No changes
Appendix J3- 2019 Content of HSTS Website	No changes
Appendix J4- 2019 Content of MSTS Website	No changes
Appendix J5- LTT 2020 Content of the MyNAEP System	Revised the SD/ELL information section including providing final screenshots on pages 22-24, 27-29, and 32-34 (including adding a section on exclusions instructions on pages 23, 28, and 33) The remainder of finalized MyNAEP screen shots will be submitted to OMB for approval as a non-substantive change request by August 2019
Appendix K1-NAEP 2019 Student Questionnaires	No changes
Appendix K2- NAEP 2019 Teacher Questionnaires	No changes
Appendix K3- NAEP 2019 School Questionnaires	No changes
Appendix K4- LTT 2020 Student Questionnaires	No changes
Appendix K-S- NAEP 2019 Spanish Translations of Survey Questionnaire	No changes
Appendix K4-S- LTT 2020 Spanish Translations of Student Questionnaires	New appendix
Appendix L- Findings and Recommendations from the NAEP 2017 Pilot Study of MSTS	No changes

550 12^th Street, S.W., Washington, DC 20202

Our mission is to ensure equal access to education and to promote educational excellence throughout the Nation.