A Study of Reliability and Consequential Validity of a Mathematics Diagnostic Assessment System in Georgia

ICR 201809-1850-006

OMB: 1850-0946

Federal Form Document

Forms and Documents
Document
Name
Status
Form and Instruction
New
Supplementary Document
2018-09-19
Supporting Statement B
2019-03-06
Supplementary Document
2018-09-19
Supporting Statement A
2019-03-06
IC Document Collections
ICR Details
1850-0946 201809-1850-006
Active
ED/IES ED-2018-ICCD-0087
A Study of Reliability and Consequential Validity of a Mathematics Diagnostic Assessment System in Georgia
New collection (Request for a new OMB Control Number)   No
Regular
Approved with change 03/08/2019
Retrieve Notice of Action (NOA) 10/31/2018
  Inventory as of this Action Requested Previously Approved
03/31/2022 36 Months From Approved
44 0 0
606 0 0
0 0 0

Several school districts in Georgia (including Forsyth and Jefferson Counties) currently use the Individual Knowledge Assessment of Number (IKAN; New Zealand Ministry of Education, 2011) and the Global Strategy Stage (GloSS; New Zealand Ministry of Education, 2012) as part of a diagnostic assessment system within their multi-tiered systems of support. The IKAN and GloSS assessments were designed for use in Grades K–8 (GaDOE, 2015). IKAN provides information on students’ number knowledge (that is, magnitude comparisons, knowledge of base 10 system and meaning of decimals and fractions), and the GloSS provides information on strategies students use when solving mathematical problems. When used together, the IKAN and GloSS assessments furnish teachers with information on how students solve mathematics problems and students’ understanding of whole and rational number concepts. Teachers can then use the information from the assessments to tailor their instruction to students’ levels of understanding and address problems that underlie lack of success with grade-level curriculum. The Georgia Department of Education (GaDOE) has received positive feedback through testimonials from district-level personnel and math coaches supporting the use of IKAN/GloSS. Yet, very limited psychometric data exists to support the use of these measures. GaDOE has not conducted reliability or validity studies using its student population. While many studies have been conducted in New Zealand by the Ministry of Education, participating Georgia school districts and the GaDOE are interested in psychometric data using teachers and students in their state in the context of their state system of standards, assessments, and accountability. Thus, through the Improving Mathematics Research Alliance, the GaDOE requested REL Southeast conduct a study to determine the reliability and validity of the IKAN/GloSS diagnostic assessments. The three research questions guiding the project relate to the inter-assessor reliability of the GloSS and IKAN assessments when administered by two assessors within a one-week period and the consequential validity of using IKAN and GloSS diagnostic assessments (that is, teachers’ perception of their instructional utility for providing intervention). Student data from the IKAN and GloSS assessments administered by teachers and mathematics coaches will be used to answer the two research questions related to the inter-assessor reliability studies.

None
None

Not associated with rulemaking

  83 FR 42492 08/22/2018
83 FR 54729 10/31/2018
No

1
IC Title Form No. Form Name
Diagnostic Assessment System in Georgia Focus Group and Surveys N/A, N/A, N/A Focus Group Questions ,   IKAN/GloSS Sample Items ,   Teacher Consequential Validity Survey

  Total Approved Previously Approved Change Due to New Statute Change Due to Agency Discretion Change Due to Adjustment in Estimate Change Due to Potential Violation of the PRA
Annual Number of Responses 44 0 0 44 0 0
Annual Time Burden (Hours) 606 0 0 606 0 0
Annual Cost Burden (Dollars) 0 0 0 0 0 0
Yes
Miscellaneous Actions
No
This is a new request - therefore all burden is new. This results in a program change increase in burden and responses of 606 hours and 44 responses respectively.

$179,723
No
    Yes
    Yes
No
No
No
Uncollected
Janelle Sands 202 245-6786

  No

On behalf of this Federal agency, I certify that the collection of information encompassed by this request complies with 5 CFR 1320.9 and the related provisions of 5 CFR 1320.8(b)(3).
The following is a summary of the topics, regarding the proposed collection of information, that the certification covers:
 
 
 
 
 
 
 
    (i) Why the information is being collected;
    (ii) Use of information;
    (iii) Burden estimate;
    (iv) Nature of response (voluntary, required for a benefit, or mandatory);
    (v) Nature and extent of confidentiality; and
    (vi) Need to display currently valid OMB control number;
 
 
 
If you are unable to certify compliance with any of these provisions, identify the item by leaving the box unchecked and explain the reason in the Supporting Statement.
10/31/2018


© 2024 OMB.report | Privacy Policy