2010 CRCT Erasure Analysis

February 9, 2011

The Governor’s Office of Student Achievement (OSA) today released the results of a spring 2010 erasure analysis on the standardized assessment known as the CRCT. OSA again worked with CTB-McGraw Hill (CTB), the state’s testing vendor that develops and scores the CRCTs, to conduct a comprehensive examination of all answer documents for grades 1 through 8. The analysis focused on the number of wrong answers that had been erased and replaced with correct answers on individual student answer sheets in Reading, English-Language Arts, and Mathematics.

“This analysis done on the 2010 CRCT answer sheets, which is identical to that done last year on 2009 answer sheets, paints a very different picture,” said OSA Executive Director, Kathleen Mathers. “Far fewer classrooms were flagged across the state this time, and those flags were generally much smaller than flags seen a year ago. That’s certainly good news.”
 
In the analysis, CTB psychometricians scanned answer documents to identify total erasures per classroom, flagging those classrooms in which the number of wrong-to-right changes proved to be significantly higher than the state average.
 
OSA again placed schools into four categories based on the percentage of classrooms flagged within each school: Clear of concern (0%-5% flagged); Minimal concern (6%-10% flagged); Moderate concern (11%-24% flagged); and Severe concern (25% or more flagged).
 
87% of Georgia’s elementary and middle schools fell into the “Clear” category compared to 80% a year ago; 10% fell into “minimal concern” compared to 10% a year ago; 3% fell into “Moderate concern” compared to 6% a year ago; and 0.5% fell into “Severe concern” compared to 4% a year ago.
 
“We’ve seen the greatest progress where it matters most - in schools on the moderate and severe concern lists,” said Adrian Neely, OSA’s Academic Auditor. “Certainly we have to stay focused on the work before us, but we’re very encouraged by the improvement we’ve seen in just one year.”
 
Recommendations on which the State Board of Education is expected to vote on Thursday range from keeping educators whose classrooms were flagged across multiple subjects from administering the 2011 CRCT, to rotating teachers so that they do not administer the test to students they have taught. In addition, state monitors will be placed in schools in the severe and moderate concern categories during this spring’s test.
 
 The Criterion Referenced Competency Test (CRCT) is a standardized assessment given to elementary and middle school students each spring in Georgia. The test is designed to measure how well students at each grade level have learned the state’s curriculum. CRCT results are used to determine whether schools have made Adequate Yearly Progress (AYP) and are also the criteria by which some student promotion and retention decisions are made.
 
The Governor’s Office of Student Achievement serves as a reporting and accountability agency for education in Georgia. As such, OSA is charged with inspecting academic records of schools to ensure that such records are valid and reliable. Through an academic audit, GOSA reviews student assessment data and other school records reported to the State to confirm accuracy and explore the effectiveness of local school initiatives in improving achievement. The full 2010 CRCT erasure analysis report is attached below.
 
Contact Information: 
404.463.1150
Related Files: