GOSA releases 2014 Spring CRCT Analysis Results

February 19, 2015

The Governor’s Office of Student Achievement (GOSA) today released the results of the spring 2014 Criterion Referenced Competency Test (CRCT) erasure analysis.  For the past six years, GOSA has partnered with CTB-McGraw Hill (CTB), the state’s testing vendor in charge of developing and scoring CRCT exams to conduct a comprehensive examination of all answer documents for grades 3 through 8.  The analysis focused on the number of wrong answers that had been changed to right answers on an individual student answer sheets in Reading, English-Language Arts, and Mathematics.  Each answer sheet was scanned to identify total erasures and total wrong-to right changes.  Classrooms across the state were flagged in which the number of wrong-to-right changes were three standard deviations (SDs) or more above the state average.  Overall, less than 2% of Georgia’s elementary and middle school classrooms were flagged using this criterion, which is similar to the previous two years.

As in previous years, GOSA has placed elementary and middle schools in varying categories based on their percentage of flagged classrooms.  Approximately 94% of Georgia’s elementary and middle schools fell into the “Clear of Concern” category, 4.1% (75) schools fell into the “Minimum Concern” category; 1.5% (28 schools) were determined to be in the “Moderate Concern” category; and only 0.1% (1 school) was termed “Severe Concern” as defined by a school having 25% or more of its classes flagged for wrong-to-right changes.

The results indicate that local districts continue to improve test security and implement best practices. GOSA, in collaboration with Georgia’s Department of Education, will continue to support local districts with improving their test plans and enhancing the overall security of the test environment while systems transition from pencil and paper testing to computer-based testing.

Recommendations on which the State Board of Education will vote range from requiring local superintendents with schools on the “Concern” lists to conduct internal investigations to determine the causes of testing irregularities, to rotating teachers during the next test administrations in those schools so that they administer the test to students they are not currently teaching.  In addition, state monitors will be placed in schools on the “Concern” lists throughout the state during the next administration.

The CRCT is a standardized assessment given to elementary and middle school students each spring in Georgia. It is designed to measure how well students at each grade level have acquired the knowledge and skills within Georgia’s performance/content standards outlined in the CCGPS/GPS (Common Core Georgia Performance Standards/Georgia Performance Standards).  Additionally, the CRCT results serve as the criteria by which some student promotion and retention decisions are made. The Georgia Milestones Assessment System (Georgia Milestones) is Georgia’s new state assessment spanning grades 3 through 12.  GOSA will continue to audit and inspect the Georgia Milestones tests as important decisions for individual students and for schools are based on student assessment data.  Therefore, it is critical that reported scores are an accurate representation of students’ knowledge and skills.

The Governor’s Office of Student Achievement serves as the reporting and accountability agency for education in Georgia.  As such, GOSA is charged by law with inspecting academic records of schools to ensure that education institutions are faithful to performance accountability requirements.  Through an academic audit, GOSA reviews student assessment data and other school records reported to the State to confirm accuracy and explore the effectiveness of local initiatives in improving achievement.

Click here to access the analysis on GOSA’s academic auditing page.