State-Level Analysis of 2012-13 CCRPI Release

April 21, 2014

By Pascael Beaudette and Sam Rauschenberg

In May 2013, the Georgia Department of Education (GaDOE) released the first ever College and Career Ready Performance Index (CCRPI) as a new statewide accountability system for schools and districts. Each school and district received a score based on data from the 2011-12 school year, but the initial release was considered a “study year.” After this release, GaDOE received feedback from its education partners, including GOSA, and the public. It revised the CCPRI calculation in light of these suggestions. For a detailed summary of these changes, click here.

On Monday, April 21, 2014, the GaDOE released CCRPI scores for the 2012-13 academic year as well as recalculated 2011-12 scores that apply the new methodology to the same 2012 data.

The total possible CCRPI score is 110 points (100 points and 10 Challenge Points). The index includes the following components:

Component Possible Points
Achievement 60
Progress 25
Achievement Gap 15
Challenge (Bonus) Points 10
Total Score 110
 
Achievement (60 points)
  • Content Mastery on CRCT/EOCT tests in core subjects.
  • Post High School Readiness (eg: career pathways, ACT/SAT/AP/IB exam performance, world language coursework, reading/writing skills, and attendance).
  • Graduation rate (Four- and five-year graduation rates with more weight given to the four-year rate) in high school or a “Predictor for High School Graduation” for elementary and middle schools (an additional, different look at CRCT performance).
Progress (25 points)
  • Measured by the percentage of students earning typical or high growth on state assessments. This percentage is derived from Student Growth Percentiles (SGPs), which compare a student’s growth with other students with similar past achievement.
Achievement Gap (15 points)
  • Based upon schools’ achievement gap size and change in that gap. The gap is measured between the schools’ bottom 25% of students and the state average.
Challenge Points (10 total points) as a sum of the following:
  • Exceeding the Bar (ETB) Points
    • Seven to ten items worth 0.5 points each that focus on innovative practices and career-related outcomes. Only the top 5% in each category qualify with the exception of the 0.5 points awarded for innovative practices.
  • ED/EL/SWD Performance Points
    • Based upon subgroup performance of economically disadvantaged (ED), students with disabilities (SWD), and English Language Learners (ELL) student performance relative to state targets. Possible points is proportional to the percentage of students a school has in each subgroup.

Each school receives a separate score for each grade configuration (Elementary K-5, Middle 6-8, and High 9-12). However, each school also receives an overall score that is a weighted average of enrollment in each grade configuration.

2012-13 CCRPI Key Points

  • The statewide score for 2012-13 is 75.8, an increase of 1.7 points from 2011-12.
  • Elementary schools have the highest average and had the largest score increase, from 74.9 in 2011-12 to 78.5 in 2012-13.
  • The middle school score increased from 73.9 to 75.0, but the high school score decreased from 73.0 to 72.0.

Graph of Distribution of CCRPI Scores by School Type, high schools peak first, then middle schools, then elementary

 

  • High school scores are lower than elementary or middle primarily because high school tend to earn fewer achievement and challenge points.
graph of distribution of achievement points by school type; high schools peak first graph of distribution of challenge points by school type; high schools peak first
  • As the percentage of students who are eligible for free/reduced price lunch increases, CCRPI generally scores decrease. However, there are schools at nearly all poverty levels that earn high CCRPI scores.

scatter plot of CCRPI score and percent poverty; negative correlation

  • This pattern exists with each of the score components, but the relationship is much less pronounced for Progress and Challenge points. As a result, the shift toward more weight from Achievement to Progress has reduced the correlation between CCRPI scores and the percent of students eligible for free/reduced price lunch.
scatter plot of achievement points and percent poverty; negative correlation scatter plot of progress points and percent poverty; negative correlation
scatter plot of achievement gap points and percent poverty; negative correlation scatter plot of challenge points and percent poverty; slight negative correlation

State-Level Scores

GaDOE calculates a statewide score for each grade cluster (Elementary, Middle, and High School) by running the calculation at the state level. Using this methodology, the state averages are included in the table below:

Statewide CCRPI Scores in 2011-12 and 2012-13*
  Achievement Progress Achievement Gap Challenge: EL/ED/SWD Challenge: ETB CCRPI Score
Elementary
2011-12 45.6 16.3 7.0 5.6 0.4 74.9
2012-13 47.5 16.5 9.0 4.8 0.7 78.5
Middle
2011-12 46.8 16.5 8.0 2.5 0.1 73.9
2012-13 48.3 16.7 7.0 2.6 0.4 75.0
High
2011-12 43.1 16.3 11.3 2.1 0.2 73.0
2012-13 43.6 16.3 8.7 3.2 0.2 72.0
 
  Overall 2011-12 State Score 74.1
  Overall 2012-13 State Score 75.8
*Scores are split into Elementary (K-5), Middle (6-8), and High School (9-12) categories. Schools  with grade configurations in multiple categories receive a separate CCRPI score for both categories.

Impact of Challenge Points

  • Most Challenge Points are awarded from ED/EL/SWD Performance Points rather than ETBs.
  • Schools with higher CCRPI scores tend to earn more Challenge Points than schools receiving lower CCRPI scores. However, the skew towards high performing schools is less than in the original score release.
  • The chart below shows the effect of Challenge points on the CCPRI score.

 

Impact of Challenge Points in 2012-13

CCRPI Score Range

Average Challenge Points

Number of Schools in Score Range without Challenge Points Included

Number of Schools in Score Range with Challenge Points Included

Percent Change in Number of Schools

90-100+

3.8

233

293

26%

80-89

5.3

416

622

50%

70-79

4.4

742

660

-11%

60-69

2.4

652

463

-29%

Less than 60

0.9

414

335

-19%

Conclusion and Next Steps

The revisions to the CCRPI increased the rigor of the index and have resulted in an index that provides more meaningful information on school quality.  In the coming months, GOSA will conduct more in-depth indicator-level analyses to provide more information about CCRPI patterns and trends.

Click here to access the GaDOE CCRPI Portal to access specific school scores.

Click here to access the GaDOE Accountability page for more information on the CCRPI calculation methodology.