State-Level Analysis of 2012-13 CCRPI Release
April 21, 2014
By Pascal Beaudette and Sam Rauschenberg
In May 2013, the Georgia Department of Education (GaDOE) released the first ever College and Career Ready Performance Index (CCRPI) as a new statewide accountability system for schools and districts. Each school and district received a score based on data from the 2011-12 school year, but the initial release was considered a “study year.” After this release, GaDOE received feedback from its education partners, including GOSA, and the public. It revised the CCPRI calculation in light of these suggestions. For a detailed summary of these changes, click here.
On Monday, April 21, 2014, the GaDOE released CCRPI scores for the 2012-13 academic year as well as recalculated 2011-12 scores that apply the new methodology to the same 2012 data.
The total possible CCRPI score is 110 points (100 points and 10 Challenge Points). The index includes the following components:
| Component | Possible Points |
|---|---|
| Achievement | 60 |
| Progress | 25 |
| Achievement Gap | 15 |
| Challenge (Bonus) Points | 10 |
| Total Score | 110 |
Achievement (60 points)
- Content Mastery on CRCT/EOCT tests in core subjects.
- Post High School Readiness (eg: career pathways, ACT/SAT/AP/IB exam performance, world language coursework, reading/writing skills, and attendance).
- Graduation rate (Four- and five-year graduation rates with more weight given to the four-year rate) in high school or a “Predictor for High School Graduation” for elementary and middle schools (an additional, different look at CRCT performance).
Progress (25 points)
- Measured by the percentage of students earning typical or high growth on state assessments. This percentage is derived from Student Growth Percentiles (SGPs), which compare a student’s growth with other students with similar past achievement.
Achievement Gap (15 points)
- Based upon schools’ achievement gap size and change in that gap. The gap is measured between the schools’ bottom 25% of students and the state average.
Challenge Points (10 total points) as a sum of the following:
- Exceeding the Bar (ETB) Points
- Seven to ten items worth 0.5 points each that focus on innovative practices and career-related outcomes. Only the top 5% in each category qualify with the exception of the 0.5 points awarded for innovative practices.
- ED/EL/SWD Performance Points
- Based upon subgroup performance of economically disadvantaged (ED), students with disabilities (SWD), and English Language Learners (ELL) student performance relative to state targets. Possible points is proportional to the percentage of students a school has in each subgroup.
Each school receives a separate score for each grade configuration (Elementary K-5, Middle 6-8, and High 9-12). However, each school also receives an overall score that is a weighted average of enrollment in each grade configuration.
2012-13 CCRPI Key Points
- The statewide score for 2012-13 is 75.8, an increase of 1.7 points from 2011-12.
- Elementary schools have the highest average and had the largest score increase, from 74.9 in 2011-12 to 78.5 in 2012-13.
- The middle school score increased from 73.9 to 75.0, but the high school score decreased from 73.0 to 72.0.
- High school scores are lower than elementary or middle primarily because high school tend to earn fewer achievement and challenge points.
- As the percentage of students who are eligible for free/reduced price lunch increases, CCRPI generally scores decrease. However, there are schools at nearly all poverty levels that earn high CCRPI scores.
- This pattern exists with each of the score components, but the relationship is much less pronounced for Progress and Challenge points. As a result, the shift toward more weight from Achievement to Progress has reduced the correlation between CCRPI scores and the percent of students eligible for free/reduced price lunch.
WYSIWYG:
EMBEDDED IMAGE
|
- 124 schools saw an increase of more than 15 points in 2012-13.
- Most of the improvement was due to gains in Achievement and Achievement Gap points.
- 92 elementary schools, 12 middle schools, and 20 high schools
- 37 schools saw a decrease of more than 15 points in 2012-13.
- Most of the decrease was due to decreases in Achievement and Achievement Gap points.
- The change in CCRPI scores between years is not strongly correlated with the percentage of students eligible for free/reduced price lunch.
-
Click
here for a list of schools with increases of 10 points or more in CCRPI scores.
-
Click
here for a list of schools with decreases of 10 points or more
.
State-Level Scores
GaDOE calculates a statewide score for each grade cluster (Elementary, Middle, and High School) by running the calculation at the state level. Using this methodology, the state averages are included in the table below:
| Statewide CCRPI Scores in 2011-12 and 2012-13* | ||||||
|---|---|---|---|---|---|---|
| Achievement | Progress | Achievement Gap | Challenge: EL/ED/SWD | Challenge: ETB | CCRPI Score | |
| Elementary | ||||||
| 2011-12 | 45.6 | 16.3 | 7.0 | 5.6 | 0.4 | 74.9 |
| 2012-13 | 47.5 | 16.5 | 9.0 | 4.8 | 0.7 | 78.5 |
| Middle | ||||||
| 2011-12 | 46.8 | 16.5 | 8.0 | 2.5 | 0.1 | 73.9 |
| 2012-13 | 48.3 | 16.7 | 7.0 | 2.6 | 0.4 | 75.0 |
| High | ||||||
| 2011-12 | 43.1 | 16.3 | 11.3 | 2.1 | 0.2 | 73.0 |
| 2012-13 | 43.6 | 16.3 | 8.7 | 3.2 | 0.2 | 72.0 |
| Overall 2011-12 State Score | 74.1 | |||||
| Overall 2012-13 State Score | 75.8 | |||||
| *Scores are split into Elementary (K-5), Middle (6-8), and High School (9-12) categories. Schools with grade configurations in multiple categories receive a separate CCRPI score for both categories. | ||||||
Impact of Challenge Points
- Most Challenge Points are awarded from ED/EL/SWD Performance Points rather than ETBs.
- Schools with higher CCRPI scores tend to earn more Challenge Points than schools receiving lower CCRPI scores. However, the skew towards high performing schools is less than in the original score release.
- The chart below shows the effect of Challenge points on the CCPRI score.
|
Impact of Challenge Points in 2012-13 |
||||
|---|---|---|---|---|
|
CCRPI Score Range |
Average Challenge Points |
Number of Schools in Score Range without Challenge Points Included |
Number of Schools in Score Range with Challenge Points Included |
Percent Change in Number of Schools |
|
90-100+ |
3.8 |
233 |
293 |
26% |
|
80-89 |
5.3 |
416 |
622 |
50% |
|
70-79 |
4.4 |
742 |
660 |
-11% |
|
60-69 |
2.4 |
652 |
463 |
-29% |
|
Less than 60 |
0.9 |
414 |
335 |
-19% |
Conclusion and Next Steps
The revisions to the CCRPI increased the rigor of the index and have resulted in an index that provides more meaningful information on school quality. In the coming months, GOSA will conduct more in-depth indicator-level analyses to provide more information about CCRPI patterns and trends.
Click here to access the GaDOE CCRPI Portal to access specific school scores.