The API reports include a “similar schools rank.” This
information shows where a school ranks academically on a
scale of 1–10, compared with 100 other schools with similar
demographic characteristics. California public schools serve
students with many different backgrounds and needs. As a
result, schools face different educational challenges. The
similar schools ranks allow schools to look at their academic
performance compared to other schools with some of the same
opportunities and challenges.
The comparison of similar schools is required by the PSAA,
Education Code Section 52056(a), and provides additional
information about schools beyond that provided by APIs and
statewide ranks. However, similar schools ranks are not used
to establish eligibility for awards or interventions provided by
the PSAA. The PSAA also requires that similar school
comparisons be based on specified demographic school characteristics.
Schools’ API scores are ranked separately within school type:
elementary, middle, and high schools. For each of the three
categories, schools’ API scores are first sorted from lowest to
highest statewide and then divided into ten equal groups (or
deciles) ranked from lowest (one) to highest (ten). This first
process produces the statewide ranks. A second process
produces the similar schools ranks.
Similar Schools Ranking Questions and Answers
- What is the purpose of comparing similar
schools in the API report?
California public schools serve students with different backgrounds
and needs. As a result, schools face different educational challenges
and opportunities. For this reason, it is helpful to provide
information about a school’s academic achievement as it compares
to similar schools.
- How are the similar schools ranks used?
The similar schools ranks can be used in at least two ways. First,
schools can use this information as a reference point for judging
their academic achievement against other schools facing similar
challenges. Second, schools may improve their academic performance
by studying what similar schools with higher rankings are
doing. Similar schools ranks are not used in any way as the basis
for awards or sanctions.
- What sources were used to collect the data for
the 2004 similar schools ranks?
The demographic data for the similar schools ranks came from
several sources, including the administration of the Standardized
Testing and Reporting (STAR) program and the California
Basic Educational Data System (CBEDS). The CBEDS is a
data collection conducted by the CDE.
- What steps are used in calculating the similar
schools ranks?
Several steps were used to calculate the similar schools ranks.
First, schools were divided into grade level categories (elementary,
middle, and high schools). Then, the School Characteristics Index
(SCI), a composite of the school’s demographic characteristics,
was calculated for each school. Next, a comparison group of 100
similar schools was formed, based on similar SCIs (see AUSD example of SCI). Last, the
similar schools rank for each school was calculated. This ranking
was based on the school’s API Base compared with the Base APIs
of other similar schools in the comparison group.
- What is the SCI and how is it calculated?
The SCI combines the demographic characteristics of a school.
It is calculated through a statistical
procedure that produces a single index based on all of the factors
included. Schools with SCIs that are close in numerical value face
similar educational challenges and opportunities.
- Do all 100 schools in the same similar schools
rank have the same demographic characteristics?
Each school is unique; therefore, it is impossible to find similar
schools that match in every way. In order to form large enough
groups of similar schools for meaningful ranks, the procedure
used for each SCI allows for some differences between schools.
- How is a specific similar schools rank determined?
A comparison group for each school was formed by placing the
school’s SCI as the median or mid-point (middle) and taking the
50 schools with SCIs just above and the 50 just below. The 100
schools in the comparison group were sorted according to their
API Base and divided into 10 equal-sized groups (deciles). The
API of the school was then compared to the APIs of the schools
in its group. The school was assigned a decile rank based on this
comparison, and that is the rank shown on the report.
- How can I find out which schools are in the
comparison group for my student’s school?
The list of the 100 schools and the Base APIs of the schools
included in each school’s similar schools comparison group can
be found in the Similar Schools Report on the CDE Web site.
- Another school in the school district has similar
students and almost exactly the same API
score but a different “similar schools” rank.
How can that be?
Even if schools appear quite similar, they may differ with respect
to some measured characteristics. Small differences in two
school’s demographic characteristics and SCIs can result in very
different groups of similar schools. If one school’s comparison
group has a different range of API scores than the other school,
the two schools’ ranks may differ.
- Will the comparison group for my student’s
school remain the same from year to year?
No. Demographic characteristics change from year to year. In
March 2005, your school received a 2004 similar schools rank,
which compared the school’s 2004 API level to a group of 100
similar schools. In March 2006, your school will receive a 2005
similar schools rank which will compare its 2005 API level to a
new group of 100 similar schools. The new group of 100 similar
schools may or may not change substantially from the previous
year.
There are approximately 5200 elementary schools in California. The School Classification Index ranges from 140 to 210 for these 5200 elementary schools. The higher the School Classification Index, the higher socio economic demographics including parental education of that school. The similar school ranking takes 50 schools above a school's School Classification Index and 50 schools above. The precentage rating for each school shows where on the continuum for each school. For 2007, Washington's % of 54.77% means there were in middle of elementary in terms of socio economic demographics while Bay Farm with a 97.38% means there were only 2.5% elementary schools in the state with socio economic demographics than Bay Farm.
Error found in school rankings
Comparison of similar campuses is pulled off Web for correction
By Dan Nguyen, Sacramento Bee, April 8, 2006
The discovery of a miscalculation has caused the state Department of Education to withdraw a ranking used to compare academic performance of schools of similar characteristics.
The state said Friday it had omitted a variable - the number of students whose ethnicity was unspecified - from its calculation of "similar schools" rankings.
The erroneous rankings, which were released in late March, were pulled from the state's Web site and are expected to be re-released in three weeks, said Pat McCabe, the state's director of policy and evaluation.
These rankings have been released every year since 1999, when the state created the Academic Performance Index - the API - based on a school's test scores.
The similar-schools ranking compares the API of one California school against 100 other schools that most closely share its characteristics and challenges.
The comparability of schools is measured using 14 factors, such as parent education level, percentage of English learners, average class size and ethnicity.
The re-evaluation of the similar-schools rankings does not affect API scores.
Since its debut in 2000, the similar-schools ranking has sparked confusion and controversy. The state had to recalculate the first year results after it learned that schools had submitted incomplete data.
A parent in Southern California subsequently sued the state for not releasing details of its rankings formula.
On Friday, opponents of the rankings system welcomed the state's admission of an error.
Lynn Winters, assistant superintendent of the Long Beach Unified district, said her district for years had dismissed the rankings as irrelevant.
"Mathematically, it's uninterpretable," Winters said.
"When you have a similar schools ranking, it needs to make sense to people," she said.
But Winters said she took notice this year after principals had complained about inexplicable and dramatic drops in their school rankings.
Winters believes there are other errors in the state's formula that will necessitate an overhauling of the rankings system.
McCabe said the state's testing department will meet Monday with the Long Beach district to hear its complaints. But he said there are complaints about the rankings every year and they often stem from misunderstandings of the system.
"There's a lot of disgruntlement around the similar schools rank," he said. "A lot of it comes from people thinking that schools (on their lists of 100) ought to look like them."
McCabe said schools are grouped together because of the amount of challenges they face, even if the types of challenges are different.
This year's ranking gaffe comes in the same year that the state revised its formula and added six new factors, including the number of gifted and special education students.
San Juan Unified district officials believe the inclusion of gifted student numbers might have resulted in several of its schools taking a dive in their rankings this year.
Del Paso Manor Elementary saw its ranking plummet from a top rank of 10 to a rank of 2. This means its test scores were in the bottom 20 percent compared to the 100 schools in its group. Only about a dozen schools statewide fell as sharply.
Principal Phyllis Westrup said she was perplexed, because the school actually increased its Academic Performance Index from 862 - which is well above the state's goal - to 872. And she said the school's low-income students had made large increases in test scores.
"It's kind of hard to understand how your school could make such wonderful progress and yet drop in the similar schools rankings," she said.
Donna O'Neil, San Juan's director of accountability, said she had not seen the details of this year's calculation method, but has in the past encouraged principals to contact schools on their lists and compare notes.
She suspected, however, that Del Paso Manor's number of gifted students - nearly 40 percent of the school's population - put it in a more elite bracket of schools.
McCabe said he expected complaints about the new formula. In the past, he said, schools with small gifted programs complained about being compared against other schools with larger gifted programs.
"You get complaints and concerns from people on both sides. You'll always have winners or losers," McCabe said.
Long Beach's Winters said the fact that a school like Del Paso Manor could be ranked so dismally despite actually improving academically was proof of how unintuitive the ranking system is.
Winters said she supported the idea of comparing similar schools, but wanted the state to find a different system for doing so.
"We don't mind the (concept). But the system they chose is particularly complex and uninterpretable." she said.
Academic Performance Index (API) Scores for Alameda Schools
Academic Performance Index Base Date for Alameda Schools 2002 to Current
TOP
Comments. Questions. Broken links? Bad spelling! Incorrect Grammar? Let me know at webmaster.
Last modified: March 15, 2005
Disclaimer: This website is the sole responsibility of Mike
McMahon. It does not represent any official opinions, statement of facts or
positions of the Alameda Unified School District. Its sole purpose is to
disseminate information to interested individuals in the Alameda community.