Lots of Poor School Districts Do Pretty Well, But We Don’t Know Why

As we all know, some schools are better than others, and some neighborhoods have smarter kids than others. Here’s a chart that puts these two things together in a way that’s pretty dramatic once you stare at it for a while:

Take a look at the two school districts I highlighted. On the left, third-grade students are performing at a kindergarten level. On the right, third-graders are performing at a sixth grade level. That’s an enormous difference, but not necessarily one that you can blame on schools.

But that’s not all. The vertical axis shows progress from third through eighth grade, which is more plausibly related to school performance. In the school district on the left, kids gain only about 0.8 years of achievement for each year of schooling. In other words, they fall even further behind. On the right, kids gain 1.2 years of achievement per year of school. By the time they’re both in eighth grade, one group of kids is performing at a fourth grade level while the other is performing like high school seniors.

Alternatively, take a look at the schools that I’ve circled. Third-graders are performing at third-grade level, so that’s fine. But then they fall off a cliff. Over the next five years they gain only about 0.4 years of achievement per year of school. By eighth grade they’re performing at the level of fifth graders. They’ve made barely any progress at all.

Obviously not all of this is the fault of the school districts. But surely some of it is, and it’s a national disgrace that the differences are so stark. However, what’s really striking about this chart is how random it is: third-grade performance is almost completely unconnected to growth between third and eighth grades. And it’s only weakly correlated with the income level of a school district.

So which school districts do the best at taking third-graders and turning them into eighth graders? Here’s a map:

A few things jump out at you:

  • The South does really badly.
  • Florida is an almost insane basket case.
  • Tennessee is a green oasis in the middle of a desert of purple. Someone should figure out what they’re doing right.
  • There are plenty of big-city school districts that also perform strongly. Chicago is bright green. Seattle does well. New Orleans does well. Conversely, Baltimore, Los Angeles, and Atlanta all start off poorly and continue to do poorly between third and eighth grades.

This all comes from Stanford’s Center for Education Policy Analysis. Sean Reardon has a paper discussing these results here, and he concludes with this:

What may be surprising, however, is…the fact that these growth opportunities are at best weakly correlated with early opportunities and with socioeconomic status.

In other words, third-grade scores are probably strongly influenced by poverty and home life, while growth from third to eighth grade is probably more influenced by the quality of schooling. They have little to do with each other:

Growth rates better isolate the contribution to learning due to experiences during the schooling years. Grade 3 average scores are likely much more strongly influenced by early childhood experiences than the growth rates….Some caution is warranted in interpreting the average growth rates as pure measures of school effectiveness. Nonetheless, relative to average test scores (at grade 3 or any grade), the growth rates are closer to a measure of school effectiveness.

If we take the growth rates, then, as rough measures of school effectiveness, then neither socioeconomic conditions nor average test scores are very informative about school district effectiveness. Many districts with high average test scores have low growth rates, and vice versa. And many low-income districts have above average growth rates. This finding calls into question the use of average test scores as an accountability tool or a way of evaluating schools.

And finally, this:

The findings also suggest that we could learn a great deal about reducing educational inequality from the low-SES communities with high growth rates. They provide, at a minimum, an existence proof of the possibility that even schools in high-poverty communities can be effective. Now the challenge is to learn what conditions make that possible and how we can foster the same conditions everywhere.

More research, please.

One More Thing

And it's a big one. Mother Jones is launching a new Corruption Project to do deep, time-intensive reporting on the corruption that is both the cause and result of the crisis in our democracy.

The more we thought about how Mother Jones can have the most impact right now, the more we realized that so many stories come down to corruption: People with wealth and power putting their interests first—and often getting away with it.

Our goal is to understand how we got here and how we might get out. We're aiming to create a reporting position dedicated to uncovering corruption, build a team, and let them investigate for a year—publishing our stories in a concerted window: a special issue of our magazine, video and podcast series, and a dedicated online portal so they don't get lost in the daily deluge of headlines and breaking news.

We want to go all in, and we've got seed funding to get started—but we're looking to raise $500,000 in donations this spring so we can go even bigger. You can read about why we think this project is what the moment demands and what we hope to accomplish—and if you like how it sounds, please help us go big with a tax-deductible donation today.

We Recommend


Sign up for our newsletters

Subscribe and we'll send Mother Jones straight to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.


Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.