Why Johnny Can Read

Going To School - Jules Bastien-Lepage (1882) - Oil on canvasEarlier this week, I read an article that really made me reconsider my tentative decision to send my child to private school. More Parents Uproot Their Lives In Search of a Perfect Education tells the story of the O’Gorman family, who basically sacrificed the home their children had grown up in and their lifelong social environment in order to enroll their children in a private school in another state. Why? They felt that the educational options near them were not good enough for their child and they were willing to drop $50,000 a year on that assumption.

In the past, I’ve been a big believer in private school for my child, as I bought into the general idea that not only are America’s public schools vastly inferior to private schools, but they were also far worse than public schools in other countries as well. This fact is consistently pounded into our head by not only the mainstream media, but also by the government itself via the National Assessment of Educational Progress.

What’s the basis for this criticism of America’s schools?

One big piece of this criticism comes from documentation produced by the National Assessment of Educational Progress. In particular, in July 2006, they released a report entitled Comparing Private Schools and Public Schools Using Hierarchical Linear Modeling (link goes to pdf of the report).

Right off the bat in this report, when discussing fourth grade reading, the report says “the average private school mean reading score was 14.7 points higher than the average public school reading score.” Wow, that’s a talking point right there, isn’t it? From just that sentence alone, media reports condemning the public schools in America flew forth, probably helping the O’Gorman family to make their $50,000 decision.

But the next sentence is quite interesting: “After adjusting for selected student characteristics, the difference in means was near zero and not significant.” What does that mean? It merely means if they divide the fourth graders up into smaller pieces of pie (such as divisions based on race, income level, and so forth) and compared equivalent pie pieces between private schools and public schools, there was no statistical difference between private schools and public schools.

How can this possibly be? This is the result of a statistical phenomenon known as Simpson’s paradox.

Simpson’s paradox says that the successes of several groups appear to be reversed when the statistics are combined

Let me show you how this works. Let’s say that we wanted to compare private school students and public school students based solely on the income levels of their parents. Of the 50,000 public school students tested, 49,000 had parents that made less than $200,000 a year, while only 1,000 had parents that made more than $200,000. On the other hand, of the 50,000 private school students tested, only 1,000 had parents that made less than $200,000 a year, while 49,000 had parents that made more than $200,000 a year.

Now, according to this report, all of the students whose parents made more than $200,000 a year, regardless of whether the school was private or public, did roughly the same on these tests – let’s say these students averaged a 90 on the test, while the poorer students averaged a 70 on the test. If you look at just the private schools, their students averaged an 89.6 on the tests, while the public school students averaged a 70.4 on the tests even though all of the poor children did the same and the rich children did the same regardless of their schooling.

This paper fell completely into Simpson’s paradox

It actually reports that public education and private education in America are roughly equal, even though private school students score higher. Why? Demographics. Private school test scores are better because the demographics of their students are tilted highly towards groups that do well no matter whether they’re schooled in public or private schools.

If you’re paying for private school, you’re not paying for a great education – you’re paying for demographics

The report actually says that on average, your student won’t do better on standardized tests in private school compared to public school; the only thing that makes a difference is their race, their income level, and their parents’ involvement in their education.

You know all of those doomsday stories about how America’s schools are falling behind those of other nations? Those reports are similarly flawed because of Simpson’s paradox.

Take South Korea, for example. Their test scores in math and science dominate America and I do admire their strong education system. But read that article more closely: only 60% of their students of high school age actually attend high school; the “bottom” 40% are actually funneled into separate vocational schools. Thus, when standardized tests compare 12th graders in Korea and 12th graders in the United States, if you individual compare demographic groups, the United States does at least as well as Korea, but if you combine all students as a whole, South Korea appears to dominate the United States. That’s because their high schools, much like private schools in the United States, are full of students whose personal demographics are universally geared towards greater educational success regardless of the schools.

This same phenomenon is true in many countries; the United States is relatively rare in that they place all students in the same high schools and they have compulsory attendance requirements. Most of the nations that exceed the United States in average scores have high schools that are demographically skewed in some fashion.

The best investment you can make in your child’s education is by being involved.

Your involvement is a factor you can control – your race and (to a degree) your other demographics can’t be changed. Instead of dropping $50,000 on getting your kid into that ultimate private school, tone down your career a bit and get involved: find out what your child is interested in, be involved and interested in their homework, and let them know that they really are important to you. Love is the one investment in your child that can really pay off.