When Discussing Education, Beware Of Averages
From Forbes. com. David Lapp’s testimony for the state funding commission knocked a thought loose.
Consider a household with four family members, two adults and two small children. We could compute the average size and weight of the family, but we would end up with data points that don’t describe anyone in that family.
Education often falls into that trap. It’s natural to want to use averages to describe a huge group of individuals, but the result is often extremely misleading.
Take concerns about average test results for standardized tests like the ACT or SAT. The tests are elective (in most states), so changes in the population taking the test can affect the overall averages. In New Jersey, every college is now SAT optional, meaning that no students have to take the SAT. Other states require all students to take the SAT, whether they plan to attend college or not. Both changes affect the test-taking population and therefor potentially shift the average score in ways that do not represent student learning.
Put another way, if Pat was a typical SAT taker ten years ago, Pat might today get exactly the same score as a decade ago, but the cohort of people taking the test with Pat has changed enough to make the average score change. The change shows a change in the test-taking population, not in the test-taking capabilities.
Pennsylvania is an example of how averages can be used to obscure serious issues. David Lapp, Director of Policy Research for Research for Action, a nonprofit education research organization testified before the state’s Basic Education Funding Commission. Commenting on the state’s extreme education inequity, Lapp pointed out, “Every metric tells the same story. Pennsylvania boasts average or slightly above average achievement, either in funding, in opportunity, and in overall achievement.” But those averages conceal “nation-leading inequity. There are gaps in funding, gaps in opportunity, and gaps in achievement.”