A sweeping new review of national test data suggests the pandemic-driven jump to online learning has had little impact on children's reading growth and has only somewhat slowed gains in math. That positive news comes from the testing nonprofit NWEA and covers nearly 4.4 million U.S. students in grades three through eight. But the report also includes a worrying caveat: Many of the nation's most vulnerable students are missing from the data.
"Preliminary fall data suggests that, on average, students are faring better than we had feared," says Beth Tarasawa, head of research at NWEA, in a news release accompanying the report.
"While there's some good news here, we want to stress that not all students are represented in the data, especially from our most marginalized communities."
Until now, estimates of learning loss have been just that — estimates or projections, based on the kind of academic backsliding schools see after a long summer. This report offers the clearest picture yet of the impact that the past eight months of disruption have had on student learning.
The data at the heart of NWEA's report come from what's known to teachers and children alike as the MAP Growth test — a check-in assessment used to measure kids' math and reading skills that's generally given three times a year, in fall, winter and spring.
While millions of students took these MAP tests in the winter of 2020, few took them again in the spring as schools raced (and many struggled) to provide learning online. But this fall, nearly 4.4 million children did take the test, either from home or back in a classroom. And the results give researchers a vital new data point: a measure of where students are right now.
Tarasawa and her research team studied the data a few different ways. First, they compared students' performance this fall — in, say, third-grade reading — with the performance of a different group of students who took third-grade reading in the fall of 2019, before the coronavirus pandemic.
Tarasawa tells NPR that with this method of comparison, the results in reading were "relatively optimistic" because "kids on average are performing similarly to how [other children] did pre-pandemic." In math, the current pandemic class of students performed about 5 to 10 percentile points lower than the pre-pandemic comparison group — what Tarasawa describes as a "moderate" drop.
In addition to comparing two different groups of students, researchers also studied students' individual growth over time, looking at where they were when they took the MAP test in the winter of 2020 and comparing it with where they are now, in the fall of 2020.
"We saw, on average, students showed growth in both math and reading across the grade levels in almost all grades," says Tarasawa. "Most students made some learning gains in both reading and math since COVID started."
In short, students kept learning when schools shifted online; they just didn't learn quite as much in math as they likely would have if there had never been a pandemic.
Mitigating the learning loss that is happening will still require patience and a thoughtful approach, says Aaliyah Samuel, NWEA's executive vice president of government affairs and partnerships.
"Addressing the unfinished learning is going to be a matter of time. We really need to be thinking about the supports and interventions for kids over at least a two- or three-year runway."
Depending on the depth of learning lost, school districts could consider a range of options, including extending the school year or even enlisting a volunteer tutoring corps.