Links and Commentary 10/17/25

Math Recovers, Social Media and Cognition, A Eulogy for Teaching, Spicy AI Grading Commentary, Vouchers Close Public Schools

Welcome to Scholastic Alchemy! I’m James and I write mostly about education. I find it fascinating and at the same time maddening. Scholastic Alchemy is my attempt to make sense of and explain the perpetual oddities around education, as well as to share my thoughts on related topics. On Wednesdays I post a long-ish dive into a topic of my choosing. On Fridays I post some links I’ve encountered that week and some commentary about what I’m sharing. Scholastic Alchemy will remain free for the foreseeable future but if you like my work and want to support me, please consider a paid subscription. If you have objections to Substack as a platform, I maintain a parallel version using BeeHiiv and you can subscribe there.

Math Recovers

Okay, I have to be honest, the link I’m going to share about math is really just a way to talk about some of the extra-scholastic and non-governmental influences on education. There was some good news from the purveyors of the MAP assessment. Students’ math MAP scores are recovering from their pandemic lows and gaps between various demographic subgroups are narrowing.

Gaps in math test scores based on race and ethnicity as well as household income remain large but appear to be narrowing. For example, the gap between students at high-poverty schools and the national average in third-grade math shrank by about a third from spring 2021 to spring 2025. The gap for Hispanic students in third-grade math shrunk by about 41%, while the gap for Black students was about 27% smaller.

The authors include some important caveats and draw a comparison with the NAEP.

The data released Tuesday comes from MAP Growth Assessments given three times a year to more than 7 million students in grades three through eight in 20,000 schools.

These students attend schools that choose to give the MAP test, while students who take the National Assessment of Educational Progress, or NAEP, reflect a statistically representative sample. The MAP data comes from the 2024-25 school year, while the most recent NAEP results come from spring 2024. NWEA weighted the results for students from certain subgroups to ensure the results were more representative.

It’s important to know that the testing data is weighted rather than having a statistically representative sample from the get-go. While it does not mean that the test data is bad or should be ignored, you should expect the MAP data to display a bit more variation than the NAEP data. Statistical weighting is credible and done in all kinds of studies and fields, but it increases the margins around which we can draw any certain conclusions from the results. Either way, this is good news and is directionally aligned with what we see in the NAEP math data. Test score recovery from the pandemic has been slow but is happening.

BUT, the other thing that I thought was so interesting about this is who the makers of the MAP tests are, the Northwest Evaluation Association, or NWEA. Sometime back in the 1970s a bunch of regional non-profit groups were spun up by various philanthropic foundations in order to conduct policy analysis. There’s a Midwestern Evaluation Association and a Southwest Evaluation Association, though I didn’t see one for the Southeast or Northeast or any other regions. It turns out, some have shuttered or been absorbed into other non-profits while other regions, like the Northeast, were covered by Educational Testing Service, ETS. Still other states refused to participate at all. Over the years, only the NWEA, based out of Portland, OR is still following its original mission of conducting educational policy evaluation. However, in the 1990s they started developing their own computer-based testing suite, the Measurment of Academic Progress, MAP.

When education comes up as a topic of discussion, often we think of the people who are influential as students and parents, various levels of government, teachers and maybe the teachers unions. Maybe more broadly we consider curriculum publishers or testing companies or EdTech vendors as influential. We rarely look at the constellation of non-profit organizations that are often deeply embedded in the day-to-day functioning of schools. NEWA, though, is no longer an independent non-profit. In 2023, the NEWA was acquired by educational publisher Houghton Mifflin Harcourt.

Education giant Houghton Mifflin Harcourt will acquire well-known K-12 assessment provider NWEA, in a pairing of two of the biggest and most influential companies in the nation’s schools.

NWEA will operate as a division of HMH, and its assessment solutions will be integrated with HMH curriculum

Meanwhile, Houghton Mifflin Harcourt was purchased by private equity firm Veritas Capital who interestingly enough purchased the company that had purchased the assessment division from the American Institutes of Research back in 2019. This makes Veritas Capital one of the largest educational publishers, largest curriculum developers, and one of the largest educational assessment operations in the country with an educational technology wing that has a product in 90% of US public schools.

“With accelerating billings growth, strong free cash flow and a transformed cost structure, we are at an important inflection point, and the time is right to move into the next phase of our long-term growth strategy alongside a partner that brings significant industry expertise,” [CEO] Lynch said in a statement.

PE firms have, in recent years, sought to control companies that contract out primarily to government or earn income from governmental sources, such as nursing homes, daycares, or it seems, education assessment organizations. Good or bad? I guess we’ll see, but it certainly is consolidated.

Social Media and Cognition

A recent article in the Journal of the American Medical Association looked at the cognitive consequences of youth social media use.

source

This analysis found that both low and high increases in social media use throughout early adolescence were significantly associated with lower performance in specific aspects of cognitive function, supporting a prior finding that greater screen time was negatively but weakly associated with adolescent cognitive performance.5 Overall, the differences in mean scores were small relative to the NIH Toolbox standard deviation of 15. Previous literature has hypothesized that social media use replacing more educational activities or schoolwork may explain the association between social media use and lower cognitive performance.6 The specific associations between increasing social media use and poorer performance on the ORRT and PVT, which tests stored language knowledge, support this hypothesis. The finding that even low levels of early adolescent social media exposure were linked to poorer cognitive performance may suggest support for stricter age restrictions. Limitations of this study include self-reported social media data, potential residual confounding, and an observational study design that precludes inferring that social media trajectories cause worse cognitive performance. Future studies should examine how specific social media platforms and content relate to cognitive outcomes.

You know, I’ve been writing a lot recently about NAEP scores, especially ELA scores and how any gains in 4th grade seem to fizzle by 8th. And then I see that MAP scores in math are improving, similar to smaller improvements on the math NAEP. And here’s this study which notes that the specific cognitive deficits from social media use appear to be in “stored language knowledge.” It all kinda makes sense, doesn’t it? Older kids with higher social media use have these language deficits whereas young kids who aren’t exposed yet wouldn’t? Anyway, it’s yet another data point against letting young adolescents have phones and use social media.

A Eulogy for Teaching

I’ve linked English teacher, Adrian Neibauer’s newsletter before, as well as a podcast he’s participated in. This week he penned a post called The Cost of Standardization and I highly recommend it. I commented on the post that it reads like a eulogy, as though his teaching has died, sacrificed at the altar of standardization. He’s dealing with something that I encountered as a new teacher: same way, same day. The idea is that every classroom in every school needs to teach at the same pace and with the same methods, often down to asking the teachers to read from scrips. Administrators where I was (we were never observed by other teachers) said they wanted to be able to leave our classrooms and drive across Gwinnett County to another school and find kids on the same lesson moving at the same pace. Adrian:

When I first started teaching, I had the ability to take whichever curriculum was presented to me, and make it my own. I could choose how I wanted students to engage with the required content standards. Instead of reading an excerpt from a basal reader, looking for the main idea, I could have students read novels and discuss themes, character development, and other literary elements. In the past, I had more professional agency to determine how I wanted to engage my students in the content. I could design transdisciplinary units, addressing multiple standards simultaneously. Unfortunately, this is no longer an option. Our district is doubling-down on using standardized curricular resources and standardized pedagogy to create standardized learning cycles. This means teaching a single content standard to all students using identical Tier 1 instruction, using standardized, formative assessments to determine which students are meeting (or not) that standard. Then, regrouping students for standardized Tier 2 interventions and extension support. All teachers are now required to teach the same thing on the same day in the same way repeatedly for 15-day learning cycles until everyone has mastered that discrete standard.

I am not engaging my students’ creativity or critical thinking skills. I am not tapping into their schema and connecting the content with their personal identities. I am not encouraging them to think for themselves or wrestle with complex ideas. I am merely managing academic tasks. Students are not reading well-written stories or having meaningful, student-centered discussions. They are not building on each other’s ideas, supporting their views with evidence, or engaging in dialogue with their peers. Students are reading AI-generated texts, locating details, selecting main ideas, and writing CERs. What’s worse is that these 15-Day Challenge cycles are set to repeat continuously throughout the year. One 15-Day Challenge after another until teachers have “taught” every academic standard required by the state, all to increase test scores.

I will note that this is exactly the kind of instruction people like Natalie Wexler have been criticizing for years and that she continues to call out today. 

…when it comes to “reading” or literacy, a fundamental problem is that the predominant approach treats reading comprehension—and writing—as sets of skills that can be taught in the abstract. Rather than teaching students to mine texts for whatever meaning they might have, most schools try to use them as vehicles for teaching skills like making inferences, finding the main idea of a text, or thinking critically. These are the skills that standardized reading tests purport to measure.

Surely, you may be thinking, those skills are worth teaching. It’s impossible to provide kids with all the information they’ll need to know in the future. Anyway, they can always use Google or AI to get answers to factual questions. Why not teach them skills they’ll be able to apply for the rest of their lives?

The problem is that skills like making inferences aren’t transferable. Readers can apply them only if they have enough relevant knowledge. It’s easy to make an inference about a text on a topic you know a lot about—so easy you may not realize you’re doing it. And it might be impossible to make an inference if the text is on a topic you’ve never heard of. So the key to developing those comprehension abilities is developing knowledge, which—especially at the elementary level—most schools have failed to do.

Natalie is right! The act of reading (and writing, for that matter) is not merely a jumble of discrete independent skills all happening independently. When we break reading down into these skills, we are making kids good test takers, but we are not promoting literacy. When we teach in this way, as Adrian says, we are merely simulating reading and writing. Kids are getting a testable facsimile of the real thing. When we teach in this way, we are merely simulating teaching. Toward the end, Adrian gives us a glimpse of his worries for his students.

Some nights, I lie awake wondering what my students will be like after high school or college, having spent their entire academic careers filling in prescribed boxes. How will they succeed in the world with no practice in asking questions or thinking for themselves? Will these high reading scores gain them easy entry into college? Once admitted, how can they be expected to evaluate information, question assumptions, and form independent conclusions rather than simply memorize facts?

We’re already here, aren’t we? We air complaints of kids being unable to read whole books or even longer passages. We hear that they can’t hold complex thoughts and need extensive support in navigating multi-step assignments. We’re told they are happy to cheat with AI because they don’t feel like doing even moderate workloads. Adrian has, perhaps, been lucky that this harsh new standardized reality is new to him while many others around the country have been teaching and learning in this way for years.

When I wrote that the people hate standardization, this is what I had in mind. There’s always so much focus on standardized testing, which some people don’t like and will opt their kids out of, but the larger underappreciated problem is the changes that accountability testing brings to the classroom. While I may have said, “it’s the tests stupid” what I mean isn’t that the tests themselves are always so objectionable. Instead, parents and the public dislike schools where the paramount value is producing high test scores. What’s more, because the tests are seen as external to the school, parents see themselves as losing control of what’s happening in their ostensibly locally controlled schools. Kids aren’t happy. Parents aren’t happy. Teachers aren’t happy. Nobody’s learning anything real, merely test skills. But, this all serves a larger purpose. Here’s what I said at the end of August.

Parents do not equate standardization and testing with rigor and quality. When public schools become focused on standardization and achieving high test scores, parents see this as bad and become more receptive to alternatives. Anti-school conservatives are there, ready to take your kid to Disney to learn fractions from Snow White on the taxpayer’s dime. And, it appears that parents are willing to take on the burden of being the executor and guarantor of their children’s education if it means they escape systems of testing and standards.

Spicy AI Grading Commentary

Writer and writing instructor John Warner says that if you use AI to grade student writing, you should either stop or quit your job. You’ll recognize some of the themes Adrian mentions in his post.

I have been making the case against algorithmic grading long before ChatGPT showed up. This piece dates from 2013 and was predicated by the enthusiasm of the developers of MOOCs who saw grading automation as a way to deliver these courses “at scale.”

Those attempts failed, as did MOOCs, when it comes to taking over the lion’s share of our post-secondary educational system, not only because of technical limitations, but because people recognized there is value in the human exchange of reading and writing. We should not give this thing of value over to a simulation, no matter how convincing that simulation may now have become.

It is an abandonment of our humanity for no discernible gain beyond efficiency. As I’ve written in this newsletter previously, efficiency is not a value we should associate with learning. Learning is rooted in connection, engagement, and productive friction.

Back in May, I called this Dead Schooling Theory. The idea is that if kids are using AI to do the work and teachers are using AI to assess the work and give feedback, then what we really have is AI talking to AI. There’s no need for a living human in the mix at all. It’s dead. Might as well let AI take the standardized tests, too.

Vouchers Close Public Schools

I missed an article from WaPo last month about how public schools in Arizona are closing because they’re losing too many funds to vouchers. The problem is, these schools are often still serving hundreds of kids but on the shoestring budgets the state gives them, even just a few kids leaving for vouchers leads to districts needing to close the schools and consolidate them. Yet, the vouchers are almost entirely going to the wealthiest families in Arizona and to the families of children who never attended public school in the first place. Because so many voucher recipients were new to the public funding, the cost of the program ballooned way beyond projections. This led to the state having a major budget shortfall in 2024 and needing to cut other services just to prevent a total collapse of state’s finances. As WaPo notes, it’s even worse this year:

The expansive voucher program also has strained the state budget, with costs projected to top $1 billion this year, far more than originally projected. Because many voucher students were already attending private schools, including many from wealthy families, funding them is a new expense for the state. That’s drained dollars, critics say, that could and should go to public education in a state that ranks 47th in spending on K-12 per-pupil spending.

emphasis added

Seems bad! Surely they’re at least providing a higher quality education? Right?

John Ward, the head of Arizona’s ESA program, told me that the state hasn’t authorized any mandatory assessments for its ESA students; he doesn’t even necessarily know where they go to school. Horne, his boss, put the matter to me squarely: “The philosophy of the legislature when they passed universal ESAs was that the accountability will come from parents.” There are no enforceable curriculum standards—and this, Ward told me, is part of the appeal. Parents of children in microschools tend to see standardized tests as reflecting “a curriculum that has been chosen and essentially developed by public school systems,” he explained. “Because [these schools] are doing something different than what the public schools are doing, those tests wouldn’t measure what they’re doing in their curriculum. It would be a poor metric applied to what they actually do.”

Oh. You get what you pay for. Unless you don’t. Why bother checking?

Thanks for reading!