A popular program for teaching kids to read just took another hit to its credibility

New research could prompt schools to reexamine their investment in Reading Recovery, one of the world's most widely used reading intervention programs.
New research could prompt schools to reexamine their investment in Reading Recovery, one of the world’s most widely used reading intervention programs. Gary John Norman | Getty Images

One of the world’s most widely used reading intervention programs for young children has taken another hit to its credibility.

Reading Recovery — a one-on-one tutoring program for first graders — has long been controversial because it’s based on a theory about how people read that was disproven decades ago by cognitive scientists. A 2019 story by APM Reports helped bring public attention to the fact that reading programs based on this theory teach the strategies struggling readers use to get by. In other words: Children are taught to read the way that poor readers read.

Now, a new, federally funded study has found that, by third and fourth grade, children who received Reading Recovery had lower scores on state reading tests than a comparison group of children who did not receive Reading Recovery.

“It’s not what we expected, and it’s concerning,” said lead author Henry May, director of the Center for Research in Education and Social Policy at the University of Delaware. May delivered the findings at an April gathering of education researchers in San Diego.

At least 2.4 million students in the United States have participated in Reading Recovery or its Spanish-language counterpart since 1984, when the program first came to America from New Zealand. The program is also used in Australia, Canada and England, among other countries.

The new research could prompt schools to reexamine their investment in Reading Recovery, and consider other ways to help struggling first-graders.

The new research shows children make initial gains, then fall behind

May was the principal investigator of an earlier federally funded study of Reading Recovery, one of the largest ever randomized experiments of an instructional intervention in elementary schools. That study, which began in 2011, found evidence of large positive gains in first grade, as has other research. The program’s advocates have pointed to that research as evidence that the instructional approach is effective and based on sound science.

But whether the initial gains last and translate into better performance on state reading tests remained a question. This new study on the long-term impact of Reading Recovery is the largest, most rigorous effort to tackle that question, according to May.

The fact that students who participated in Reading Recovery did worse in later grades than similar students who did not get the program surprised May.

“Was Reading Recovery harmful? I wouldn’t go as far as to say that,” he said. “But what we do know is that the kids that got it for some reason ended up losing their gains and then falling behind.”

In a written response to the study, the Reading Recovery Council of North America, the organization that advocates for the program in the United States, disputed some of the research methodology and maintained that their program is effective. It also said: “Reading Recovery has and will continue to change in response to evidence gathered from a wide range of studies of both students having difficulties with early reading and writing and their teachers.”

U.S. schools have been dropping Reading Recovery

At one point, Reading Recovery was in every state. But school districts have been dropping the program – today, it’s in nearly 2,000 schools in 41 states, according to the most recent data.

In fact, the first district to implement the program in the U.S. recently decided to stop using it.

Leslie Kelly, executive director of teaching and learning at Columbus City Schools in Ohio, said the decision to drop Reading Recovery is part of a larger effort to bring “the science of reading” to the district. She said she and her colleagues realized that their approach to reading instruction, including Reading Recovery, didn’t align well with that science.

Her advice to other districts that are still using Reading Recovery is to take a close look at the program’s effectiveness: “Do your research. Read a lot, and really look at do you have evidence of impact? That’s really the key. Do you have evidence of impact, and how do you know? And if you don’t have evidence of impact, you have to ask yourself why and then what are you going to do about it?”

Reading Recovery was already controversial

Critics of Reading Recovery have long contended that children in the program do not receive enough explicit and systematic instruction in how to decode words. In addition, they say, children are taught to use context, pictures and other clues to identify words, a strategy that may work in first-grade books but becomes less effective as text becomes more difficult. They say kids can seem like good readers in first grade but fail to develop the skills they need to be good readers in the long run.

May said this could explain his latest research findings. “If you don’t build up those decoding skills, you’re going to fall behind, even though it looked like you had caught up in first grade.”

He said the results could also be explained by the fact that about 40% of the students who received Reading Recovery got no further intervention after first grade. “Because the kids didn’t get the intervention that they needed in second and third grade, they lost those gains,” May said. “I think that’s a plausible hypothesis.”

But the study also found that the students who were in Reading Recovery were more likely than the comparison group to receive extra help for reading after first grade. Advocates for Reading Recovery have justified the program’s high cost — estimated to be up to $10,271 per student — by saying that the program reduces the need for further reading intervention.

This new research comes as schools and states are looking for ways to help students recover from the disruptions of the pandemic, including disruptions to their reading development. May’s findings are something for policymakers and school leaders to consider as they make decisions about what programs to invest in.

Emily Hanford is a senior correspondent and Christopher Peak is a reporter for APM Reports, the documentary and investigative reporting group at American Public Media. This story was adapted from their earlier reporting. A collection of stories from APM Reports on how kids learn to read can be found here.

Copyright 2022 APM Reports. To see more, visit APM Reports.

Transcript :

ARI SHAPIRO, HOST:

Millions of kids struggle to read. To help them learn, some schools have gone all in on one of the world’s most widely used reading intervention programs. But according to a new federally funded study, that program may be doing more harm than good.

Emily Hanford of APM Reports has done a lot of reporting on how schools teach children to read. Hi, Emily.

EMILY HANFORD: Hi.

SHAPIRO: Let’s start with this program. What’s it called, and how do schools use it?

HANFORD: The program is called Reading Recovery. It’s for first-graders who are having the hardest time learning how to read. Those kids get one-on-one instruction with a teacher who has gone through extensive training in Reading Recovery methods, and those methods are controversial.

I did a reporting project back in 2019 where I showed that some of the strategies kids are taught in Reading Recovery are actually the strategies that struggling readers use to get by. In other words, kids are taught to read the way that poor readers read. But before this new study, existing research on Reading Recovery had shown the program was effective, at least in the short term. Kids made large positive gains in first grade.

SHAPIRO: OK. So there was evidence that it worked in the short term, but this new study took a longer view. What did it show?

HANFORD: Right. So a big question about Reading Recovery has always been whether those short-term gains translate into long-term success. This is the largest, most rigorous study to look at that question. It focused on how third- and fourth-graders did on state reading tests. And what the study found is that the kids who got Reading Recovery actually did worse than a comparison group.

SHAPIRO: And do researchers know why that is?

HANFORD: The researchers cannot say exactly why, but they have some ideas. One hypothesis is that kids in the program can seem like good readers in first grade, but Reading Recovery may fail to teach them the skills they need to be good readers in the long run. Another possibility is that they did worse because of instruction that they got or didn’t get after the first grade.

Henry May is the lead author of the study, and he was surprised by the negative results.

HENRY MAY: Was Reading Recovery harmful? I wouldn’t go so far as to say that. But what we do know is that the kids that got it, for some reason, they ended up losing their gains and then falling behind where they would have been expected to fall.

HANFORD: The Reading Recovery Council of North America is the organization that advocates for Reading Recovery in the United States. In a statement about the study, they disputed some of the methodology, and they maintained that their program is effective.

SHAPIRO: And in the meantime, are schools still using the program?

HANFORD: Yes, they are, and it’s an expensive program. It can cost more than $10,000 a year per child. At one point, it was in every state, but some districts have been dropping Reading Recovery. In fact, the very first U.S. district to use the program back in 1984 was Columbus, Ohio, and they recently decided to stop using it.

I talked to their executive director of teaching and learning. She told me the decision to drop Reading Recovery is part of a larger effort to bring what’s been dubbed the science of reading to Columbus City schools. She and her colleagues realized that their approach to reading instruction, including Reading Recovery, didn’t align well with that science. Her name is Leslie Kelly, and I asked her what advice she had for other districts still using Reading Recovery.

LESLIE KELLY: I would say be open; do your research; read a lot and really look at, do you have evidence of impact? That’s really the key. Do you have evidence of impact, and how do you know? And if you don’t have evidence of impact, you have to ask yourself why, and then what are you going to do about it?

HANFORD: There are many districts and even entire states right now that are looking carefully at how schools teach reading. And we know that COVID has had a big impact on kids’ reading development. This new research is something for policymakers and school leaders to consider as they make decisions about what programs to invest in.

SHAPIRO: That’s Emily Hanford of APM Reports. Thank you.

HANFORD: Thank you.

(SOUNDBITE OF MUSIC) Transcript provided by NPR, Copyright NPR.