testing takeaways

A decade of stagnation: Little progress on closely watched federal test, as big disparities persist

Scores on the exams known as the “nation’s report card” have barely budged over the last two years, new data show.

The minimal progress on the federal math and reading exams given to fourth and eighth graders will be a disappointment to officials who have hoped that their policies would boost students’ performance or help close yawning gaps between groups of students.

The 2017 results also mean that the U.S. has seen its test scores largely stagnate for a decade, after 10 years of substantial gains in math. The country’s “achievement gaps” between black and white students, and between low-income and affluent students, have also largely held steady over the last 10 years.

“I’m pleased that eighth-grade reading scores improved slightly but remain disappointed that only about one-third of America’s fourth- and eighth-grade students read at the NAEP Proficient level,” said former Michigan Governor John Engler, the chair of the National Assessment Governing Board, which oversees the tests. “We are seeing troubling gaps between the highest- and lowest-performing students. We must do better for all children.”

In an era when standardized testing is commonplace, the National Assessment of Educational Progress is the rare exam with low stakes for individual students and schools, but high stakes for politicians and policymakers. Some education leaders have staked their own reputations on NAEP results.

But score analyzers, beware: It’s difficult to draw conclusions about the benefits of specific policies based on the results. NCES, the federal agency that administers the tests, warns against it.

Some have also questioned what the transition to digital assessments means for the trends in individual state results, though NCES insists that extensive efforts have been made to account for this change.

Still, advocates on all sides will use them to argue for their preferred changes to education policy. U.S. Secretary of Education Betsy DeVos has already praised the gains in one state, Florida, and highlighted the disappointing national results. “The report card is in, and the results are clear: We can and we must do better for America’s students,” she said.

What you should know about NAEP and this year’s scores

The National Assessment of Educational Progress is administered by the federal government to a sample of students across the country. The most closely watched tests are the fourth- and eighth-grade math and reading exams, since they show how scores are changing nationally, in individual states, and in a number of cities.

The 2017 results showed only tiny differences from 2015: a loss of 1 point in both subjects in fourth grade, and a gain of 1 point in both subjects in eighth grade. Only the grade eight reading improvement was statistically significant compared to the last test.

(One way to think about how big that is: the difference between the “basic” and the “proficiency” benchmarks is about 35 points, depending on the test.)

Most students did not reach the test’s “proficient” benchmark, which is considered a high bar to clear. But some groups of students remain further behind.

Exam Share of students scoring ‘proficient’ and above Share scoring ‘basic’ and above
Fourth-grade math 40% 80%
Eighth-grade math 34% 70%
Fourth-grade reading 37% 68%
Eighth-grade reading 36% 76%

In eighth-grade math, the average black student scored just below the “basic” benchmark, while the average white student came several points shy of the higher “proficient” benchmark. Forty-four percent of white students were proficient, compared to 20 percent of Hispanic students and 13 percent of black students.

Gaps were similarly large between students who did and did not qualify for free or reduced-price lunch, a common proxy for poverty.

While test score gaps by race and poverty remained static, there was a notable increase in the difference in performance between the highest achieving students and the lowest-achieving ones.

As expected, some states and cities saw their scores rise and fall modestly, though the vast majority held steady. Alaska, Louisiana, New Hampshire, South Carolina, and Vermont saw statistically significant declines on two or more tests, while Florida was the only state that made significant gains on multiple tests. None of the state improvements or drops were more than 6 points.

Eighth grade reading scores over time

Fourth grade math scores over time

Source: National Center for Education Statistics. Graphics by Sam Park.

Louisiana, New Mexico, and Mississippi students continued to rank at or near the bottom, while Massachusetts, New Jersey, and New Hampshire students perform consistently well.

(Since state demographics vary — and NAEP results are highly correlated with race and poverty — research has tried to account to for that to better isolate performance of schools, and those rankings differ significantly.)

The longer-run trends in NAEP are more positive than the latest results. Nationally, scores have improved substantially in math and modestly in reading since the early 1990s.

What’s the deal with the flat scores?

It’s unclear why scores are flat. NCES, which administers the exam, says the scores could be influenced by specific policies, resources available to schools, and demographics.

That’s a frustrating limitation for policymakers who want clear solutions. It’s also unlikely to stop the finger-pointing and policy prescriptions.

Critics of the reform efforts that prevailed under the Obama administration — the expansion of charter schools, introduction of the Common Core learning standards, and the creation of new teacher evaluation systems — will likely see the results as vindication, even as supporters use the latest data to argue that public schools need substantial change.

A handful of careful statistical analyses have tried to gauge how certain policies have affected NAEP scores in the past. For instance, one recent study found that states that made greater cuts in school funding in response to the Great Recession saw worse NAEP scores as a result; an older study found that an infusion of school funding led to greater NAEP gains.

Other research has found that when states introduce stringent school accountability systems, they do better on the NAEP math tests.

Special education reorganization

Only 33 black students with disabilities in Denver met expectations on state tests

Just 2 percent of black students with disabilities in Denver scored at grade-level or higher on state literacy and math tests last year. In raw numbers, that’s just 33 of the 1,641 black students with disabilities in the school district, according to Denver Public Schools data.

The percentage is similar for Latino students with disabilities: only 2.6 percent met expectations on the tests. Meanwhile, nearly 17 percent of white students with disabilities did.

Denver school officials recently revealed those shockingly low numbers and stark racial disparities as further justification for a previously proposed reorganization of the department that oversees special education. The reorganization would shrink the pool of central office staff who help school principals serve students with disabilities, and would increase the number of school psychologists and social workers.

The theory is that providing more robust mental health services in schools will allow the central office staff members who remain to shift their focus from managing behavior crises to improving academic instruction. Because of their expertise, those staff members were often tapped to help teachers deal with challenging behavior from all students, not just those with disabilities, said Eldridge Greer, who oversees special education for Denver Public Schools.

District officials also hope that increasing mental health support will reduce racial disparities in how students are disciplined. District data show black students are six times as likely to be suspended as white students, while Latino students are three times as likely.

“The biases that are in place in our society unfairly target African-American and Latino children to be controlled as a response to trauma, or as a response to readiness-to-learn (issues), instead of being provided more educational support,” Greer said.

Parents of students with disabilities have pushed back against the district’s plan to cut staff dedicated to special education. Advocates have, too.

Pam Bisceglia, executive director of Advocacy Denver, a civil rights organization that serves people with disabilities, said that while the district should be embarrassed by how poorly it’s serving students of color, she’s not sure the proposed reorganization will help.

She and others worry the district is siphoning money from special education to pay for services that will benefit all students – and that in the end, those with disabilities will lose out.

“If the district wants to have a full-time social worker and psychologist in every school, I don’t have a problem with that,” Bisceglia said. “What I have a problem with is the plan doesn’t suggest how instruction is going to look different (for students with disabilities) and how the curriculum is going to be different in terms of learning to read and do math.”

Greer said that in large part, the curriculum and strategies the district has in place are the right ones. What’s lacking, he said, is training for special education teachers, especially those who are new to the profession. Having a cadre of central office staff focused solely on academics will help, he said.

The reorganization, as detailed at a recent school board meeting, calls for cutting 45 districtwide experts who help principals serve students with disabilities – and who Greer said spent a lot of time managing behavior crises. In their place, the district would hire 15 academic specialists, eight more behavior specialists (the district already has seven), and four supervisors.

The overhaul would also ensure that all elementary schools have at least one full-time social worker or psychologist. Schools would also get money to put in place new discipline practices. The school board last year revised its discipline policy to limit suspensions and expulsions of students in preschool through third grade.

In addition, elementary schools with special programs for students with emotional needs would get $50,000 to spend on a mental health worker, teacher, or teacher’s aide.

School principals invited to discuss the reorganization with the school board said they welcomed being able to hire more social workers and psychologists. But they said they are unsure about the rest of the plan.

One principal said he relied heavily on the expert assigned to help his school serve students with disabilities. Another expressed concern about losing capable staff.

“How do we retain some of that talent so we don’t end up with a brain drain and lose all these people that have all this knowledge and expertise?” said Gilberto Muñoz, the principal at Swansea Elementary School in north Denver.

When district officials first presented the plan earlier this year, they framed it as a way to improve the academic performance of students with disabilities. Just 8 percent of Denver fourth-graders with disabilities met expectations on the state literacy test last year, compared with 44 percent of fourth-graders without disabilities.

But Greer said that when they dug into the data, they discovered the racial disparities.

“We knew there were disparities, but to see disparities as profound as the ones I shared with the board, it was important to elevate that,” he said.

Parent Sarah Young said it was courageous of the district to share such shocking data. But she said she thinks their plan to fix the disparities is lacking – and she disagrees with calling it a reorganization.

Young, who has a daughter with a learning disability, visual impairment, and epilepsy, said Denver Public Schools should call the plan what it is: cuts to special education.

“We understand you’re trying to handle behavior,” Young said, referring to the district. “But these are all vulnerable student populations, and we can’t pit them against each other. We can’t be robbing one to try to put a Band-Aid on another.”

Interrupted

BREAKING: Severed fiber optic line disrupts TNReady testing across Tennessee

PHOTO: Alan Petersime

Online testing for Tennessee students was disrupted again on Thursday, this time due to the severing of a main fiber cable between Nashville and Atlanta.

The problems arose in the morning soon after testing began for TNReady, the state’s standardized test, as internet connectivity slowed and traffic was routed to backup channels.

“This is an issue related to local connectivity, not with the testing platform,” said Sara Gast, a spokeswoman for the state Department of Education. “Testing can continue, but connectivity may be slow in areas that are impacted until this is resolved.”

Many districts chose to suspend testing for the day, while others left the decision up to school principals.

In Memphis, home to the state’s largest district, a spokeswoman for Shelby County Schools said students were “not able to connect” to the state’s online platform and that principals would decide whether to keep trying.

TNReady’s online test has experienced widespread interruptions on at least four days since the state’s three-week testing window opened on April 16. There were log-in issues on the first day, a reported cyber attack on the second, and a problem with online rosters on Wednesday after the state’s testing company, Questar, updated its software the night before.

Concerns about the subsequent validity of the results prompted state lawmakers to pass two pieces of legislation — the latest one on Wednesday — aimed at preventing students, teachers, schools, and districts from being negatively impacted by the data.

The online issues are affecting high school students statewide. Some districts also chose to expand computerized testing this year to middle grades. For the states’s youngest students, TNReady was being given on paper.

This story has been updated.