student growth

Here’s why people are talking about Tennessee, a ‘bright green rectangle’ on a new U.S. map of student growth

As recently as 2009, Tennessee was considered a cellar dweller when it came to student performance on national tests known as the Nation’s Report Card.

Maps depicting student proficiency in math and reading showed Tennessee consistently scoring below basic on the National Assessment of Educational Progress, or NAEP — considered the gold standard of student assessments — even as neighboring states such as Kentucky, Arkansas and Mississippi fared better.

But now a new map based on a Stanford researcher’s analysis — showing high-growth districts in shades of green and low-growth districts in purple — has people talking, including Kevin Huffman, the state’s former education commissioner.

The analysis, released this month by Stanford’s Center for Education Policy Analysis, is the largest of its kind. Author Sean Reardon examined standardized tests taken by students across more than 11,000 school districts from 2009 to 2015. He used NAEP data to link the scores across states and controlled for differences on state tests by converting school performance to a common scale that measures growth in grade levels. Specifically, he looked at two things: 1) average student performance in third-grade math and English tests; and 2) student test score growth between the third and eighth grades.

Tennessee has never turned heads when it comes to proficiency on national tests but, based on several batches of NAEP scores and now Reardon’s map, it’s raising eyebrows on student growth.

“The first thing that jumps out at you on the map is: ‘Who is that little green rectangle in the middle?’ And that little green rectangle, of course, is us,” said Nakia Towns, Tennessee’s assistant education commissioner, during a presentation last week to a state task force on testing.

Reports on Reardon’s work have garnered Tennessee mentions in publications like The New York Times and this clear shout-out from Mother Jones: “Tennessee is a green oasis in the middle of a desert of purple. Someone should figure out what they’re doing right.”

Reardon says the green “suggests that there’s something behind the higher growth rates for Tennessee students than for students elsewhere in the Southeast. But it doesn’t tell us what caused it or why it happened.”

Tennessee officials are quick to pin the growth on a statewide overhaul of K-12 education grounded in higher academic standards, aligned assessments, and across-the-board accountability for districts, schools, teachers and students. That includes its controversial policy to incorporate growth from standardized test scores into teacher evaluations as part of the state’s 2010 First to the Top plan.

“We as Tennesseans made the right call — the tough call — on the policies we’ve pursued,” Education Commissioner Candice McQueen told Chalkbeat. “Nearly every other state has compromised in some way on some of these core foundational components of policy work, and we have not.”

PHOTO: Kayleigh Skinner
Gov. Bill Haslam poses with students at Riverwood Elementary School in Cordova, where he celebrated Tennessee’s 2015 NAEP results.

She added that state and district leaders have collaborated to provide training and coaching supports along the way; educators have stepped up their game in the classroom; and two governors (one Democrat, one Republican) and multiple iterations of legislatures have stayed the course on Tennessee’s overall blueprint for improvement, even as major challenges have emerged.

The Stanford analysis adds credibility to the consolation prize that Tennessee officials have touted since the release of 2013 NAEP scores. Tennessee is the nation’s fastest-improving state in math and reading, they say, even as some naysayers have questioned the superlative.

Since 2011, the state’s national ranking has risen from 46th to 25th in fourth-grade math, 41st to 36th in fourth-grade reading, 45th to 37th in eighth-grade math, and 41st to 30th in eighth-grade reading.

Now, Tennessee is waiting anxiously to see if this year’s NAEP scores, to be released early next year, will support that narrative and advance its goal of ranking in the top half of states by 2019.

PHOTO: TDOE

In the meantime, Reardon’s analysis is helping districts compare their quality of education with their peers, and it’s highlighting school systems that are excelling in academic growth, including those in high-poverty areas. (His research was supported by several foundations, including the Bill & Melinda Gates Foundation, which also provides funding to Chalkbeat.)

“Tennessee’s average scores are lower than other states, but their growth rates are a little higher,” Reardon said. “That suggests that kids in Tennessee aren’t getting the same kinds of opportunities early on, but they seem to be having opportunities to learn from third to eighth grade.”

For Towns, who oversees data and research for Tennessee’s education department, the map shows in stark terms that it’s not just something in the water when it comes to her state’s student growth, particularly when comparing border districts with their counterparts just across the line in eight other southeastern states. For the most part, it’s green in Tennessee, purple across the line.

“These are people who go to church together, probably shop at the same WalMart, work together across state lines,” she said. “… There’s not a difference in the kinds of students served, but there’s a big difference in the (education) policy context.”

How effective was your Tennessee district?

Use the search box below to learn how much average student growth your local school district* achieved in five years.

*Shelby County’s listing is pre-merger and broken down as Memphis City Schools and Shelby County Schools (legacy); Metropolitan Nashville Public Schools is listed as Davidson County Schools.

testing testing

McQueen declares online practice test of TNReady a success

PHOTO: Manuel Breva Colmeiro/Getty Images

Tennessee’s computer testing platform held steady Tuesday as thousands of students logged on to test the test that lumbered through fits and starts last spring.

Hours after completing the 40-minute simulation with the help of more than a third of the state’s school districts, Education Commissioner Candice McQueen declared the practice run a success.

“We saw what we expected to see: a high volume of students are able to be on the testing platform simultaneously, and they are able to log on and submit practice tests in an overlapping way across Tennessee’s two time zones,” McQueen wrote district superintendents in a celebratory email.

McQueen ordered the “verification test” as a precaution to ensure that Questar, the state’s testing company, had fixed the bugs that contributed to widespread technical snafus and disruptions in April.

The spot check also allowed students to gain experience with the online platform and TNReady content.

“Within the next week, the districts that participated will receive a score report for all students that took a practice test to provide some information about students’ performance that can help inform their teachers’ instruction,” McQueen wrote.

The mock test simulated real testing conditions that schools will face this school year, with students on Eastern Time submitting their exams while students on Central Time were logging on.

In all, about 50,000 students across 51 districts participated, far more than the 30,000 high schoolers who will take their exams online after Thanksgiving in this school year’s first round of TNReady testing. Another simulation is planned before April when the vast majority of testing begins both online and with paper materials.

McQueen said her department will gather feedback this week from districts that participated in the simulation.

testing 1-2-3

Tennessee students to test the test under reworked computer platform

PHOTO: Getty Images

About 45,000 students in a third of Tennessee districts will log on Tuesday for a 40-minute simulation to make sure the state’s testing company has worked the bugs out of its online platform.

That platform, called Nextera, was rife with glitches last spring, disrupting days of testing and mostly disqualifying the results from the state’s accountability systems for students, teachers, and schools.

This week’s simulation is designed to make sure those technical problems don’t happen again under Questar, which in June will finish out its contract to administer the state’s TNReady assessment.

Tuesday’s trial run will begin at 8:30 a.m. Central Time and 9 a.m. Eastern Time in participating schools statewide to simulate testing scheduled for Nov. 26-Dec. 14, when some high school students will take their TNReady exams. Another simulation is planned before spring testing begins in April on a much larger scale.

The simulation is expected to involve far more than the 30,000 students who will test in real life after Thanksgiving. It also will take into account that Tennessee is split into two time zones.

“We’re looking at a true simulation,” said Education Commissioner Candice McQueen, noting that students on Eastern Time will be submitting their trial test forms while students on Central Time are logging on to their computers and tablets.

The goal is to verify that Questar, which has struggled to deliver a clean TNReady administration the last two years, has fixed the online problems that caused headaches for students who tried unsuccessfully to log on or submit their end-of-course tests.


Here’s a list of everything that went wrong with TNReady testing in 2018


The two primary culprits were functions that Questar added after a successful administration of TNReady last fall but before spring testing began in April: 1) a text-to-speech tool that enabled students with special needs to receive audible instructions; and 2) coupling the test’s login system with a new system for teachers to build practice tests.

Because Questar made the changes without conferring with the state, the company breached its contract and was docked $2.5 million out of its $30 million agreement.

“At the end of the day, this is about vendor execution,” McQueen told members of the State Board of Education last week. “We feel like there was a readiness on the part of the department and the districts … but our vendor execution was poor.”

PHOTO: TN.gov
Education Commissioner Candice McQueen

She added: “That’s why we’re taking extra precautions to verify in real time, before the testing window, that things have actually been accomplished.”

By the year’s end, Tennessee plans to request proposals from other companies to take over its testing program beginning in the fall of 2019, with a contract likely to be awarded in April.

The administration of outgoing Gov. Bill Haslam has kept both of Tennessee’s top gubernatorial candidates — Democrat Karl Dean and Republican Bill Lee — in the loop about the process. Officials say they want to avoid the pitfalls that happened as the state raced to find a new vendor in 2014 after the legislature pulled the plug on participating in a multi-state testing consortium known as PARCC.


Why state lawmakers share the blame, too, for TNReady testing headaches


“We feel like, during the first RFP process, there was lots of content expertise, meaning people who understood math and English language arts,” McQueen said. “But the need to have folks that understand assessment deeply as well as the technical side of assessment was potentially missing.”