One and done

Tennessee fires TNReady testmaker, suspends tests for grades 3-8

PHOTO: Grace Tatter
Education Commissioner Candice McQueen announced last April that she was suspending TNReady testing for grades 3-8 for the 2015-16 school year. Now, her department is asking lawmakers to make more adjustments to the weight of student test scores in Tennessee's teacher evaluation formula.

The Tennessee Department of Education has terminated its contract with the developer of the state’s new standardized test and suspended testing for students in grades 3-8 this school year due to the company’s inability to deliver testing materials, Education Commissioner Candice McQueen announced Wednesday.

However, TNReady testing will continue as planned for the state’s high school students, since those materials already have been delivered.

The announcement delivered the fatal blow to a test that has been plagued with problems beginning with a failed online rollout on Feb. 8 and numerous subsequent delivery delays of printed testing materials. The last straw came last week when Measurement Inc. failed to meet its most recent deadline — to deliver materials by April 22 — in time for testing to begin this week.

As of Wednesday morning, all districts still were waiting on some grade 3-8 materials to arrive, with a total of 2 million documents yet to be shipped, according to a statement from the department.

“Measurement Inc.’s performance is deeply disappointing,” McQueen said. “We’ve exhausted every option in problem solving with this vendor to assist them in getting these tests delivered. Districts have exceeded their responsibility and obligation to wait for grade 3-8 materials, and we will not ask districts to continue waiting on a vendor that has repeatedly failed us.”

Tennessee is the second state this year to suspend its standardized tests due to problems rooted in technical glitches. Alaska canceled its online tests early this month, due to interruptions caused when a construction worker accidentally cut a fiber optic cable thousands of miles away.

Tennessee’s suspension means that many tenets of test-based accountability will be paused for one year — a leap for a state that insisted on using the new test as the basis for teacher evaluations and student grades, even as the U.S. Department of Education offered flexibility for states making the transition to new tests. High school students’ test scores will be the only ones eligible to be used in teacher evaluations, but only if they boost a teacher’s score, and only if teachers choose to include them.

"Measurement Inc.’s performance is deeply disappointing."Candice McQueen, Tennessee education commissioner

“Challenges with this test vendor have not diverted us from our goals as a state,” McQueen said. “Tennessee has made historic and tremendous growth over the past several years. Higher standards and increased accountability have been a key part of this progress. Our work toward an aligned assessment plays a critical role in ensuring that all students are continuing to meet our high expectations and are making progress on their path to postsecondary and the workforce.”

The Department of Education is working with the Tennessee Office of Procurement to expedite the process to find a new test vendor in time for testing next spring.

Though Measurement Inc. already operated under an abbreviated timeline, with only one year to develop and deliver TNReady, McQueen said she is confident that the next round will be better.

“While certainly you have a short timeline, we believe we will have a good test next year, and we will have a strong vendor relationship,” she said at a news conference in Nashville.

She said that, despite chronic challenges with TNReady, Tennessee has a strong foundation for a good test moving forward.

“We have a good test this year. It’s a better test than we’ve had in Tennessee in the past,” she said, adding that whatever vendor the state uses next will incorporate questions developed by Measurement Inc.

“Next year’s test will be better than this year’s test,” she promised.

Gov. Bill Haslam also took an optimistic view of the situation. “The failure of the testing vendor to deliver the tests and meet its own obligations does not take away from the fact that Tennessee has created our own, higher standards, we have an improved assessment fully aligned with those standards, and we remain committed going forward to measuring student performance fairly and ensuring accountability for those results,” Haslam said in a statement.

In an interview this week with Chalkbeat, Measurement Inc. president Henry Scherich said that McQueen’s decision in February to shift from an online test to a paper-and-pencil version put the testing company in a difficult, and even impossible, situation.

McQueen countered Wednesday that the state’s contract with Measurement Inc. always had provisions for paper tests in the case of technical troubles.

Though the state’s original contract with Measurement Inc. was for $108 million, Tennessee has only paid the Durham, N.C.-based company $1.6 million so far for content.

Public reaction to the state’s announcement erupted quickly, with many TNReady critics feeling vindicated, including Tullahoma City School board member Jessica Fogarty, who created an online petition asking the state to suspend Part II testing before it began. More than 2,000 Tennesseans signed the petition.

Fogarty said the state should have terminated the contract sooner. She also noted that the state’s next testmaker, like Measurement Inc., will have only one year to develop a test — a timeline that she called unrealistic.

“If anything, we should learn from our mistakes from this year … especially knowing our state standards will change for next year,” Fogarty said. “There’s more to be resolved with testing in Tennessee. … There’s still a lot more questions to be answered before we can be confident about the future.”

"I think the pause will be taken as a relief at this point."Wayne Miller, Tennessee Organization of of School Superintendents

Others supported the commissioner’s decision.

“I think the pause will be taken as a relief at this point,” said Wayne Miller, director of the Tennessee Organization of School Superintendents. “With all the accountability that’s centered around the outcome of student assessments, that’s created certainly a less-than-ideal environment.”

Jamie Woodson, CEO of the State Collaborative on Reforming Education, expressed disappointment that many third-graders through eighth-graders graders won’t be able to gauge their performance this spring. “Parents and teachers deserve to know how much progress their students have made over the year, and all Tennesseans deserve an annual snapshot of the progress schools and school districts are making,” Woodson said.

District leaders quickly began sharing the news.

Educators and policymakers chimed in too:

 

Editor’s note: This story has been updated with additional information.

Chalkbeat staffers Laura Kebede and Marta W. Aldrich contributed to this report.

good news bad news

Most Tennessee districts are showing academic growth, but districts with the farthest to go improved the least

PHOTO: Alan Petersime

It’s not just Memphis: Across Tennessee, districts with many struggling schools posted lower-than-expected growth scores on this year’s state exams, according to data released Tuesday.

The majority of Tennessee’s 147 districts did post scores that suggest students are making or exceeding expected progress, with over a third earning the top growth score.

But most students in three of the state’s four largest districts — in Memphis, Nashville and Chattanooga — aren’t growing academically as they should, and neither are those in most of their “priority schools” in the state’s bottom 5 percent.

The divide prompted Education Commissioner Candice McQueen to send a “good news, bad news” email to superintendents.

“These results point to the ability for all students to grow,” she wrote of the top-performing districts, many of which have a wide range of academic achievement and student demographics.

Of those in the bottom, she said the state would analyze the latest data to determine “critical next steps,” especially for priority schools, which also are located in high-poverty communities.

“My message to the leaders of Priority schools … is that this level of growth will never get kids back on track, so we have to double-down on what works – strong instruction and engagement, every day, with no excuses,” McQueen said.

Growth scores are supposed to take poverty into account, so the divide suggests that either the algorithm didn’t work as it’s supposed to or, in fact, little has happened to change conditions at the state’s lowest-performing schools, despite years of aggressive efforts in many places.

The results are bittersweet for Tennessee, which has pioneered growth measures for student learning and judging the effectiveness of its teachers and schools under its Tennessee Value-Added Assessment System, known as TVAAS.

On the one hand, the latest TVAAS data shows mostly stable growth through the transition to TNReady, the state’s new test aligned to new academic standards, in the first year of full testing for grades 3-11. On the other hand, Tennessee has invested tens of millions of dollars and years of reforms toward improving struggling schools — all part of its massive overhaul of K-12 education fueled by its 2009 federal Race to the Top award.

The state-run Achievement School District, which launched in the Race to the Top era to turn around the lowest-performing schools, saw a few bright spots, but almost two-thirds of schools in its charter-reliant portfolio scored in the bottom levels of student growth.

Shelby County’s own turnaround program, the Innovation Zone, fared poorly too, with a large percentage of its Memphis schools scoring 1 on a scale of 1 to 5, after years of scoring 4s and 5s.


District profile: Most Memphis schools score low on student growth


Superintendent Dorsey Hopson called the results a “wakeup call” for the state’s biggest district in Memphis.

“When you have a population of kids in high poverty that were already lagging behind on the old, much easier test, it’s not surprising that we’ve got a lot of work to do here,” he said, citing the need to support teachers in mastering the state’s new standards.

“The good part is that we’ve seen the test now and we know what’s expected. The bad part is we’ve seen the test … and it’s a different monster,” he told Chalkbeat.

You can find district composite scores below. (A TVAAS score of 3 represents average growth for a student in one school year.) For a school-by-school list, visit the state’s website.

exclusive

Most Memphis schools score low on student growth under new state test

PHOTO: Stephanie Snyder

More than half of Memphis schools received the lowest possible score for student growth on Tennessee’s new test last school year, according to data obtained by Chalkbeat for Shelby County Schools.

On a scale of 1 to 5, with 1 being the lowest measure, about 54 percent of the district’s 187 schools scored in the bottom rung of the Tennessee Value-Added Assessment System, known as TVAAS.

That includes most schools in the Innovation Zone, a reversal after years of showing high growth in the district’s prized turnaround program.

Charter schools fared poorly as well, as did schools that were deemed among the state’s fastest-improving in 2015.

Superintendent Dorsey Hopson called the scores a “huge wakeup call.”

“It shows that we’ve got a tremendous amount of work to do,” Hopson told Chalkbeat on Monday. “It’s going to be hard and it’s going to be frustrating. … It starts with making sure we’re supporting teachers around mastering the new standards.”

District leaders across Tennessee have been trying to wrap their heads around the latest growth scores since receiving the data in late August from the State Department of Education. Only two years earlier, the Memphis district garnered the highest possible overall growth score. But since then, the state has switched to a harder test called TNReady that is aligned for the first time to more rigorous academic standards.

TVAAS results are scheduled to be released publicly this week, but Chalkbeat obtained a copy being circulated within Shelby County Schools, Tennessee’s largest district.

The data is prompting questions from some Memphis educators — and assurances from state officials — over the validity of TVAAS, the state’s system for measuring learning and judging the effectiveness of its teachers and schools.

This is the first year of issuing district-wide TVAAS scores since 2015. That’s because of the state’s cancellation of 2016 testing for grades 3-8 due mostly to failures in the switch to online testing.

Some educators wonder whether the bumpy switch to TNReady is a factor in this year’s nosedive, along with changes in how the scores are calculated.

For example, data for fourth-graders is missing since there is no prior state testing in third grade for comparison. Elementary and middle schools also don’t have growth scores for social studies, since the 2017 questions were a trial run and the results don’t count toward a school’s score.

Hopson acknowledged concerns over how the state compares results from “two very different tests which clearly are apples and oranges,” but he added that the district won’t use that as an excuse.

“Notwithstanding those questions, it’s the system upon which we’re evaluated on and judged,” he said.

State officials stand by TVAAS. They say drops in proficiency rates resulting from a harder test have no impact on the ability of teachers, schools and districts to earn strong TVAAS scores, since all students are experiencing the same change.

“Because TVAAS always looks at relative growth from year to year, not absolute test scores, it can be stable through transitions,” said Sara Gast, a spokeswoman for the State Department of Education.

Shelby County Schools is not the only district with disappointing TVAAS results. In Chattanooga, Hamilton County Schools logged low growth scores. But Gast said that more districts earned average or high growth scores of 3, 4 or 5 last school year than happened in 2015.

Want to help us understand this issue? Send your observations to [email protected]

Below is a breakdown of Shelby County’s TVAAS scores. A link to a school-by-school list of scores is at the bottom of this story.

Districtwide

School-wide scores are a combination of growth in each tested subject: literacy, math, science and social studies.

Fifty three schools saw high growth in literacy, an area where Shelby County Schools has doubled down, especially in early grades. And 51 schools saw high growth in math.

Note: A TVAAS score of 3 represents average growth for a student in one school year. A score of 1 represents significantly lower academic growth compared to peers across the state.

2017

School-wide composite Number of schools Percent of schools
1 101 54%
2 19 10%
3 20 11%
4 10 5%
5 37 20%

2015

School-wide composite Number of schools Percent of schools
1 58 28%
2 16 8%
3 38 19%
4 18 9%
5 75 37%

Innovation Zone

Out of the 23 schools in the district’s program to turn around low-performing schools, most received a growth score of 1 in 2017. That stands in stark contrast to prior years since the program opened in 2012, when most schools were on a fast growth track.

School-wide composite Number of iZone schools
1 14
2 2
3 2
4 0
5 5

Reward schools

Nearly half of 32 schools deemed 2015 Tennessee reward schools for high growth saw a major drop in TVAAS scores in 2017:

  • Central High
  • Cherokee Elementary
  • Germanshire Elementary
  • KIPP Memphis Middle Academy
  • Kirby High
  • Memphis Business Academy Elementary
  • Power Center Academy High
  • Power Center Academy Middle
  • Ross Elementary
  • Sheffield High
  • South Park Elementary
  • Southwind High
  • Treadwell Middle
  • Westside Elementary

Charter schools

Charter schools authorized by Shelby County Schools fared similarly to district-run schools in growth scores, with nearly half receiving a TVAAS of 1 compared to 26 percent of charter schools receiving the same score in 2015.

2017

School-wide composite Number of iZone schools
1 18
2 6
3 7
4 2
5 7

2015

School-wide composite Number of iZone schools
1 10
2 2
3 7
4 3
5 16

Optional schools

Half of the the district’s optional schools, which are special studies schools that require students to test into its programs, received a 1 on TVAAS. That’s compared to just 19 percent in 2015.

2017

School-wide composite Number of iZone schools
1 23
2 6
3 5
4 2
5 10

2015

School-wide composite Number of iZone schools
2 5
3 6
4 5
5 14

You can sort through a full list of TVAAS scores for Shelby County Schools here.