TNReady snag

Tennessee’s ill-timed score delivery undercuts work to rebuild trust in tests

PHOTO: Laura Faith Kebede
The Tennessee Department of Education worked with local districts and schools to prepare students for TNReady, the state's standardized test that debuted in 2016.

After last year’s online testing failure, Education Commissioner Candice McQueen pledged to rebuild trust in Tennessee’s new TNReady assessment, a lynchpin of the state’s system of school accountability.

A year later, frustration over TNReady has re-emerged, even after a mostly uneventful spring testing period that McQueen declared a success just weeks ago.

Preliminary TNReady scores are supposed to count for 10 percent of students’ final grades. But as many districts end the school year this week, the state’s data is arriving too late. One by one, school systems have opted to exclude the scores, while some plan to issue their report cards late.

The flurry of end-of-school adjustments has left local administrators to explain the changes to parents, educators and students who are already wary of state testing. And the issue has put Tennessee education officials back on the defensive as the state works to regain its footing on testing after last year’s high-profile setbacks.

“We just need to get more crisp as a state,” said Superintendent Dorsey Hopson after Shelby County Schools joined the growing list of districts opting to leave out the scores. “If we know that we want to use (TNReady scores), if the state says use them on the report card, then we got to get them back.”

The confusion represents one step back for TNReady, even after the state took two steps forward this spring with a mostly smooth second year of testing under Questar, its new test maker. Last year, McQueen canceled testing for grades 3-8 and fired Measurement Inc. after Tennessee’s online platform failed and a string of logistical problems ensued.


Why TNReady’s failed rollout leaves Tennessee with challenges for years to come


But the reason this year’s testing went more smoothly may also be the reason why the scores haven’t arrived early enough for many districts.

TNReady was mostly administered on paper this time around, which meant materials had to be processed, shipped and scored before the early data could be shared with districts. About 600,000 students took the assessment statewide.

After testing ended on May 5, districts had five days to get their materials to Questar to go to the front of the line for return of preliminary scores. Not all districts succeeded, and some had problems with shipping. Through it all, the State Department of Education has maintained that its timelines are “on track.”

McQueen said Wednesday that districts have authority under a 2015 state law to exclude the scores from students’ final grades if the data doesn’t arrive a week before school lets out. And with 146 districts that set their own calendars, “the flexibility provided under this law is very important.”

Next year will be better, she says, as Tennessee moves more students to online testing, beginning with high school students.

PHOTO: TN.gov
Candice McQueen

“We lose seven to 10 days for potential scoring time just due to shipping and delivery,” she said of paper tests. “Online, those challenges are eliminated because the materials can be uploaded immediately and transferred much much quicker.”

The commissioner emphasized that the data that matters most is not the preliminary data but the final score reports, which are scheduled for release in July for high schools and the fall for grades 3-8. Those scores are factored into teachers’ evaluations and are also used to measure the effectiveness of schools and districts. 

“Not until you get the score report will you have the full context of a student’s performance level and strengths and weaknesses in relation to the standards,” she said.

The early data matters to districts, though, since Tennessee has tied the scores to student grades since 2011.

“Historically, we know that students don’t try as hard when the tests don’t count,” said Jennifer Johnson, a spokeswoman for Wilson County Schools, a district outside of Nashville that opted to issue report cards late. “We’re trying to get our students into the mindset that tests do matter, that this means business.”

Regardless, this year’s handling of early scores has left many parents and educators confused, some even exasperated.

“There’s so much time and stress on students, and here again it’s not ready,” said Tikeila Rucker, a Memphis teacher who is president of the United Education Association of Shelby County.

“The expectation is that we would have the scores back,” Hopson agreed.

But Hopson, who heads Tennessee’s largest district in Memphis, also is taking the long view.

“It’s a new test and a new process and I’m sure the state is trying to figure it all out,” he said. “Obviously the process was better this year than last year.”

Laura Faith Kebede and Caroline Bauman contributed to this report.

rules and regs

State shortens length of ‘gag order’ on teachers discussing Regents questions online

PHOTO: G. Tatter

After pushback from teachers, the State Education Department has changed a new provision that temporarily prohibits teachers from discussing Regents exam questions online.

The original rule stated that teachers could not use email or a listserv to discuss test questions or other specific content with other teachers until a week after the exam period ended on June 23. As Chalkbeat reported Tuesday, teachers objected, arguing that they sometimes needed to discuss questions in order to properly grade the tests or to challenge questions that seems unfair.

Under the change, tests taken between June 13 and June 16 can be discussed online beginning June 23. And for those taken between June 19 and June 22, teachers can discuss content online beginning June 27.

According to education department officials, the provision was intended to ensure that testing material did not spread online before all students had completed their exams, particularly among schools that serve students with special needs, who qualify for multiple-day testing.

“We believe that nearly all students who are testing with this accommodation will have completed their exams by these dates,” Steven Katz, director of the Office of State Assessment, wrote in a memo to school principals and leaders.

Still, longtime physics teacher Gene Gordon and former president of the Science Teachers Association of New York State noted that, to some extent, the damage was done since the amendment to the rule came out only after many teachers had already graded their exams.

“It did not have any real effect,” Gordon said.

The New York State United Teachers — which criticized the new provision on Tuesday as a “gag order” and called for its repeal — called the amendment a “clear victory” for educators. Still, NYSUT spokesman Carl Korn told Chalkbeat, “it clearly will be more helpful in the future than this year.”

Testing Testing

Calculator mix-up could force some students to retake ISTEP, and Pearson is partially to blame

PHOTO: Ann Schimke

ISTEP scores for thousands of students across the state will be thrown out this year, including at two Indianapolis private schools, according to state officials.

The mishap can be traced back to calculators. Students at 20 schools used calculators on a section of the 2017 ISTEP math test when they shouldn’t have — in at least one district because of incorrect instructions from Pearson, the company that administers the tests in Indiana.

It’s a small glitch compared to the massive testing issues Indiana experienced with its previous testing company, CTB McGraw Hill. But years of problems have put teachers, students and parents on high alert for even minor hiccups. In 2013, for example, about 78,000 students had their computers malfunction during testing. Pearson began administering ISTEP in 2016.

The calculator mix-up involving Pearson happened in Rochester Community Schools, located about two hours north of Indianapolis. About 700 students in three schools received the incorrect instructions.

Molly Deuberry, spokeswoman for the Indiana Department of Education, said that Rochester is the only district known to have received the incorrect instructions, but the state is also investigating calculator-related problems at 19 other schools.

According to federal rules, students who use calculators on non-calculator test sections must have their scores labeled as “undetermined.” Current sophomores will need to retake the test, since passing the 10th-grade exam is a graduation requirement in Indiana. Students will have multiple opportunities to do so, including during the summer, state officials said.

It’s not clear how the invalidated scores will affect those schools’ A-F letter grades. It is up to the Indiana State Board of Education to handle A-F grade appeals, which districts can request once grades are released.

“The Department and State Board will collaborate to ensure that the State Board receives sufficient detail about this incident when reviewing the appeals,” the education department said in an email.

Pearson spokesman Scott Overland said in an email that they would work with the education department to follow up on the calculator issues and correct their processes for next year.

“In some cases, Pearson inadvertently provided inaccurate or unclear guidance on the use of calculators during testing,” Overland said. “In these instances, we followed up quickly to help local school officials take corrective action.”

Here are the districts and schools the state says had students incorrectly use calculators on this year’s ISTEP:

  • Covington Christian School, Covington
  • Eastbrook South Elementary, Eastbrook Schools
  • Eastern Hancock Elementary School, Eastern Hancock County Schools
  • Emmanuel-St. Michael Lutheran School, Fort Wayne
  • Frankfort Middle School, Frankfort Community Schools
  • George M Riddle Elementary School, Rochester Community Schools
  • Lasalle Elementary School, School City of Mishawaka
  • New Haven Middle School, East Allen County Schools
  • Rochester Community Middle School, Rochester Community Schools
  • Rochester Community High School, Rochester Community Schools
  • Saint Boniface School, Lafayette
  • Saint Joseph High School, South Bend
  • Saint Roch Catholic School, Indianapolis
  • Silver Creek Middle School, West Clark Community Schools
  • St. Louis de Montfort School, Lafayette
  • Tennyson Elementary School, Warrick County Schools
  • Thomas Jefferson Elementary School, School City of Hammond
  • Trinity Christian School, Indianapolis
  • Waterloo Elementary School, DeKalb County Schools
  • Westfield Middle School, Westfield-Washington Schools

This story has been updated to include comments from Pearson.