Testing Testing

Indiana dumps CTB-McGraw Hill, picks Pearson to create future ISTEP

PHOTO: Shannan Muskopf via Flickr
State officials are closing as many 38 Michigan schools with low rankings due to test scores but they might have trouble finding higher scoring schools nearby

Indiana appears ready to ditch the company that creates ISTEP after years of testing problems, but the cost of delivering Indiana’s state tests could go way up if it does.

British-owned Pearson, another giant testing company, won the state’s bid for a $38 million two-year contract to give the ISTEP test starting next spring over CTB-McGraw Hill, according to awards released today by the Indiana Department of Administration. California-based CTB-McGraw Hill has created ISTEP since the test’s inception in 2009. The company had a four-year, $95 million contract to create ISTEP that expired last year.

But state lawmakers are already casting doubts on whether they will approve the big spike in spending the contracts would require. So it’s not yet a done deal.

Awards to five other companies would push the price tag for Indiana’s testing system to $133.8 million for the next two years. CTB-McGraw Hill, which has been under fire for repeated testing problems over the past four years, was awarded $68 million to continue creating practice tests school districts use to prepare for state exams.

State Superintendent Glenda Ritz slammed the cost of the bids in a statement, which she said her department did not control.

“When I ran for this office, I ran on a platform that included less testing for our students,” Ritz said in a statement. “However, Indiana’s procurement process is modeled to comply with state and federal mandates that require a continuation of assessments that we have been administering to our students.  The Department of Education learned of the awards and the astronomical costs of the assessments after this process had been completed.”

Shelley Triol, a spokeswoman for the department of administration, said her department monitors and carries out the contract proposal process on behalf of the education department and state board of education, but it isn’t involved in budget negotiations. The contracts are not yet final, she said, and budget issues have to be hashed out between the test companies and the department of education.

“For (requests for proposal) conducted or administered by IDOA on behalf of other agencies, IDOA has no part in the budgetary process,” Triol said in an email. “All budgetary issues are dealt with directly by the agency that will ultimately enter into the contract(s) that may result from the (proposal) process.”

Lawmakers, including state Sen. Luke Kenley, R-Noblesville, have been asking if Indiana should scrap ISTEP altogether in favor of a national “off-the-shelf” test like one from the Northwest Evaluation Association or a well-known exam like the Iowa Test of Basic Skills. Senate Bill 566, which Kenley authored, would do just that. The bill passed the Senate 46-3 last month and is expected to be considered by the House soon.

The current state budget proposal, passed last month by the House, does not include the extra money needed to pay for the contracts that were awarded. It allocates the same amount of money for testing as the state is spending now. The Senate began to debate the budget this week.

Kenley, who heads the budget-making Senate Appropriations Committee, said he thinks this creates the perfect opportunity for Ritz, the education department, lawmakers and the Indiana State Board of Education to continue discussions about his bill and creating a more streamlined, cheaper test that’s better for students and teachers.

“I think that getting the results of the (requests for proposals) and looking at the price tags is a helpful step in motivating everybody … to try to sit down and work on this thing, to get a resolution out that everybody gets comfortable with what we think will be beneficial for the students and for the teachers in the state,” Kenley said.

The education department, he said, is scheduled to present its budget proposal to the Senate Appropriations Committee on March 19. If the cost for testing remains as high as it is, Kenley said he’s not inclined to move the department’s proposal forward. The State Budget Committee, which will meet separately later on this year, must also review the test contracts.

That could throw the state’s entire plan to convert to a new state exam next year off course and raise several hard questions about whether a cheaper test could still meet all the requirements of state and federal law that the bidding companies were asked to meet.

Ritz was not available for interviews, but in her statement she seemed to endorse the idea that cost-saving alternatives should be explored.

“I strongly believe that Indiana needs a streamlined system of assessments that come at a reasonable cost to taxpayers,” she said in the statement. “I look forward to working with Indiana’s policymakers toward that outcome.”

Last month, news of a potentially 12-hour long ISTEP test sent policymakers into a panic. Part of the reason the test was projected to be so lengthy was because the department needed to add questions that did not count this year but that were being tried out for the 2015-16 test.

After a week of heated back-and-forth between Ritz’s department and Gov. Mike Pence’s office, a deal was struck to fast-track a bill that shortened the test by three hours.

Indiana State Board of Education member Sarah O’Brien said in a statement the board also wants more discussion about what the future state testing system should look like.

“The State Board of Education will take a very close look in the coming months at the proposed testing contracts in terms of overall scope and cost,” the statement said. “Hoosier taxpayers and parents can be assured the Board will not authorize any assessment that results in excessive testing time for our children or spends more tax dollars than is necessary to meet state and federal education requirements.”

CTB-McGraw Hill spokesman Brian Belardi said the company declined to comment. A representative from Pearson did not immediately respond to a request for comment.

Since 2011 CTB-McGraw Hill has had repeated problems with ISTEP.

The biggest incident came in April of 2013, about 78,000 Indiana students taking ISTEP experienced interruptions over the course of several days, or about 16 percent of all test takers online. It was the third consecutive year that online ISTEP had such troubles. In 2011, about 10,000 students had problem and in 2012, it was 9,000 students with online trouble.

Last August CTB-McGraw Hill reached a $3 million settlement with the state over problems on the 2013 exam. The company has had similar problems in other states including Oklahoma, which canceled its contract last July.

Here is a complete list of companies that were awarded potential two-year contracts to create test for Indiana:

  • Pearson would create ISTEP for just over $38 million and IREAD-3, Indiana’s third-grade reading test, for almost $7 million.
  • Questar Assessment would create the high school end-of-course exams for about $7.5 million and the alternate assessment for students with special needs for about $5 million.
  • College Board, which writes the SAT and Advanced Placement tests, would create a graduation exam for $10.7 million and an exam that would determine whether students are ready for college or jobs for $624,381.
  • Amplify, a New York City-based company, would write practice English tests for Kindergarten through second grade for a little more than $3 million.
  • Strategic Measurement and Evaluation, an Indiana-based company affiliated with Questar, would create practice math tests for Kindergarteners through second-graders for about $900,000.
  • McGraw-Hill would create practice tests in science, for kindergarten to second grade, for about $7 million; practice tests in social studies, for kindergarten to second grade, for about $7 million; practice English tests, grades 3 to 10, for almost $13 million; practice math tests, grades 3 to 10, for a little more than $11 million; practice science tests, grades 3 to 10, for a little more than $11 million; and practice social studies tests, grades 3 to 10, for a little more than $11 million.

 

Not Ready

Memphis students won’t see TNReady scores reflected in their final report cards

PHOTO: Creative Commons / timlewisnm

Shelby County Schools has joined the growing list of Tennessee districts that won’t factor preliminary state test scores into students’ final grades this year.

The state’s largest school district didn’t receive raw score data in time, a district spokeswoman said Tuesday.

The State Department of Education began sharing the preliminary scores this week, too late in the school year for many districts letting out in the same week. That includes Shelby County Schools, which dismisses students on Friday.

While a state spokeswoman said the timelines are “on track,” Superintendent Dorsey Hopson said the timing was unfortunate.

“There’s a lot of discussion about too many tests, and I think anytime you have a situation where you advertise the tests are going to be used for one thing and then we don’t get the data back, it becomes frustrating for students and families. But that’s not in our control,” he said Tuesday night.

Hopson added that the preliminary scores will still get used eventually, but just not in students’ final grades. “As we get the data and as we think about our strategy, we’ll just make adjustments and try to use them appropriately,” he said.

The decision means that all four of Tennessee’s urban districts in Memphis, Nashville, Knoxville and Chattanooga won’t include TNReady in all of their students’ final grades. Other school systems, such as in Williamson and Wilson counties, plan to make allowances by issuing report cards late, and Knox County will do the same for its high school students.

Under a 2015 state law, districts can leave out standardized test scores if the information doesn’t arrive five instructional days before the end of the school year. This year, TNReady is supposed to count for 10 percent of final grades.

Also known as “quick scores,” the data is different from the final test scores that will be part of teachers’ evaluation scores. The state expects to release final scores for high schoolers in July and for grades 3-8 in the fall.

The Department of Education has been working with testing company Questar to gather and score TNReady since the state’s testing window ended on May 5. About 600,000 students took the assessment statewide in grades 3-11.

State officials could not provide a district-by-district listing of when districts will receive their scores.

“Scores will continue to come out on a rolling basis, with new data released every day, and districts will receive scores based on their timely return of testing materials and their completion of the data entry process,” spokeswoman Sara Gast told Chalkbeat on Monday. “Based on district feedback, we have prioritized returning end-of-course data to districts first.”

Caroline Bauman and Laura Faith Kebede contributed to this report.

Making the grade

TNReady scores are about to go out to Tennessee districts, but not all will make student report cards

PHOTO: Chalkbeat Photo Illustration

The State Department of Education will start Monday to distribute the test score data that goes into students’ final report cards, but it won’t arrive in time for every district across the state.

That’s because some districts already have ended their school years, some won’t have time to incorporate TNReady grades before dismissing their students, and some missed the state’s first deadline for turning in testing materials.

“Our timelines for sharing TNReady scores are on track,” spokeswoman Sara Gast said Friday, noting that the schedule was announced last fall. “We have said publicly that districts will receive raw score data back in late May.”

Shelby County Schools is waiting to see when their scores arrive before making a decision. A spokeswoman said Tennessee’s largest district met all testing deadlines, and needs the scores by Monday to tabulate them into final grades. The district’s last day of school is next Friday.

School leaders in Nashville and Kingsport already have chosen to exclude the data from final grades, while Williamson County Schools is delaying their report cards.

A 2015 state law lets districts opt to exclude the data if scores aren’t received at least five instructional days before the end of the school year.

TNReady scores are supposed to count for 10 percent of this year’s final grades. As part of the transition to TNReady, the weight gradually will rise to between 15 and 25 percent (districts have flexibility) as students and teachers become more familiar with the new test.

The first wave of scores are being sent just weeks after Education Commissioner Candice McQueen declared this year’s testing a “success,” both on paper and online for the 24 districts that opted to test high school students online this year. Last year, Tennessee had a string of TNReady challenges in the test’s inaugural year. After the online platform failed and numerous delivery delays of printed testing materials, McQueen canceled testing in grades 3-8 and fired its previous test maker, Measurement Inc.

Tennessee test scores have been tied to student grades since 2011, but this is the first year that the state used a three-week testing window instead of two. Gast said the added time was to give districts more flexibility to administer their tests. But even with the added week, this year’s timeline was consistent with past years, she said.

Once testing ended on May 5, school districts had five days to meet the first deadline, which was on May 10, to return those materials over to Questar, the state’s new Minneapolis-based testing company.

School officials in Nashville said that wasn’t enough time.

“Due to the volume of test documents and test booklets that we have to account for and process before return for scoring, our materials could not be picked up before May 12,” the district said in a statement on Thursday.

Because districts turned in their testing materials at different times, the release of raw scores, will also be staggered across the next three weeks, Gast said.