Testing Testing

Indiana dumps CTB-McGraw Hill, picks Pearson to create future ISTEP

PHOTO: Shannan Muskopf via Flickr
State officials are closing as many 38 Michigan schools with low rankings due to test scores but they might have trouble finding higher scoring schools nearby

Indiana appears ready to ditch the company that creates ISTEP after years of testing problems, but the cost of delivering Indiana’s state tests could go way up if it does.

British-owned Pearson, another giant testing company, won the state’s bid for a $38 million two-year contract to give the ISTEP test starting next spring over CTB-McGraw Hill, according to awards released today by the Indiana Department of Administration. California-based CTB-McGraw Hill has created ISTEP since the test’s inception in 2009. The company had a four-year, $95 million contract to create ISTEP that expired last year.

But state lawmakers are already casting doubts on whether they will approve the big spike in spending the contracts would require. So it’s not yet a done deal.

Awards to five other companies would push the price tag for Indiana’s testing system to $133.8 million for the next two years. CTB-McGraw Hill, which has been under fire for repeated testing problems over the past four years, was awarded $68 million to continue creating practice tests school districts use to prepare for state exams.

State Superintendent Glenda Ritz slammed the cost of the bids in a statement, which she said her department did not control.

“When I ran for this office, I ran on a platform that included less testing for our students,” Ritz said in a statement. “However, Indiana’s procurement process is modeled to comply with state and federal mandates that require a continuation of assessments that we have been administering to our students.  The Department of Education learned of the awards and the astronomical costs of the assessments after this process had been completed.”

Shelley Triol, a spokeswoman for the department of administration, said her department monitors and carries out the contract proposal process on behalf of the education department and state board of education, but it isn’t involved in budget negotiations. The contracts are not yet final, she said, and budget issues have to be hashed out between the test companies and the department of education.

“For (requests for proposal) conducted or administered by IDOA on behalf of other agencies, IDOA has no part in the budgetary process,” Triol said in an email. “All budgetary issues are dealt with directly by the agency that will ultimately enter into the contract(s) that may result from the (proposal) process.”

Lawmakers, including state Sen. Luke Kenley, R-Noblesville, have been asking if Indiana should scrap ISTEP altogether in favor of a national “off-the-shelf” test like one from the Northwest Evaluation Association or a well-known exam like the Iowa Test of Basic Skills. Senate Bill 566, which Kenley authored, would do just that. The bill passed the Senate 46-3 last month and is expected to be considered by the House soon.

The current state budget proposal, passed last month by the House, does not include the extra money needed to pay for the contracts that were awarded. It allocates the same amount of money for testing as the state is spending now. The Senate began to debate the budget this week.

Kenley, who heads the budget-making Senate Appropriations Committee, said he thinks this creates the perfect opportunity for Ritz, the education department, lawmakers and the Indiana State Board of Education to continue discussions about his bill and creating a more streamlined, cheaper test that’s better for students and teachers.

“I think that getting the results of the (requests for proposals) and looking at the price tags is a helpful step in motivating everybody … to try to sit down and work on this thing, to get a resolution out that everybody gets comfortable with what we think will be beneficial for the students and for the teachers in the state,” Kenley said.

The education department, he said, is scheduled to present its budget proposal to the Senate Appropriations Committee on March 19. If the cost for testing remains as high as it is, Kenley said he’s not inclined to move the department’s proposal forward. The State Budget Committee, which will meet separately later on this year, must also review the test contracts.

That could throw the state’s entire plan to convert to a new state exam next year off course and raise several hard questions about whether a cheaper test could still meet all the requirements of state and federal law that the bidding companies were asked to meet.

Ritz was not available for interviews, but in her statement she seemed to endorse the idea that cost-saving alternatives should be explored.

“I strongly believe that Indiana needs a streamlined system of assessments that come at a reasonable cost to taxpayers,” she said in the statement. “I look forward to working with Indiana’s policymakers toward that outcome.”

Last month, news of a potentially 12-hour long ISTEP test sent policymakers into a panic. Part of the reason the test was projected to be so lengthy was because the department needed to add questions that did not count this year but that were being tried out for the 2015-16 test.

After a week of heated back-and-forth between Ritz’s department and Gov. Mike Pence’s office, a deal was struck to fast-track a bill that shortened the test by three hours.

Indiana State Board of Education member Sarah O’Brien said in a statement the board also wants more discussion about what the future state testing system should look like.

“The State Board of Education will take a very close look in the coming months at the proposed testing contracts in terms of overall scope and cost,” the statement said. “Hoosier taxpayers and parents can be assured the Board will not authorize any assessment that results in excessive testing time for our children or spends more tax dollars than is necessary to meet state and federal education requirements.”

CTB-McGraw Hill spokesman Brian Belardi said the company declined to comment. A representative from Pearson did not immediately respond to a request for comment.

Since 2011 CTB-McGraw Hill has had repeated problems with ISTEP.

The biggest incident came in April of 2013, about 78,000 Indiana students taking ISTEP experienced interruptions over the course of several days, or about 16 percent of all test takers online. It was the third consecutive year that online ISTEP had such troubles. In 2011, about 10,000 students had problem and in 2012, it was 9,000 students with online trouble.

Last August CTB-McGraw Hill reached a $3 million settlement with the state over problems on the 2013 exam. The company has had similar problems in other states including Oklahoma, which canceled its contract last July.

Here is a complete list of companies that were awarded potential two-year contracts to create test for Indiana:

  • Pearson would create ISTEP for just over $38 million and IREAD-3, Indiana’s third-grade reading test, for almost $7 million.
  • Questar Assessment would create the high school end-of-course exams for about $7.5 million and the alternate assessment for students with special needs for about $5 million.
  • College Board, which writes the SAT and Advanced Placement tests, would create a graduation exam for $10.7 million and an exam that would determine whether students are ready for college or jobs for $624,381.
  • Amplify, a New York City-based company, would write practice English tests for Kindergarten through second grade for a little more than $3 million.
  • Strategic Measurement and Evaluation, an Indiana-based company affiliated with Questar, would create practice math tests for Kindergarteners through second-graders for about $900,000.
  • McGraw-Hill would create practice tests in science, for kindergarten to second grade, for about $7 million; practice tests in social studies, for kindergarten to second grade, for about $7 million; practice English tests, grades 3 to 10, for almost $13 million; practice math tests, grades 3 to 10, for a little more than $11 million; practice science tests, grades 3 to 10, for a little more than $11 million; and practice social studies tests, grades 3 to 10, for a little more than $11 million.

 

good news bad news

Most Tennessee districts are showing academic growth, but districts with the farthest to go improved the least

PHOTO: Alan Petersime

It’s not just Memphis: Across Tennessee, districts with many struggling schools posted lower-than-expected growth scores on this year’s state exams, according to data released Tuesday.

The majority of Tennessee’s 147 districts did post scores that suggest students are making or exceeding expected progress, with over a third earning the top growth score.

But most students in three of the state’s four largest districts — in Memphis, Nashville and Chattanooga — aren’t growing academically as they should, and neither are those in most of their “priority schools” in the state’s bottom 5 percent.

The divide prompted Education Commissioner Candice McQueen to send a “good news, bad news” email to superintendents.

“These results point to the ability for all students to grow,” she wrote of the top-performing districts, many of which have a wide range of academic achievement and student demographics.

Of those in the bottom, she said the state would analyze the latest data to determine “critical next steps,” especially for priority schools, which also are located in high-poverty communities.

“My message to the leaders of Priority schools … is that this level of growth will never get kids back on track, so we have to double-down on what works – strong instruction and engagement, every day, with no excuses,” McQueen said.

Growth scores are supposed to take poverty into account, so the divide suggests that either the algorithm didn’t work as it’s supposed to or, in fact, little has happened to change conditions at the state’s lowest-performing schools, despite years of aggressive efforts in many places.

The results are bittersweet for Tennessee, which has pioneered growth measures for student learning and judging the effectiveness of its teachers and schools under its Tennessee Value-Added Assessment System, known as TVAAS.

On the one hand, the latest TVAAS data shows mostly stable growth through the transition to TNReady, the state’s new test aligned to new academic standards, in the first year of full testing for grades 3-11. On the other hand, Tennessee has invested tens of millions of dollars and years of reforms toward improving struggling schools — all part of its massive overhaul of K-12 education fueled by its 2009 federal Race to the Top award.

The state-run Achievement School District, which launched in the Race to the Top era to turn around the lowest-performing schools, saw a few bright spots, but almost two-thirds of schools in its charter-reliant portfolio scored in the bottom levels of student growth.

Shelby County’s own turnaround program, the Innovation Zone, fared poorly too, with a large percentage of its Memphis schools scoring 1 on a scale of 1 to 5, after years of scoring 4s and 5s.


District profile: Most Memphis schools score low on student growth


Superintendent Dorsey Hopson called the results a “wakeup call” for the state’s biggest district in Memphis.

“When you have a population of kids in high poverty that were already lagging behind on the old, much easier test, it’s not surprising that we’ve got a lot of work to do here,” he said, citing the need to support teachers in mastering the state’s new standards.

“The good part is that we’ve seen the test now and we know what’s expected. The bad part is we’ve seen the test … and it’s a different monster,” he told Chalkbeat.

You can find district composite scores below. (A TVAAS score of 3 represents average growth for a student in one school year.) For a school-by-school list, visit the state’s website.

exclusive

Most Memphis schools score low on student growth under new state test

PHOTO: Stephanie Snyder

More than half of Memphis schools received the lowest possible score for student growth on Tennessee’s new test last school year, according to data obtained by Chalkbeat for Shelby County Schools.

On a scale of 1 to 5, with 1 being the lowest measure, about 54 percent of the district’s 187 schools scored in the bottom rung of the Tennessee Value-Added Assessment System, known as TVAAS.

That includes most schools in the Innovation Zone, a reversal after years of showing high growth in the district’s prized turnaround program.

Charter schools fared poorly as well, as did schools that were deemed among the state’s fastest-improving in 2015.

Superintendent Dorsey Hopson called the scores a “huge wakeup call.”

“It shows that we’ve got a tremendous amount of work to do,” Hopson told Chalkbeat on Monday. “It’s going to be hard and it’s going to be frustrating. … It starts with making sure we’re supporting teachers around mastering the new standards.”

District leaders across Tennessee have been trying to wrap their heads around the latest growth scores since receiving the data in late August from the State Department of Education. Only two years earlier, the Memphis district garnered the highest possible overall growth score. But since then, the state has switched to a harder test called TNReady that is aligned for the first time to more rigorous academic standards.

TVAAS results are scheduled to be released publicly this week, but Chalkbeat obtained a copy being circulated within Shelby County Schools, Tennessee’s largest district.

The data is prompting questions from some Memphis educators — and assurances from state officials — over the validity of TVAAS, the state’s system for measuring learning and judging the effectiveness of its teachers and schools.

This is the first year of issuing district-wide TVAAS scores since 2015. That’s because of the state’s cancellation of 2016 testing for grades 3-8 due mostly to failures in the switch to online testing.

Some educators wonder whether the bumpy switch to TNReady is a factor in this year’s nosedive, along with changes in how the scores are calculated.

For example, data for fourth-graders is missing since there is no prior state testing in third grade for comparison. Elementary and middle schools also don’t have growth scores for social studies, since the 2017 questions were a trial run and the results don’t count toward a school’s score.

Hopson acknowledged concerns over how the state compares results from “two very different tests which clearly are apples and oranges,” but he added that the district won’t use that as an excuse.

“Notwithstanding those questions, it’s the system upon which we’re evaluated on and judged,” he said.

State officials stand by TVAAS. They say drops in proficiency rates resulting from a harder test have no impact on the ability of teachers, schools and districts to earn strong TVAAS scores, since all students are experiencing the same change.

“Because TVAAS always looks at relative growth from year to year, not absolute test scores, it can be stable through transitions,” said Sara Gast, a spokeswoman for the State Department of Education.

Shelby County Schools is not the only district with disappointing TVAAS results. In Chattanooga, Hamilton County Schools logged low growth scores. But Gast said that more districts earned average or high growth scores of 3, 4 or 5 last school year than happened in 2015.

Want to help us understand this issue? Send your observations to tn.tips@chalkbeat.org

Below is a breakdown of Shelby County’s TVAAS scores. A link to a school-by-school list of scores is at the bottom of this story.

Districtwide

School-wide scores are a combination of growth in each tested subject: literacy, math, science and social studies.

Fifty three schools saw high growth in literacy, an area where Shelby County Schools has doubled down, especially in early grades. And 51 schools saw high growth in math.

Note: A TVAAS score of 3 represents average growth for a student in one school year. A score of 1 represents significantly lower academic growth compared to peers across the state.

2017

School-wide composite Number of schools Percent of schools
1 101 54%
2 19 10%
3 20 11%
4 10 5%
5 37 20%

2015

School-wide composite Number of schools Percent of schools
1 58 28%
2 16 8%
3 38 19%
4 18 9%
5 75 37%

Innovation Zone

Out of the 23 schools in the district’s program to turn around low-performing schools, most received a growth score of 1 in 2017. That stands in stark contrast to prior years since the program opened in 2012, when most schools were on a fast growth track.

School-wide composite Number of iZone schools
1 14
2 2
3 2
4 0
5 5

Reward schools

Nearly half of 32 schools deemed 2015 Tennessee reward schools for high growth saw a major drop in TVAAS scores in 2017:

  • Central High
  • Cherokee Elementary
  • Germanshire Elementary
  • KIPP Memphis Middle Academy
  • Kirby High
  • Memphis Business Academy Elementary
  • Power Center Academy High
  • Power Center Academy Middle
  • Ross Elementary
  • Sheffield High
  • South Park Elementary
  • Southwind High
  • Treadwell Middle
  • Westside Elementary

Charter schools

Charter schools authorized by Shelby County Schools fared similarly to district-run schools in growth scores, with nearly half receiving a TVAAS of 1 compared to 26 percent of charter schools receiving the same score in 2015.

2017

School-wide composite Number of iZone schools
1 18
2 6
3 7
4 2
5 7

2015

School-wide composite Number of iZone schools
1 10
2 2
3 7
4 3
5 16

Optional schools

Half of the the district’s optional schools, which are special studies schools that require students to test into its programs, received a 1 on TVAAS. That’s compared to just 19 percent in 2015.

2017

School-wide composite Number of iZone schools
1 23
2 6
3 5
4 2
5 10

2015

School-wide composite Number of iZone schools
2 5
3 6
4 5
5 14

You can sort through a full list of TVAAS scores for Shelby County Schools here.