Testing 2016

Testing giants vie to provide Colorado high school exams

The final piece of Colorado’s 2016 testing puzzle should fall in place by year’s end when state officials decide whether the ACT testing company or the College Board, creators of the SAT, will provide 10th and 11th grade exams.

The decision will carry big implications for the state’s 125,000 high school sophomores and juniors and for the teachers who will prepare students for the exams and oversee test taking.

If the state chooses ACT’s bid, sophomores likely will take the ACT Aspire test, already used by some other states, including neighboring Wyoming. The test offered by the College Board is the PSAT 10. Either exam would take less time for students to finish than the PARCC language arts and math tests that 10th graders took last spring.

Sophomores spent more than 11 hours on PARCC tests last spring. The estimated time to take the ACT 10th grade test is a little more than four hours, while the College Board’s offering clocks in at just under three hours. The PARCC tests have been shortened somewhat for next spring.

For juniors, ACT offers the familiar ACT college entrance test, while the College Board provides the SAT exam.

The coming changes make school districts nervous, given that they’ll have only a few months to ramp up for the new exams.

Why Colorado is planning new tests

The two exams are required by the testing overhaul law passed by legislators last spring.

Lawmakers wanted to reduce the amount of time consumed by testing, particularly in high school. Last spring, 9th, 10th and 11th grade students all had to take PARCC language arts and math tests, and juniors also took the ACT. And seniors were required to take science and social studies tests the previous fall.

The legislature retained traditional testing for 9th graders. But it eliminated 11th grade language arts and math exams, and ordered the 10th grade tests replaced with a college readiness test.

Lawmakers wanted to do more than cut testing time. The policy goal behind the changes was to use high school tests that are more focused than PARCC on college readiness. PARCC tests include only language arts and math. The ACT and College Board tests cover reading, writing, math, science and social studies and are calibrated to measure college and workforce readiness.

The policy goal behind the changes was to use high school tests that are more focused than PARCC on gauging student readiness for college and the workforce in reading, writing, math, science and social studies.

The tests taken by sophomores and juniors are meant to be aligned. So, for instance, results on the 10th grade tests are designed to be predictive of results on the 11th grade exams, giving teachers information they can use to help students before they take tests as juniors. Because of the need for alignment, the state will choose one vendor to provide both tests.

Both companies have long history in Colorado

Learn more about the tests

Many people who’ve graduated from Colorado’s high schools remember the ACT. Every high school junior has had to take the test since 2001. About 55,000 students took the test last spring in the state’s public schools.

Even before the ACT became mandatory, it traditionally was the preferred test for students applying to Colorado colleges.

In contrast, the SAT has had a lower profile in Colorado. About 6,500 students who graduated last spring took the test.

Other College Board tests such as Advanced Placement are taken by some high school students, and some districts use other company tests.

Scores on the ACT test are used in the state accountability system as one factor to rate how well high schools are preparing students for college and careers. Overall, student ACT performance has been relatively flat for several years.

Annual scores on other tests like PARCC are also used in school ratings. In addition, the state rating system uses multiple years of test scores to track student academic growth over time.

So a change in the main set of language arts and math tests disrupts the collection of growth data until the new tests are given for at least two years. The state’s rating system is on hold this year because PARCC tests were new last spring.

But no growth data is calculated from multiple years of ACT tests, so switching 11th grade tests isn’t necessarily a problem.

“If SAT can predict college readiness as well as ACT, we don’t lose a lot” by switching, said Lisa Escarcega, chief accountability and research officer for Aurora Public Schools. “It’s a new group of students every year.”

Change raises concerns for districts

There’s a lot of preparation that goes into giving tests, and some districts fear they’re going to have to scramble to get ready once the state announces which tests will be used.

“It really does matter which test,” Escarcega said. “If it’s ACT, the issue is minimized in terms of having to ramp up.”

If the College Board tests are chosen, teachers will need to be trained quickly, Escarcega said.

And Mya Martin-Glenn, the Aurora district’s assessment director, noted that juniors in many districts already have taken practice ACT tests this school year but won’t necessarily be as prepared for SATs.

When tests will be given and who pays

The Department of Education hasn’t yet decided when the tests will given next spring. The 11th grade test will be given on a single day, with one makeup date. The department expects to do the same thing with the 10th grade exam but won’t decide until later. CDE plans to offer the tests on paper, not online.

Those decisions will be made after a testing company is chosen. CDE spokeswoman Dana Smith said the department anticipates making  a recommendation to the state procurement director before the end of the year,” said CDE spokeswoman Dana Smith.

State procedures required the tests be put out to competitive bid, and the testing law requires the tests be rebid every five years.

The state has budgeted $1.8 million for the new 10th grade exam. The current ACT test for juniors costs about $2.1 million a year. An additional $432,000 has been budgeted to cover the costs of juniors who also want to take a writing exam next spring. The state will cover those costs.

Last spring’s testing law also requires the state to cover the costs of 11th grade writing exams for students who wish to take them.

The national picture

In decades past, the ACT and SAT tests were taken primarily by students using them to apply to college. But in recent years both companies have moved into the state test market.

Alabama, Arkansas, Wisconsin and Wyoming use ACT Aspire for 10th graders. Some states also use different versions of Aspire in lower grades. The College Board partners with a dozen states on various tests. And some states use both tests.

See which states use which tests in this list provided by the Education Commission of the States. ECS discusses testing trends in this paper.

good news bad news

Most Tennessee districts are showing academic growth, but districts with the farthest to go improved the least

PHOTO: Alan Petersime

It’s not just Memphis: Across Tennessee, districts with many struggling schools posted lower-than-expected growth scores on this year’s state exams, according to data released Tuesday.

The majority of Tennessee’s 147 districts did post scores that suggest students are making or exceeding expected progress, with over a third earning the top growth score.

But most students in three of the state’s four largest districts — in Memphis, Nashville and Chattanooga — aren’t growing academically as they should, and neither are those in most of their “priority schools” in the state’s bottom 5 percent.

The divide prompted Education Commissioner Candice McQueen to send a “good news, bad news” email to superintendents.

“These results point to the ability for all students to grow,” she wrote of the top-performing districts, many of which have a wide range of academic achievement and student demographics.

Of those in the bottom, she said the state would analyze the latest data to determine “critical next steps,” especially for priority schools, which also are located in high-poverty communities.

“My message to the leaders of Priority schools … is that this level of growth will never get kids back on track, so we have to double-down on what works – strong instruction and engagement, every day, with no excuses,” McQueen said.

Growth scores are supposed to take poverty into account, so the divide suggests that either the algorithm didn’t work as it’s supposed to or, in fact, little has happened to change conditions at the state’s lowest-performing schools, despite years of aggressive efforts in many places.

The results are bittersweet for Tennessee, which has pioneered growth measures for student learning and judging the effectiveness of its teachers and schools under its Tennessee Value-Added Assessment System, known as TVAAS.

On the one hand, the latest TVAAS data shows mostly stable growth through the transition to TNReady, the state’s new test aligned to new academic standards, in the first year of full testing for grades 3-11. On the other hand, Tennessee has invested tens of millions of dollars and years of reforms toward improving struggling schools — all part of its massive overhaul of K-12 education fueled by its 2009 federal Race to the Top award.

The state-run Achievement School District, which launched in the Race to the Top era to turn around the lowest-performing schools, saw a few bright spots, but almost two-thirds of schools in its charter-reliant portfolio scored in the bottom levels of student growth.

Shelby County’s own turnaround program, the Innovation Zone, fared poorly too, with a large percentage of its Memphis schools scoring 1 on a scale of 1 to 5, after years of scoring 4s and 5s.


District profile: Most Memphis schools score low on student growth


Superintendent Dorsey Hopson called the results a “wakeup call” for the state’s biggest district in Memphis.

“When you have a population of kids in high poverty that were already lagging behind on the old, much easier test, it’s not surprising that we’ve got a lot of work to do here,” he said, citing the need to support teachers in mastering the state’s new standards.

“The good part is that we’ve seen the test now and we know what’s expected. The bad part is we’ve seen the test … and it’s a different monster,” he told Chalkbeat.

You can find district composite scores below. (A TVAAS score of 3 represents average growth for a student in one school year.) For a school-by-school list, visit the state’s website.

exclusive

Most Memphis schools score low on student growth under new state test

PHOTO: Stephanie Snyder

More than half of Memphis schools received the lowest possible score for student growth on Tennessee’s new test last school year, according to data obtained by Chalkbeat for Shelby County Schools.

On a scale of 1 to 5, with 1 being the lowest measure, about 54 percent of the district’s 187 schools scored in the bottom rung of the Tennessee Value-Added Assessment System, known as TVAAS.

That includes most schools in the Innovation Zone, a reversal after years of showing high growth in the district’s prized turnaround program.

Charter schools fared poorly as well, as did schools that were deemed among the state’s fastest-improving in 2015.

Superintendent Dorsey Hopson called the scores a “huge wakeup call.”

“It shows that we’ve got a tremendous amount of work to do,” Hopson told Chalkbeat on Monday. “It’s going to be hard and it’s going to be frustrating. … It starts with making sure we’re supporting teachers around mastering the new standards.”

District leaders across Tennessee have been trying to wrap their heads around the latest growth scores since receiving the data in late August from the State Department of Education. Only two years earlier, the Memphis district garnered the highest possible overall growth score. But since then, the state has switched to a harder test called TNReady that is aligned for the first time to more rigorous academic standards.

TVAAS results are scheduled to be released publicly this week, but Chalkbeat obtained a copy being circulated within Shelby County Schools, Tennessee’s largest district.

The data is prompting questions from some Memphis educators — and assurances from state officials — over the validity of TVAAS, the state’s system for measuring learning and judging the effectiveness of its teachers and schools.

This is the first year of issuing district-wide TVAAS scores since 2015. That’s because of the state’s cancellation of 2016 testing for grades 3-8 due mostly to failures in the switch to online testing.

Some educators wonder whether the bumpy switch to TNReady is a factor in this year’s nosedive, along with changes in how the scores are calculated.

For example, data for fourth-graders is missing since there is no prior state testing in third grade for comparison. Elementary and middle schools also don’t have growth scores for social studies, since the 2017 questions were a trial run and the results don’t count toward a school’s score.

Hopson acknowledged concerns over how the state compares results from “two very different tests which clearly are apples and oranges,” but he added that the district won’t use that as an excuse.

“Notwithstanding those questions, it’s the system upon which we’re evaluated on and judged,” he said.

State officials stand by TVAAS. They say drops in proficiency rates resulting from a harder test have no impact on the ability of teachers, schools and districts to earn strong TVAAS scores, since all students are experiencing the same change.

“Because TVAAS always looks at relative growth from year to year, not absolute test scores, it can be stable through transitions,” said Sara Gast, a spokeswoman for the State Department of Education.

Shelby County Schools is not the only district with disappointing TVAAS results. In Chattanooga, Hamilton County Schools logged low growth scores. But Gast said that more districts earned average or high growth scores of 3, 4 or 5 last school year than happened in 2015.

Want to help us understand this issue? Send your observations to [email protected]

Below is a breakdown of Shelby County’s TVAAS scores. A link to a school-by-school list of scores is at the bottom of this story.

Districtwide

School-wide scores are a combination of growth in each tested subject: literacy, math, science and social studies.

Fifty three schools saw high growth in literacy, an area where Shelby County Schools has doubled down, especially in early grades. And 51 schools saw high growth in math.

Note: A TVAAS score of 3 represents average growth for a student in one school year. A score of 1 represents significantly lower academic growth compared to peers across the state.

2017

School-wide composite Number of schools Percent of schools
1 101 54%
2 19 10%
3 20 11%
4 10 5%
5 37 20%

2015

School-wide composite Number of schools Percent of schools
1 58 28%
2 16 8%
3 38 19%
4 18 9%
5 75 37%

Innovation Zone

Out of the 23 schools in the district’s program to turn around low-performing schools, most received a growth score of 1 in 2017. That stands in stark contrast to prior years since the program opened in 2012, when most schools were on a fast growth track.

School-wide composite Number of iZone schools
1 14
2 2
3 2
4 0
5 5

Reward schools

Nearly half of 32 schools deemed 2015 Tennessee reward schools for high growth saw a major drop in TVAAS scores in 2017:

  • Central High
  • Cherokee Elementary
  • Germanshire Elementary
  • KIPP Memphis Middle Academy
  • Kirby High
  • Memphis Business Academy Elementary
  • Power Center Academy High
  • Power Center Academy Middle
  • Ross Elementary
  • Sheffield High
  • South Park Elementary
  • Southwind High
  • Treadwell Middle
  • Westside Elementary

Charter schools

Charter schools authorized by Shelby County Schools fared similarly to district-run schools in growth scores, with nearly half receiving a TVAAS of 1 compared to 26 percent of charter schools receiving the same score in 2015.

2017

School-wide composite Number of iZone schools
1 18
2 6
3 7
4 2
5 7

2015

School-wide composite Number of iZone schools
1 10
2 2
3 7
4 3
5 16

Optional schools

Half of the the district’s optional schools, which are special studies schools that require students to test into its programs, received a 1 on TVAAS. That’s compared to just 19 percent in 2015.

2017

School-wide composite Number of iZone schools
1 23
2 6
3 5
4 2
5 10

2015

School-wide composite Number of iZone schools
2 5
3 6
4 5
5 14

You can sort through a full list of TVAAS scores for Shelby County Schools here.