Datahead

Denver and Aurora schools showed modest gains on state tests. But gaps still remain.

PHOTO: Helen H. Richardson/Denver Post
Justin Machado, 9, reads on his iPad during his 3rd grade class at Ashley Elementary in 2015.

Two large Colorado school districts with substantial numbers of students living in poverty — Denver Public Schools and Aurora Public Schools — showed modest improvement in the second year of state tests measuring students’ mastery of tougher academic standards.

Despite those gains, both districts still lag behind the state average — and in Aurora’s case, the gap is substantial.

Overall, the state education department’s release Thursday of district- and school-level results from PARCC math and English tests amounted to a mixed bag for most, with scores creeping up in some subjects and grades, slipping in others or remaining steady.

The picture is further muddied by a lack of student growth data that measure changes in the same group of students over time — data state officials are still compiling. Low test participation rates in higher grades also call into question district and school level scores, officials concede.

The state last month released state-level 2016 PARCC results, which showed more elementary school students were meeting expectations, while middle school scores were flat.

For the first time since the state overhauled its annual testing system in 2014 to align to the politically controversial Common Core State Standards, teachers, parents and taxpayers are able to compare year-to-year results in most subjects and grades.

A student at Vista Peak in Aurora works on an assignment.
PHOTO: Nicholas Garcia
A student at Vista Peak in Aurora works on an assignment.

The results, along with other measures such as graduation rates, will determine the quality ratings of schools and districts. Those ratings will be released later this fall. For some schools, another round of poor results could mean state intervention — something that has never happened before.

Like last year, anti-testing sentiment ran highest in Boulder and wealthier suburban Denver enclaves, as well as in some rural districts. Older students were more likely to not take the tests while the overwhelming majority of younger students took them, also echoing last year’s trends.

At Boulder’s Fairview High School, just 72 of 514 ninth graders took the PARCC English test.

Joyce Zurkowski, the state’s director of assessments, said lower participation rates invite scrutiny.

“When I’m looking at a school with a high number of kids who met or exceeded expectations, with 98 percent participation, the confidence I can have in those results is higher than at a school with an even higher number of students who met or exceed expectations but had only 40 percent participation,” Zurkowski said.

The big five

Results from the state’s five largest school districts mostly mirrored statewide results, which most notably showed gains in elementary school math.

Denver Public Schools, the state’s largest school district, showed gains in all but one test. The district only lost ground in the percentage of students who met or exceeded the state’s benchmarks in seventh grade math, dropping by 2.6 percentage points. The district’s largest leap in the percentage of students who cleared the state’s benchmarks was in fourth grade English, with a jump of 5.5 percentage points.

“A decade ago, we were 25 points behind the rest of the state,” Superintendent Tom Boasberg said. “Now we’re about 3 or 4 points behind the rest of the state. Against that benchmark, we’ve made very consistent, very striking progress.”

Jeffco Public Schools, the state’s second largest school district, saw gains in math in every grade but sixth. But it lost ground across the board on the state’s English tests. Its largest drop, 6.4 percentage points, was in the ninth grade.

“We are pleased to be improving in math given the higher level expectations of the CMAS/PARCC assessments,” Superintendent Dan McMinimee said in a statement. “Reading will continue to be a focus for our district improvement planning and we won’t be satisfied until all of our students are meeting or exceeding state expectations.”

The state’s third largest school district, Douglas County, made gains in math at the elementary school level, but lost ground in middle and high school. The south-suburban school district had wild swings on the English test. Ninth graders gained 5.7 points on that test, but seventh graders lost 7 points.

Strong gains in math were made in Cherry Creek elementary schools. But sixth graders this year lost 4 percentage points. The state’s fourth largest school district had more mixed results on the English test. There was a 2.8 percentage point increase in the number of fourth graders who were at grade level in English. But there was a 2.3 percentage point drop at the eighth grade level.

Julie Skupa, Cherry Creek’s assistant superintendent of assessment and improvement, said the district could attribute its higher math scores in part to a new curriculum.

“It goes beyond knowledge and rote memorization, and requires students to do a lot of problem-solving,” she said.

Aurora Public Schools, the fifth largest school district, saw mostly improvements. Students made gains in every grade on the English test except for grades six and eight. Similarly, Aurora showed increases in the number of students who met state expectations on the math test in every grade except for sixth and seventh.

“We’re seeing the first overall increase in performance since the 2011 school year,” said Superintendent Rico Munn, who has been leading an aggressive school improvement agenda. “We hope we can attribute that to our increase in rigor and relevance, our effort to make sure we have a high-quality teaching staff, and focus on our strategic plan.”

Growing pains

Changes made to Colorado’s testing system during the 2015 legislative session — including who takes the tests and how they take the tests — complicated this year’s release. School leaders voiced their frustration over slow-to-be-released and incomplete data that in some cases can’t be used to make comparisons to last year’s results.

For starters, this year’s upper division math results can’t be compared to last year’s because different grade levels took those tests. In 2015, middle school and high school students were eligible to take the state’s most advanced math tests. However, after lawmakers eliminated testing in the 10th and 11th grades, only seventh through ninth graders were able to take those tests.

Seniors at Fairview High School in Boulder protested a standardized test in November 2014.
PHOTO: Nic Garcia
Seniors at Fairview High School in Boulder protested a standardized test in November 2014.

The upshot: you can’t compare results between the two years.

And for the second year in a row, Colorado has released results from its tests piecemeal. While schools are getting their results three months earlier than they did last year, the results are still slower than anyone expected.

“What they promised was that through the online system, we’d get results back sooner than later,” Skupa said, adding that it’s difficult for districts to make any meaningful changes after the school year has started. “It’s these bits and pieces that make it difficult to create a big picture view.”

Part of the slowdown this year, Zurkowski said, is that school districts were allowed to use pencil-and-paper tests on a much larger scale. But that’s only part of the problem, she said.

“I believe the PARCC consortium underestimated the complexity of scoring and reporting their assessments, especially in the first few years,” she said. “I do believe that not only Colorado but the PARCC consortium is committed to continue to find ways to improve that turnaround time.”

Paper-and-pencil tests are causing another set of concerns for the state. Last year, the state acknowledged that students who used paper tests performed better than they would have if they used online tests. Test that were impacted included the third grade English test and upper division high school math tests.

Zurkowski said that while the department has theories as to why the bump happened — students could have felt more comfortable writing out equations than keyboarding them — it doesn’t know for certain.

“There was a lot to sort through,” she said. “… Honestly, we don’t know what specifically the issue is.”

To ensure that didn’t happen this year, the state education department ran results from about 16 schools that used paper tests through a series of mathematical procedures ensuring students would get the same score whether they took the test on paper or online, Zurkowski said.

The additional steps make the results more reliable, Zurkowski said, but the department is still urging caution when it comes to looking at those schools.

“We’re not going to over-interpret at this point,” she said.

Search for your school

Use Chalkbeat’s database to search for your school’s individual results on the math and English tests. The green bar represents the number of students who met or exceeded the standards. The yellow bar represents the number of students who took the tests. State officials have cautioned that low participation rates could skew results.

Testing Testing

“ILEARN” is in, ISTEP is out — Indiana legislature approves test set to begin in 2019. Now awaiting governor’s OK.

PHOTO: Grace Tatter

A little more than a year ago, lawmakers made the dramatic call to “repeal” the state’s beleaguered ISTEP test without a set alternative.

Friday night, they finally decided on a plan for what should replace it.

The “ILEARN” testing system in House Bill 1003 passed the House 68-29 and passed the Senate 39-11. Next, the bill will go to Gov. Eric Holcomb for him to sign into law.

The new test would be used for the first time in 2019, meaning ISTEP still has one more year of life. In the meantime, the Indiana Department of Education will be tasked with developing the new test and finding a vendor. Currently, the state contracts with the British test writing company Pearson.

House Speaker Brian Bosma said he was very pleased with the compromise, which he thinks could result in a short, more effective test — although many of those details will depend on the final test writer.

However, a number of Democrats, and even some Republicans, expressed frustration with the testing proposal.

“The federal government requires us to take one test,” said Sen. Aaron Freeman, a Republican from Indianapolis. “Why we continue to add more and more to this, I have no idea.”

For the most part, the test resembles what was recommended by a group of educators, lawmakers and policymakers charged with studying a test replacement. There would be a new year-end test for elementary and middle school students, and High schools would give end-of-course exams in 10th grade English, ninth-grade biology, and algebra I.

An optional end-of-course exam would be added for U.S. government, and the state would be required to test kids in social studies once in fifth or eighth grade.

It’s not clear if the plan still includes state Superintendent Jennifer McCormick’s suggestion to use an elementary and middle school test that would be “computer-adaptive” and adjust difficulty based on students’ answers.

The plan does make potentially significant changes to the state’s graduation requirements. Rather than having ECAs count as the “graduation exam,” the bill would create a number of graduation pathways that the Indiana State Board of Education would flesh out. Options could include the SAT, ACT, industry certifications, or the ASVAB military entrance exam.

Test researchers who have come to speak to Indiana lawmakers have cautioned against such a move, as many of these measures were not designed to determine high school graduation.

While teacher evaluations would still be expected to include test scores in some way, the bill gives some flexibility to districts as to specifically how to incorporate them, said Rep. Bob Behning, an Indianapolis Republican and the bill’s author.

Currently, law says ISTEP scores must “significantly inform” evaluations, but districts use a wide range of percentages to fit that requirement.

You can find all of Chalkbeat’s testing coverage here.

lingering debate

Drop TNReady scores from teacher evaluations, urge Shelby County leaders

PHOTO: The Commercial Appeal
From left: Commissioners Reginald Milton, Van Turner and David Reaves listen during a meeting in Memphis of the Shelby County Board of Commissioners. The governing board this week urged state lawmakers to strip TNReady scores from teacher evaluations.

Just as students have begun taking Tennessee’s new standardized test, Shelby County officials are calling on state leaders to back off of using those scores to evaluate teachers.

The Shelby County Board of Commissioners, the local funding body for Memphis schools, voted unanimously on Monday to urge  the state to use TNReady results as only a “diagnostic” tool. Currently, the board says, state scores are being used as a punitive evaluation of both teachers and students.

The board’s call gets to the heart of a debate that has lingered since a 2010 state law tied standardized test results to teacher evaluations. That was several years before TNReady was introduced last year as a new measuring stick for determining how Tennessee students — and their teachers — are doing.

TNReady testing, which began this week and continues through May 5, has intensified that debate. The new test is aligned to more rigorous academic standards that Tennessee is counting on to improve the state’s national ranking.

But Shelby County’s board is questioning whether reforms initiated under Tennessee’s 2010 First to the Top plan are working.

“While giving off the appearance of a better education, this type of teaching to the test behavior actually limits the amount of quality content in deference to test taking strategies,” the board’s resolution reads.

The board also cites “unintended consequences” to the teaching profession as nearly half of Tennessee’s 65,000 teachers are expected to leave or retire in the next decade.

“Record numbers of quality teachers are leaving the teaching profession and school districts are struggling to recruit and retain quality teachers due to the TN standards imposed in regards to standardized testing,” the resolution reads.

It’s true that school districts statewide struggle to recruit and retain effective teachers in some subject areas. But there’s little evidence to support that incorporating test scores in evaluations is the primary reason teachers are leaving the profession.

It’s also unlikely that Tennessee will back off of its teacher evaluation model, even as some states have recently abandoned the practice. The model is baked into reforms that the state initiated through two gubernatorial administrations to improve both teacher and student performance.


Want education equity? Make sure your teachers feel valued, say lawmakers


PHOTO: Yalonda M. James/The Commercial Appeal
Commissioner David Reaves

Shelby County’s resolution was introduced by Commissioner David Reaves, a former Memphis school board member who says he hears a “continual outcry” from teachers and parents over high-stakes testing.

“Allow the local (school district) to assess and classify teachers and use the test results as a tool, not as a stick,” Reaves told Chalkbeat.

In Tennessee, test scores in some form count for 35 to 50 percent of teachers’ evaluation scores. TNReady scores currently count 10 percent but, as the state settles into its new test, that will gradually increase to 25 percent by 2018-19.

Classroom observations and evaluations did play a factor in retention rates for effective teachers in a 2014 study by the Tennessee Department of Education before the transition to TNReady. Where teachers reported consistent and objective classroom observations, effective teachers were more likely to stay.

State and local teacher surveys also differ on the quality of Tennessee’s teacher evaluation system known as TEAM, which mostly relies on classroom observations.

In Shelby County Schools, exit surveys show issues like levels and stability of teacher pay — not test scores in their evaluations — are cited most often by teachers leaving the district.

Superintendent Dorsey Hopson told the school board last month that most Shelby County teachers find the state’s evaluation system unfair, but the same majority think their own score is fair.

Another survey by the Tennessee Department of Education suggests that satisfaction with the state’s evaluation system is on the rise as teacher feedback continues to be incorporated.

The Shelby County board, which oversees funding for Tennessee’s largest district, is sending its resolution to Gov. Bill Haslam, Education Commissioner Candice McQueen, and the Tennessee General Assembly. Below is the full text: