change of plans

With A-F grades off the table, Tennessee gets creative about rating its schools under federal law

PHOTO: Getty Images/danchooalex

Tennessee’s plan to start grading its schools this year has taken a big detour.

Days of online testing problems this spring forced officials to toss out a new A-F grading system, under development for more than a year as part of Tennessee’s sweeping plan to usher in a new era of school quality.

Now the state Education Department has come up with a different approach to help parents and communities understand how their schools performed in 2017-18.

The state will rate each school on a scale of 0-4 on six different performance indicators. And in a major concession to local district leaders, schools won’t receive a single overall grade or rating as initially planned.

Education Commissioner Candice McQueen said the change complies with a new state law ordering that this year’s TNReady scores “shall not be used to assign a letter grade to a school” — a nod to concerns that the test results may be unreliable. She believes it also complies with the Every Student Succeeds Act, also known as ESSA, the 2015 federal law that requires every state to adopt a rating system that distinguishes each of its schools in a meaningful way.   

McQueen’s approach is drawing mostly praise from education leaders and groups, even as some wonder whether a numeric system will provide the simplicity and clarity of one that grades schools on an A-F scale.

“I give the department credit for going much further than I thought they could or would based on the TNReady law. They were very creative and ambitious,” said Gini Pupo-Walker, who leads the Tennessee Educational Equity Coalition, which seeks to improve education quality for students of color.

Sen. Dolores Gresham, who chairs the Senate Education Committee, says the numeric system “is not ideal, but it does allow for some accountability and fulfills our requirement” under ESSA.

Federal officials are expected to approve the numeric rating concept and a few other revisions on Tennessee’s updated ESSA plan shared last month with the U.S. Department of Education.

McQueen recently told the task force advising her on testing matters that the numeric system will still provide useful information about how schools are doing in areas such as chronic absenteeism; out-of-school suspensions; student readiness for college, career and the military; and a variety of student achievement and growth data. The indicators are meant to give families a fuller picture of school performance than test scores alone.

PHOTO: Kayleigh Skinner
Tennessee Education Commissioner Candice McQueen is greeted by students and staff at Springdale Memphis Magnet Elementary School during a 2015 svisit.

The commissioner also believes the ratings will follow the intent of the emergency TNReady laws, which shield schools from any “adverse action” from this year’s scores.

The ratings will be accessible online by December. For now, state officials are calling the new platform a “dashboard,” and school superintendents got an early peek last week at its design.

The dashboard will be separate from Tennessee’s existing State Report Card, another online tool showing annual data such as demographics, per-pupil funding, and student achievement by school and district.

“The current report card has dozens of data points, but we know it may not be a user-friendly tool for every parent to understand how a school is doing” said state spokeswoman Sara Gast.

“The dashboard will condense the number of data points to highlight what we think are some of the key indicators of success, and provide some context about what those scores mean,” she said.

But whether using the 0-4 system will be as easy to understand as A-F grades is a concern.

State lawmakers passed a 2016 law requiring an A-F system for schools beginning this year, and the Education Department adopted that approach as part of Tennessee’s ESSA plan. The idea was to provide parents with an easy-to-use tool to understand how their child’s school is performing. After all, that’s what their children get on their report cards.

For several years, the plan to give each school an overall grade — in addition to grades for each performance indicator — has been a point of contention for local education leaders. The state superintendents organization has fought the idea at every turn and was pushing legislation this year to roll it back before this year’s online TNReady problems made the issue moot.

“We’ve never opposed getting grades for individual areas,” said Dale Lynch, executive director of the Tennessee Organization of School Superintendents. “But many superintendents and school boards felt very passionately that giving schools a single letter grade was not the right approach to give parents the best and most accurate information.”

"I believe (the changes) get away from the simplicity and transparency that an A-F system was trying to accomplish."Sen. Dolores Gresham, R-Somerville

Gresham, who sponsored the A-F bill that became state law, is equally passionate about the importance of providing parents with one summative grade for their school. She’s also concerned that the numeric system won’t pack the same punch as letter grades.

“I believe that both choices get away from the simplicity and transparency that an A-F system was trying to accomplish,” Gresham told Chalkbeat. “The parents and our communities are our audience, not school administrators.”

Pupo-Walker would rather have overall grades too. But, for now, she’s mostly concerned about whether the dashboard will help parents and communities have robust conversations about the strengths and weaknesses of their schools.

“The onus is on the state to present the information in a way that parents and schools and community members can understand it,” she said, “and then for the information to be actionable.”

In partnership with the state, the coalition is sponsoring five regional meetings beginning June 26 in Nashville to discuss updates to Tennessee’s ESSA plan, including the new rating system. You can find the details here.

outside the box

How one Chicago principal is leaning on data to help black boys

PHOTO: Adeshina Emmanuel

Test scores were rising at Fuller Elementary School when Marilyn McCottrell took over in 2016. Yet troubling trends loomed behind the numbers.

“A lot of growth has been made,” said the principal. “But that growth is not equal among students.”

She’s talking about black boys.

Black girls had driven most of Fuller’s academic improvement since the 2012-13 school year, when Chicago Public Schools handed management of the Bronzeville school over to the non-profit Academy for Urban School Leadership, which replaced the staff and principal in a turnaround effort. Black boys had improved much slower. They got most of the school’s Ds and Fs, and were much less likely than girls to meet or approach expectations for college readiness on state tests.

Last school year, McCottrell and her staff crunched the data and made changes at Fuller to shorten the gaps between boys and girls. The stakes are high. Black boys, especially those from low-income households, are more prone than their sisters to falling behind in school and running into the juvenile criminal justice system. As adults, they are more likely to be arrested, imprisoned, or chronically unemployed. McCottrell believes what Fuller did, starting with painstakingly crunching data at the school, classroom and individual levels, could help other schools do better for black boys.

But she wants to be clear about something: Black boys don’t need to be “saved.”

“They need to be respected and appreciated for the differences and the unique gifts that they bring to the educational experience,” she said.

PHOTO: Adeshina Emmanuel
Fuller Elementary School students (from left)Tyrese Robinson-Guy, Terrell Johnson, and Jasean Waters at a community garden in Bronzeville.

 

Fuller, a Level 1 school in good standing, occupies the corner of St. Lawrence Avenue and 42nd Street in Bronzeville. Nearly all of its 370 students are black and come from economically disadvantaged households. When CPS turned over management of Fuller, it was seeking to lift up a school that had been on academic probation five consecutive years. Fuller still has far to go. In 2017, only 10 percent of Fuller students were ready for the next level compared to 26 percent across the school district and 34 percent across the state. Growth has been above average, but, as McCottrell said, that growth hasn’t been equal.

Last August, McCottrell arrived at Fuller for a training session for teachers bearing handouts packed with data on black boys’ grades and test scores. Middle school reading teacher Arlicia McClain was shocked to see the stark disparities.

“It made me buck up and say I need to talk to these students,” she said. “I need to know what is going on that is preventing them from improving. Is it me? Is it something going on with them individually? Is it something they are missing?”

Girls’ math scores had increased by 193 percent compared with 90 percent for boys since the turnaround effort began in the 2012-13 school year. The gender performance gap was even more striking in reading, where black girls’ scores jumped 140 percent compared with 31 percent for boys. 

As McClain and other teachers reflected on the numbers, they recounted their  own experiences in the classroom. For example, they could all name which students were removed from class the most for disciplinary reasons, and nearly all were black boys.

Fuller Elementary School teacher Arlicia McClain.

McClain realized she tended to call on black girls more in class.

McClain, African-American herself, wondered if she was favoring girls or failing to challenge boys enough, and how that could affect their learning. She resolved to push black boys more during her second year at Fuller.

She also left the session with another big take-away: A lot of boys who wouldn’t participate in classroom-wide sessions engaged more in small groups. Wedding the data to her realizations has helped the young teacher come up with tailored approaches for struggling students.

“Look at them as individuals who want to learn, but who sometimes need the individualized attention to do that,” McClain said. “If you really are about the progression of black youth, you’re going to need to be individual-focused, and you’re going to need the data to do it.”

In the 2016-17 school year, for the subjects of English language arts and math, about 70 percent of all Ds and Fs at Fuller went to black boys.

In the first quarter of last school year, McCottrell and her staff revised Fuller’s grading policies in hopes of addressing the disparity.

They switched to what McCottrell called “a more equitable grading scale,” where the lowest a student could score is a 50, adopted a “no-opt out policy” for homework, so children who failed to turn in their homework by deadline wouldn’t automatically get a zero and had to make up assignments, and allowed students to redo certain parts of failed tests and quizzes after reteaching.

By the end of the first quarter, the numbers of Ds and Fs had decreased by nearly half.

But black boys were still getting about the same percent of them as before.

So McCottrell decided to go in for a closer look.

“The numbers only tell part of the story,” she said.

McCottrell ate with boys in the lunchroom. She played flag football with them at recess. She sat with them in class, assisted their teachers, and taught her own lessons across grades and subjects.

She talked to the boys — and listened.

Jasean Waters, 13, said he found it hard to focus on his school work.

Some distractions come from inside the classroom, like the bullies Jasean’s run into. Other distractions live in the world outside Fuller, like the gun violence whose victims are overwhelmingly black males.

“It’s a big struggle for us,” he said. “There’s a lot of people dying around here, so we gotta watch our backs, and when we’re walking home we feel like we’re unsafe, so we just focus on us being safe. It’s hard to focus on school.”

Boredom is another issue. Jasean said that he does well in math, but struggles sometimes with reading, and that his interest wanes with the lack of characters and authors he can relate to in school texts. That sounded familiar to McCottrell.  When she spoke with boys, she heard that school amounted to a seven-hour suppression of their personalities, interests, and voices — especially in reading and English classes, where black voices and black writers were missing.

“When kids have to pick a book for independent reading, they don’t relate to the characters in those classroom libraries,” she said. “It’s really hard coming to a class everyday when nothing relates to you.”

McCottrell decided to teach an optional African-American literature class every Friday during a weekly “intervention time” for students needing help in reading and math  About 17 boys showed up on the first day and read excerpts from Ralph Ellison’s “Invisible Man,” whose protagonist proclaims, “I am invisible, understand, simply because people refuse to see me.”

McCottrell said many of the boys could expertly analyze the Harlem Renaissance classic, because they related to the idea of not being heard, seen, or understood for who they really are. The students offered examples like the portrayal of black men in the media.

“Many of them were saying things like, ‘I’m not a gangbanger, but this is what people think I am, because I’m dark or because I’m tall,’” she said. “They talked about it in the context of their teachers not knowing who they are.”

The class soon doubled as word of mouth drew others in. Jasean, a C student at the start of the class, joined them. He said he learned things he hadn’t been introduced to before. He read about segregation, speeches by Martin Luther King, and books like “Bud, Not Buddy,” about a 10-year-old black orphan during the Great Depression.

He said he rededicated himself to doing 100 minutes of reading a night and by the end of last school year earned an A in reading. He said he raises his hand to ask and answer questions in class more.

“It feels good,” he said.

Jasean’s grandmother, local school council member Regina Waters, praised McCottrell’s hands-on approach with students and her efforts to build one-on-one relationships with the boys.

“She’s upfront with the kids, and she knows all the kids by name which is unusual in the short time she’s been there,” Waters said.

Marilyn McCottrell

Fuller’s boys closed the gap with girls in several ways over last school year.

They went from getting 70 percent of the Ds and Fs in English and math to 60 percent. In 2016-17, 46 percent of boys compared with 55 percent of girls were on track, meaning they earned a C or higher in reading and math and had an attendance rate of at least 95 percent. In 2017-18, the percentage of boys on track increased by 23 percentage points compared to 19 points for girls. But sitting in her office at Fuller one day earlier this summer, McCottrell admitted something about her efforts for black boys.

“Nothing is solved,” she said.

Despite some progress last school year, when the 2018-19 school year stars, black boys at Fuller will still lag behind black girls. Forces outside of education like poverty, mass incarceration, and racial discrimination will continue to disadvantage black youth in ways that manifest in classrooms, where they land heaviest on black boys.

The odds aren’t yet even for black boys at McCottrell’s school, or at most schools across America. However, Mccottrell believes that educators learned a lot that they can build on down the line.

Next year, McCottrell said she’s urging teachers to incorporate more of the black experience and black voices into lesson plans and to increase small-group instruction.

Teachers are having more data conferences with McCottrell and with each other to guide instruction and target specific students’ needs. McCottrell is also promoting more social-emotional learning techniques and restorative practices rather than punitive approaches to discipline.

Marlene Aponte, AUSL’s director of coaching,  said that in some ways Fuller’s story resembles other schools’ in the years after turnarounds. After focusing on rigorous instruction and ambitious growth targets,“we’re starting to really hone in on some of the pieces that we may have overlooked, such as gender bias, gender equity, access in equity,” she said.

McCottrell wants her boys to have the tools to succeed. She knows there are some issues that her school won’t be able to solve.

But it’s a start.

testing accountability

Pressuring schools to raise test scores got diminishing returns, new study of No Child Left Behind finds

PHOTO: Ann Schimke

Does tightening the screws on schools and teachers lead to benefits for students?

For the past couple of decades, school reform efforts have assumed that the answer is yes. Setting ambitious goals, and putting pressure on schools to reach them, would push students ahead. And past research has shown that math scores rose as more states began threatening and sanctioning schools with low test scores in the 2000s.

But a new study shows that continuing to to “raise the bar” during the No Child Left Behind era only had a modest effect at best. That raises questions about whether the small gains were worth the political controversy, and what critics claim were the educational costs, of putting a greater focus on test scores.

“These results suggest that the ratcheting [up] of test-based accountability pressures alone is not enough to sustain improvements in student achievement,” conclude researchers Vivian Wong, Coady Wing, David Martin, and Anandita Krishnamachari.

Their paper, which has not been formally peer-reviewed, focuses on the several years after the federal No Child Left Behind law was signed in 2002. The law — which passed with bipartisan support but would eventually draw bipartisan ire — required states to test students annually and set goals for schools. Schools that didn’t meet them faced sanctions.

States each set their own targets using different tests. But the researchers attempted to ask the same questions of each state: How hard was it for each school to hit its goals, and how did that change between 2003 and 2011? Then, they looked at how students did on the National Assessment for Educational Progress. Did states see larger gains on the federal low-stakes test after making life tougher on schools?

In many states, it really did become harder and harder for schools to measure up. In 2008, Education Week noted that California’s school failure rate jumped from 34 to 48 percent between 2007 and 2008. In Vermont, the climb was even steeper: from 12 percent of schools failing to 37 percent.

This added pressure, the authors conclude, seemed to lead to national gains in eighth grade math and reading. But the effect was tiny: about half a point in both subjects. (For comparison’s sake, the difference in performance between white and black students in eighth grade math was 32 points on the latest test.)

“Though they find positive effects, like everyone in this literature, they are small [effects],” Tom Dee, a Stanford education professor.

That said, the gains were largest for certain disadvantaged groups: English language learners, Hispanic students, students with disabilities, and students who started at the lowest levels of performance.

There was no evidence of higher standards causing any improvements in fourth grade math or reading.

If this shows that raising the bar doesn’t do much, though, past research has shown that just having a bar can make a big difference.

In states that didn’t have accountability systems at all before No Child Left Behind, creating them led to big gains on national low-stakes math tests: 8 points in fourth grade and 5 points in eighth grade, according to a study from Dee.

Together, this research bolsters a theory known as the “accountability plateau” — that creating tougher rules boost performance, but ratcheting up the pressure leads to diminishing returns.

“It seems like when you implement an accountability system there’s an initial bump, but after that continued gains are hard to come by,” said Morgan Polikoff, a professor at the University of Southern California who has studied standards and accountability systems.

Dee was more skeptical of this idea. Schools’ goals were getting harder and harder to reach just as criticism of the law was cresting and politicians were considering changes.  

“Districts may have understood it was a nudge and a wink and it didn’t really have teeth,” he said of the law.

No Child Left Behind’s replacement, the Every Student Succeeds Act, takes a different tack. Instead of giving each state discretion in how many schools are identified as failing and requiring them to ramp up the consequences over time, the law requires each state to identify 5 percent of schools as low-performing.

The latest study suggests that might be a preferable approach if states are able to figure out better ways to help a small group of struggling schools improve. Turnaround efforts — including a prominent federal program backed by a lot of money — have often produced disappointing results.

“It remains unclear how states will implement ESSA,” write the researchers. “But the federal law will likely not succeed if performance requirements are not accompanied by additional support for educators.”