high stakes

There’s always been confusion surrounding Tennessee’s growth model. With a missing year of data, new questions pile on

At a time when scores are about to be used for high-stakes decisions in how to improve Tennessee’s schools, gaps in the state’s data and uncertainty about how scores were derived have left Memphis officials wondering how to interpret the torrent of information.

Last year’s chaotic state testing, which led to the cancellation of the state’s test for grades 3 to 8, left a crucial gap in the data meant to help make decisions about schools and teachers.

School leaders have also said they were puzzled by the state’s methodology in reaching the so-called growth scores upon which districts and schools are judged — particularly by how they arrived at the Memphis district’s low score.

Even those who are paid to sift through the data say they are having trouble getting answers to questions about the growth scores, known as TVAAS. Bill White, chief of planning and accountability for Shelby County Schools, conceded to board members last week that he didn’t know the ins and outs of the complex formula and the changes meant to compensate for the missing data.

“I have personally never been shown all the mathematics behind our data and how this works,” he told board members. “I do know that it has been peer-reviewed and vetted and it’s essentially been held up among those statisticians. But there is a lot that goes on behind the scenes that no one has been able to walk us through.”

The confusion has renewed skepticism about the state’s value-added model, which is supposed to help officials identify the impact that schools and teachers have on student performance. The system relies on the state’s data measuring student growth in districts.

Part of the problem is last year’s botched testing, which is having multiple ripple effects throughout the state.

This year, growth scores are comparing 2016-17 test results with the 2014-15 school year, the most recent data available. That throws a wrench in how to assess which school or teacher is responsible for a child’s growth over a two-year period. And for elementary schools, that means there is no data for fourth graders this year since testing in third grade, the first year students take state tests, was canceled.

In addition, one subject was dropped entirely from TVAAS calculations because social studies questions were a trial run for elementary and middle schools students and did not count.

Statisticians for the most part have figured out how to calculate growth even when a state transitions to a new test. But the missing data creates a whole other host of challenges the revisions attempt to account for.

One Memphis charter leader said he still isn’t quite sure how his school even got a score since last year his highest grade level at the school was third grade, the first year of testing.

“It’s such a convoluted formula, it’s hard for us to understand. We’re not sure how we got (our score),” said the charter leader, who declined to be named because he was still seeking answers from the state.

Damian Betebenner, a senior associate at Center for Assessment that regularly consults with state departments, said missing data on top of a testing transition “muddies the water” on results.

“When you look at growth over two years, so how much the student grew from third to fifth grade, then it’s probably going to be a meaningful quantity,” he said. “But to then assert that it isolates the school contribution becomes a pretty tenuous assertion… It adds another thing that’s changing underneath the scene.”

At the same time, TVAAS scores for struggling schools will be a significant factor to determine which improvement tracks they will be be placed on under the state’s new accountability system as outlined in its plan to comply with the federal Every Student Succeeds Act. For some schools, their TVAAS score will be the difference between continuing under a local intervention model or being eligible to enter the state-run Achievement School District. The school growth scores will also determine which charter schools are eligible for a new pot of state money for facilities.

The state has data analysts based across Tennessee to help districts with their questions and provide data simulations for the complex formula that has been replicated in other states.

“Of course, the reason it is complex is because we want it to be fair for educators and therefore capture as much data and nuance as possible – which is discussed at length in the technical documentation,” said a state department spokeswoman.

The state has also published an overview video of how the formula works and details on the recent changes in a 46-page, formula-packed document from SAS, the private company that calculates teacher and school scores for the state.

But as far as knowing how the state gets from A to Z, White said he still has questions.

“I’ve had some questions about getting access to certain data myself,” said White, who routinely interprets data for the district. “We would like a lot more access to what goes into TVAAS.” (He later declined to elaborate.)

He’s not the only one. When the Tennessee Education Association unsuccessfully sued Knox County Schools over its use of TVAAS in awarding teacher bonuses, access to data on how the scores were calculated was central to the association’s argument that the district denied teachers due process, said Rick Colbert, TEA’s general counsel.

When Colbert attempted to subpoena technical documents on the calculations, SAS blocked it partially because the request would divulge “trade secrets.”

“When they’re called upon to defend it you get a lot of general statements but you can’t get a lot of information to see if you can back that up,” Colbert said. “There’s so much about TVAAS that can’t be explained.”

Board member Mike Kernell called it a double standard and asked White last week if the district could request a demonstration of the complicated formula.

“I think the state department of education ought to show its work if they’re asking children to show their work,” he said.


During Memphis visit, former Newark schools chief touts ways to change student discipline

PHOTO: Governor's Office/Tim Larsen
Cami Anderson when she was superintendent of schools in Newark, New Jersey.

As the top schools chief in Newark, Cami Anderson was horrified at the strict discipline policy she saw in one of her high schools. Since then, she has left the New Jersey district and taken her ideas on the road about reducing suspensions and moving away from exclusionary discipline practices.

This week, Anderson came to Memphis as part of her Discipline Revolution Project at the invitation of Stand for Children Tennessee, The Community Foundation of Greater Memphis, School Seed, and Shelby County Schools. The New Teacher Project is partnering with her on the national tour.

Anderson has been meeting with Shelby County Schools administrators and board members as well as charter school leaders, philanthropists, education advocates, and students. Her time will culminate in a public event hosted by Stand for Children on Thursday at the National Civil Rights Museum.

Chalkbeat sat down with Anderson after she explained to a group of about 40 charter leaders her six focus areas to reduce classroom disruptions while also preventing sending students home when they’re in trouble. (This interview was edited for clarity and brevity.)

Related story: Tennessee students more likely to be suspended if they’re black boys — or live in Memphis

Question: How did you land on student discipline as an area you wanted to focus on?

Answer: If there’s actually a thread in my career, it’s this. I essentially ran the system of supports for the kids in New York City who are on their last stop on the train, so to speak. I’ve always worked with kids who are marginalized, the ones who really struggled in school. So, I’ve spent a lot of time thinking about what we need to get better at collectively to serve all kids, to really embrace the “all means all.” That’s been my lifelong question.

The three areas to me where inequities are most obvious are: enrollment policies, how we handle discipline, and mobility and how a kid stays connected to school. Discipline is where it comes to a head. It’s both a place where our collective inability to reach all kids shows up and it’s also an opportunity if we actually figure out how to prevent young people from misstepping in the first place, but then respond in healthy ways when they do Then we’d actually start to solve the broader equity issues.

Q. School leaders say they don’t want to have a lot of suspensions because students miss out on class. But they’re also not sure what to replace suspensions with to manage student behavior well. What would you say to them?

"You can’t just be against something. You have to be for something."Cami Anderson

A. That’s one of the main reasons we started Discipline Revolution Project. We don’t want you to do X, whatever X is: suspend kids, use corporal punishment. But educators are saying, rightfully so, then what are we doing? Our whole framework is trying to answer that question and give them tools to get to the “why” behind finding alternative responses.

Most people who use punitive or exclusionary discipline don’t actually think it works that well. They just don’t have a lot of other tools. So, when you give folks a lot of other tools and they find that it works, it’s a very powerful thing. When people try out a restorative conference, they say “Oh, I feel better. The kid feels better. And we actually got back to the lesson faster.” You can’t just be against something. You have to be for something.

I’ve heard a lot of demand for basics of restorative practices (conflict resolution between students and students and teachers), though I don’t think they should stop there. They want training for student support teams. And overwhelmingly, the places I’ve been want to talk about how teacher bias plays into who gets disciplined, but they don’t know how to start the conversation and for it to be productive.

Q. Memphis’ two school districts have emphasized a bottom-up approach on discipline reform: adding behavior specialists, school counselors, soliciting support from principals and teachers. How have you seen other districts do it?

"Policy-level change is critical but insufficient if you only do that."Cami Anderson

A. I’ve seen districts lead with policy and only make statements declaring they will cut suspensions in half or put a moratorium on suspensions or rewrite their policy. Policy-level change is critical but insufficient if you only do that. What you see is folks who are actually on the ground working with students may not have the strategies to replace it with something productive. That causes people to be more entrenched in their views that discipline reform wouldn’t work, some schools subtly pushing kids out, underreporting discipline data, all that.

I’ve also seen the opposite where it’s all about professional development and capacity but at no point is there is any accountability for those same schools, for example, that suspend 90 percent of the kids. People watch what you do, not what you say. If you don’t align your policies and your actions with your values, then you also have limits to the impacts you have for kids.

Frustrated with high suspension rates, Memphis schools shift to restorative justice

I’ve come to believe you need all of it and you need everyone working together. Stop admiring the problem and get on to the solutions.

Q. What pushed student discipline practices more widely into the national conversation? What have you observed from the conversation here in Memphis?

A. People are looking at data, which is a good thing, and seeing patterns like everyone else. Another thing is I believe a lot of people who got into education reform are completely dedicated to equity. And now they’re seeing this side of it, and like someone said in the training today, they feel a sense of “healthy guilt.” I think it’s great they’re having the courage to be honest. And then a lot of folks had kids. You start thinking, “Do I want any of that happening to my own kid?” I’m personally heartened and encouraged and motivated to see a collective sense of responsibility and focus on this.

There’s a lot of energy and candor in Memphis about this issue. Some other cities I’ve been in think they have it figured out when they don’t. When there’s that much energy, I think anywhere — including in Memphis — people can be tempted to devolve into the blame game, no matter what district or charter hat you wear. That energy can be the greatest asset or greatest liability.

Study: When Chicago cut down on suspensions, students saw test scores and attendance rise

Q. The school shooting in Parkland has been a catalyst for more conversations about the trauma students bring into the classroom — conversations that were already happening about violence in low-income communities of color. What would you say to school leaders on how to address that?

A. I’m most interested to know what adults can do to mitigate those risk factors for young people who experience trauma. I feel like it could take us down a very bad path to just observe that there are things called “adverse childhood experiences.” To me, that’s not enough. The question then is what are the environments and strategies that we can put in place as educators and adults to mitigate the impact of those traumatic experiences. Things like relationships, trust, consistency, high expectations, high supports, and support healthy identity development especially in times of conflict. We know from research that young people who face long odds who ultimately prevail, they are exposed to environments that really embody those things.

You can both be aware of and acknowledge those experiences that make it harder for them to succeed in school. But if you stop there, I don’t think you’re doing justice to young people. There are things we can do in schools to help create the environment to help them succeed.


Denver parents worry budget changes will hurt students with special needs, despite district assurances

PHOTO: Helen H. Richardson/The Denver Post
Josue Bonilla, 13, left, gets a high five from his teacher Wendi Sussman, right, after completing a hard reading lesson in his multi-intensive special education class at STRIVE Prep charter school in Denver in 2016.

Denver parents of students with disabilities are concerned that an impending reorganization of the school district’s special education department will have a negative impact on their children.

Specifically, parents are worried about cuts to the number of special education teachers and paraprofessionals, teacher’s aides that one advocate called “the backbone of special education,” the people who often help students follow directions or focus on their schoolwork.

District officials insist the reorganization does not cut paraprofessional or teacher support. Any reductions families are experiencing, they said, are the result of school-level budget constraints as the number of students with disabilities at those schools ebbs and flows.

In fact, officials said the reorganization is meant to increase the number of adults working inside schools – a change they said will benefit all students, not just those with special needs. The plan calls for trimming $4 million from the district’s billion-dollar budget by shrinking the pool of central office staff who help school principals serve students with disabilities. That money would be reallocated to fortify mental health services for all students, including by providing every district-run school with at least one full-time social worker or psychologist.

Some parents of students with disabilities are skeptical. Their feelings speak to the tenuousness of resources for special education students and distrust that they’ll get the services they need. Federal law guarantees students with disabilities a “free and appropriate” education. What that means in practice can a subject of disagreement among districts, parents, and advocates.

“The improvements that they’re proposing to make, they’re all great,” said Jeanne Posthumus, whose sixth-grade daughter has a rare genetic disorder and receives special education services at a Denver charter school. “But don’t do it on the backs of kids with special needs.”

About 10,000 of the 92,600 students in Denver Public Schools have disabilities, according to district statistics. They have historically lagged far behind their peers in reading, writing, and math. Last year, 44 percent of Denver fourth-graders without disabilities met expectations on the state literacy test, while just 8 percent of fourth-graders with disabilities did.

Eldridge Greer, the district’s associate chief of student equity and opportunity, said the reorganization, which is set to go into effect on July 1, is meant to “dramatically improve academic outcomes and truly meet the promise of special education.”

Part of the problem with the system as it exists now, Greer said, is that the central office staff who help school principals end up spending too much time putting out fires related to student behavior and too little time working on improving academic instruction.

The proposal calls for eliminating about 30 of those central office positions, as well as some supervisory and vacant positions in the same department. The positions that remain will focus on academics, including coaching and training special education teachers, Greer said.

Managing student behavior will become the responsibility of a bigger corps of mental health workers hired with the savings, he said. Most schools already have social workers and psychologists, but not all of them can afford to have one on staff five days a week.

That’s despite a tax increase approved by voters in 2016 that included $10.9 million to hire more mental health workers and nurses. The money was split among schools based on enrollment, with extra allotted to those with high needs, district officials said. But it still left some smaller and more affluent schools without five-day coverage, which principals have said is crucial.

“We’re seeing so many more young children in kindergarten with severe behavioral needs,” said Robin Kline, the principal at Steck Elementary, a high-achieving school in southeast Denver that serves a wealthier student population. “Whether or not they’re special education, they require a level of special education, figuratively, that requires a lot more one-on-one.”

The proposal also calls for hiring eight more “behavior techs,” who are specially trained professionals or paraprofessionals who can be deployed to schools for weeks at a time to help manage behavior crises. The district has seven behavior techs this year.

In addition, elementary schools with special programs for students with emotional needs would get an additional $50,000 to spend on paraprofessionals, mental health workers, or teachers.

The reorganization, Greer said, “creates role clarity and enables the instructional specialists to do what they do best.” He emphasized that the district is not cutting its special education budget, and he said it would continue to provide services to students who qualify. The district spends $1,300 more per student on special education now than it did in 2013, he said.

Parent Danielle Short said families are confused by the changes. Her 7-year-old son, Micah, has Down syndrome and was treated for leukemia. He’s currently in a kindergarten class taught by one teacher and two paraprofessionals. Though the paraprofessionals are there to help all of the students in the class, she said they spend a lot of time with Micah, helping him in the lunchroom and the bathroom, and keeping an eye on him in the hallways.

The first grade class at Micah’s school has just one part-time paraprofessional. To keep Micah fully included with his peers, rather than in a separate classroom, Short said his special education team has determined he needs a dedicated paraprofessional next year.

“It’s not my vision for him to have para glued to his hip,” she said. “But he needs one right now.”

She’s worried the reorganization will affect Micah’s ability to get one, especially since families at other schools said they have been told their students’ one-on-one paraprofessionals may be cut next year. Greer denied that’s the case, but he said he understands the parents’ reaction.

“When we try to make this system change, it can create incredible anxiety because people remember just a generation ago how hard it was to get students with disabilities through the schoolhouse door,” Greer said.

His assurances haven’t completely assuaged parents’ fears. Short said that while she’s grateful that schools will get more mental health support next year, she wants to make sure her son’s more specific needs are met, too.

“The psychologist has been helpful for my son,” providing strategies to help with some of his behavior, Short said. But, she added, “his needs are not met by increasing the psychologist from half-time to full-time. He has other needs that should be funded by the district.”

Short was among a group of parents who pleaded with the school board at its monthly meeting Thursday to, in the words of another mother, “stop pillaging special education funds.”

Christy Pennick told the board her son’s school, Swigert International in northeast Denver, is already feeling the effects: Instead of two special education teachers, it will have one next year.

Swigert principal Shelby Dennis confirmed that the district’s formula for allocating special education funding, which she said is based on the level of service students need, has allotted the elementary school one fewer special education teacher next year.

But Dennis said she doesn’t know if that’s a result of the reorganization or not. Since the district ran its formula for Swigert, one student with disabilities has transferred into the school and three more have qualified for special education services, she said. Given that, she said she’s hopeful the district will increase Swigert’s allotment in the fall. Even if it doesn’t, she said she was able to find $30,000 in her budget to hire a part-time teacher for next year to fill in some of the gap.

Pam Bisceglia, executive director of Advocacy Denver, a civil rights organization that serves people with disabilities, said it’s stories like that that raise red flags.

“What parents are hearing once again is where cuts are being made is to special education,” Bisceglia said. “It says their kids aren’t as important.”