outlier

Actually, N.Y. did okay one city school's teacher evaluation plan

Staten Island's John W. Lavelle Preparatory Charter School is the only school in the city and the only charter school in the state with a state-approved teacher evaluation plan.

In the aftermath of New York City’s failed teacher evaluation negotiations, a small detail has gone unnoticed: There actually is one city school with a state-approved teacher evaluation system.

Surprised?

“We were surprised, too,” said Ken Byalin, president of John W. Lavelle Preparatory Charter School, a Staten Island secondary school with an emphasis on serving students with emotional challenges.

“When we saw there were no approved plans by charter schools, we thought, ‘Oh my god, what are we doing?’” Byalin said. “We were out in front in a way we hadn’t expected to be.”

Though alone among charter schools, Lavelle is hardly the only school in the state to beat the city Department of Education to creating a teacher evaluation system: More than 700 districts did. But as the smallest school in the state to write a system in line with the state’s requirements, Lavelle offers a unique look inside what teacher evaluation requires.

Even with just 37 teachers and fewer than 300 students, no unions to contend with, and practice assessing teacher quality that predated the state’s 2010 evaluation law, Lavelle’s top staff nevertheless worked nonstop for nearly a week to hammer out a plan that would pass muster with state education officials. And they are already planning to revisit their work this summer.

Hashing out an evaluation plan

Byalin said the school chose to meet the state’s Jan. 17 deadline, even though the deadline did not apply to charter schools, because of the prospect of federal support for its teacher training efforts. The state had awarded the school a $16,500 “Strengthening Teacher and Leader Effectiveness” grant from its federal Race to the Top funds, but made cashing the check contingent on having an approved evaluation plan in place.

As they began planning to design a system that followed the state’s rules, Lavelle administrators had a distinct advantage: Unlike most school districts, including New York City, the school had been evaluating teachers based on a variety of measures, including student performance, for years. Since it opened in 2009, Lavelle had been testing students and observing teachers in ways that would allow the school to meet the state’s requirements relatively easily. The school began tightening those practices earlier this year, when it joined a project led by the nonprofit CEI-PEA to help charter schools develop performance pay systems.

“This is just data in a different calculation,” Chris Zilinski, an eighth-grade teacher who has been at the school since shortly after it opened, said about the new evaluation system.

“What we tried to do is to keep [the state evaluation plan] as consistent as we could with what we’ve been doing, and refining and building on that,” Byalin said. Even so, he said, as the state’s deadline approached, the school had “probably three or four people working around the clock the last four or five days to get it done.”

For the 40 percent of evaluations that must be based on student performance, the school selected state-approved tests produced by private vendors to measure student growth in science, social studies, and high school academic subjects that do not have state exams. Physical education, art, and Spanish teachers will be graded according to the entire student body’s improvement on state math and reading tests.

Sixty percent of each teacher’s rating — the full amount allowed for measures other than student performance — will come from his or her score in an observation conducted according to the Danielson Framework, the same model the city plans to use whenever it does adopt new evaluations.

Like most districts across the state, Lavelle submitted a plan that would only cover one year — an arrangement that Mayor Bloomberg pilloried last month as a “sham” meant to dilute the power of an agreement. Bloomberg rejected a teacher evaluation deal for the city because of a two-year “sunset” that he said the city teachers union was demanding. “If the agreement sunset in two years, the whole thing would be a joke,” Bloomberg said at the time.

At Lavelle, administrators and teachers said they wrote the plan to apply only to this year because they expect the evaluation system will need to evolve as the school adds new grades each year and officials learn from each round of ratings.

“We will see and teachers will see which of the [assessments the school selected] seems fair and which seem to be completely distorting,” Byalin said. “The plan that we submit for next year will be informed by what happens this year.”

Teachers’ voice

Of course, unlike the city Department of Education, administrators at Lavelle — whose teachers are not represented by a union — did not have to get teachers’ signoff before submitting an evaluation plan to the state. But Byalin said they worked to get teachers comfortable with the new system anyway. He cited both altruistic and pragmatic reasons.

“Part of the reason this feels safe here and doesn’t in some of the bigger [school] systems is that just like everything we do, it’s bottom up,” he said. “The advantage that we have is the ability to hear each person. While it’s a lot of work for us, it doesn’t have the same kind of cost that it does when you’re bringing together a huge bureaucracy.”

The evaluation system has already changed because of input from teachers, according to Zilinski, the eighth-grade teacher. Last year, the school used a set of nationally normed assessments called the Measures of Student Progress, but he said, “I don’t think our teachers were as happy with that as they could be.”

After looking at other assessments, teachers determined that tests produced by Scantron, which are also online and nationally normed, better reflected their goals for their students, Zilinski said. Now, the school is using Scantron assessments in all high school courses that do not have state Regents exams.

“It’s great to be able to say what assessments to base this on,” he said. “That’s a high level of teacher input.”

But Zilinski said he thought there was still room for Lavelle’s evaluation system to improve, for example by reflecting more than just what happens inside individual classrooms. Teachers run a variety of elective programs, such as mock trial, choral performance, and sports journalism, but excellence in those areas would not influence a teacher’s score under the school’s evaluation system.

“Right now my understanding is that the performance is based on numbers,” Zilinski said. “Those intangibles — I absolutely do believe they should factor in.”

Byalin, the charter school’s president, said future versions of the evaluation system are likely to grant credit for teacher leadership. (The state funding will let the school get help from Wagner College to figure out the best way to assess leadership.) He also said the school would likely add peer review to the subjective measures that influence teachers’ ratings and would carefully scrutinize the results to make sure that having many students with special needs does not put teachers at a disadvantage.

The biggest change on the horizon for the school isn’t about what goes into teacher ratings, but how they are used. As part of the latest cohort in CEI-PEA’s performance pay project, Lavelle will soon begin basing all raises are based on performance, rather than years of service. It’s a paradigm that Zilinski says all teachers buy in to before they join the staff.

“This is our culture, so what we’re doing in adopting [new teacher evaluations] is tweaking the method, not introducing new values,” Byalin said.

An early adopter among charter schools?

Whether other charter schools will follow Lavelle’s lead and submit teacher evaluation plans to the state is not clear. Like Lavelle, many other charter schools lack teachers unions, test students regularly, and aim to reward high-performing educators.

But the charter sector has so far resisted efforts by state education officials to get its schools to submit teacher evaluation plans. In December, charter school advocates urged school leaders not to fulfill a state request for teacher performance data.

That could change as the state makes more Race to the Top money available only to schools with teacher evaluation systems in place. Harvey Newman, co-director of CEI-PEA’s charter school performance pay project, said he has encouraged participating charter schools to use the state’s teacher evaluation requirements as a guide so that they can easily gain state approval when they want it.

“You’re going to have this requirement, whether it’s this year or next year or the next year,” Newman said he tells charter schools that are considering joining CEI-PEA’s Teacher Incentive Fund program. “Only now we’ll help you through the process.”

And more than money is at stake for charter schools to develop teacher evaluation systems that meets the state’s requirements, Byalin said.

“For charters to sit outside of this is going to become very, very difficult,” he said. “Part of the premise of charters is transparency and accountability. Either they’re going to have to do this system, or they’re going to have to come up with an alternative and justify why they are doing it that way.”

Trade offs

Indianapolis is experimenting with a new kind of teacher — and it’s transforming this school

PHOTO: Teachers and coaches meet at Indianapolis Public Schools Lew Wallace School 107.
Paige Sowders (left) is one of three multi-classroom leaders who are helping teachers at School 107.

Teachers at School 107 are up against a steep tower of challenges: test scores are chronically low, student turnover is high and more than a third of kids are still learning English.

All the school’s difficulties are compounded by the struggle to hire and retain experienced teachers, said principal Jeremy Baugh, who joined School 107 two years ago. At one of the most challenging schools in Indianapolis Public Schools, many of the educators are in their first year in the classroom.

“It’s a tough learning environment,” Baugh said. “We needed to find a way to support new teachers to be highly effective right away.”

This year, Baugh and the staff of School 107 are tackling those challenges with a new teacher leadership model designed to attract experienced educators and support those who are new to the classroom. School 107 is one of six district schools piloting the opportunity culture program, which allows principals to pay experienced teachers as much as $18,000 extra each year to support other classrooms. Next year, the program will expand to 10 more schools.

The push to create opportunities for teachers to take on leadership and earn more money without leaving the classroom is gaining momentum in Indiana — where the House budget includes $1.5 million for developing educator “career pathways” — and across the country in places from Denver to Washington. The IPS program is modeled on similar efforts in North Carolina led by the education consulting firm Public Impact.

At School 107, Baugh hired three new teachers, called multi-classroom leaders, who are responsible for the performance of several classes. Each class has a dedicated, full-time teacher. But the classroom leader is there to help them plan lessons, improve their teaching and look at data on where students are struggling. And unlike traditional coaches, they also spend time in the classroom, working directly with students.

As classroom leaders, they are directly responsible for the test scores of the students in their classes, said Jesse Pratt, who is overseeing opportunity culture for the district.

“They own that data,” Pratt said. “They are invested in those kids and making sure they are successful.”

At School 107, the program is part of a focus on using data to track student performance that Baugh began rolling out when he took over last school year. It’s already starting to bear fruit: Students still struggle on state tests, but they had so much individual improvement that the school’s letter grade from the state jumped from a D to a B last year.

Paige Sowders, who works with classes in grades 3 through 6, is one of the experienced teachers the program attracted to School 107. After 9 years in the classroom, she went back to school to earn an administrator’s license. But Sowders wasn’t quite ready to leave teaching for the principal’s office, she said. She was planning to continue teaching in Washington Township. Then, she learned about the classroom leader position at School 107, and it seemed like a perfect opportunity to move up the ladder without moving out of the classroom.

“I wanted something in the middle before becoming an administrator,” she said. “I get to be a leader and work with teachers and with children.”

PHOTO: Dylan Peers McCoy
The multi-classroom leaders meet regularly with teachers and district coaches to review data and plan lessons.

The new approaches to teacher leadership are part of a districtwide move to give principals more freedom to set priorities and choose how to spend funding. But those decisions aren’t always easy. Since schools don’t get extra funding to hire classroom leaders, Baugh had to find money in his existing budget. That meant cutting several vacant part-time positions, including a media specialist, a gym teacher and a music teacher.

It also meant slightly increasing class sizes. Initially, that seemed fine to Baugh, but then enrollment unexpectedly ballooned at the school — going from 368 students at the start of the year to 549 in February. With so many new students, class sizes started to go up, and the school had to hire several new teachers, Baugh said.

Some of those teachers were fresh out of college when they started in January, with little experience in such challenging schools. But because the school had classroom leaders, new teachers weren’t expected to lead classes without support. Instead, they are working with leaders like Sowders, who can take the time to mentor them throughout the year.

With teachers who are just out of school, Sowders spends a lot of time focusing on basics, she said. She went over what their days would be like and how to prepare. During the first week of the semester, she went into one of the new teacher’s classes to teach English every day so he could see the model lessons. And she is working with him on improving discipline in his class by setting expectations in the first hour of class.

Ultimately, Baugh thinks the tradeoffs the school made were worth it. The extra money helped them hold on to talented staff, and they have the bandwidth to train new teachers.

“If I’m a novice teacher just learning my craft, I can’t be expected to be a super star best teacher year one,” he said. “We learn our skill.”

school turnaround lessons

Too many good teachers are quitting Tennessee’s Achievement School District, researchers say

PHOTO: Micaela Watts
Students at Cherokee Elementary, an iZone school in Memphis, engage with their teacher. Tennessee's iZones have had success recruiting teachers with high marks in the state's teacher evaluation system.

A growing question in Memphis and across Tennessee has been why local school improvement efforts seem to be outperforming the state’s 5-year-old flagship initiative.

Now, researchers charged with studying that initiative have a hypothesis: Schools in the Achievement School District have struggled to hold on to their highest-rated teachers.

For their latest report, released on Tuesday, researchers at the Tennessee Education Research Alliance at Vanderbilt’s Peabody College partnered with the University of Kentucky to examine the extent to which the ASD and local turnaround initiatives called innovation zones, or “iZones,” have been able to recruit and retain teachers with top ratings.

They found that ASD teachers left their jobs far more frequently than teachers in iZone schools in Memphis, Nashville and Chattanooga.

That wasn’t a surprise the first year a school was in the ASD, given the requirement that teachers in turnaround schools must reapply for their jobs.

But even in following years, fully half of the ASD’s teachers left its schools each year. Among iZone schools, the corresponding rates were 40 percent and 23 percent, respectively.

In both initiatives, lower-rated teachers were replaced by better ones. Researchers found this to be more pronounced in iZone schools where, on Tennessee’s 5-point scale, incoming teachers scored an average of more than a half point higher than those moving to other schools or leaving the profession. In the ASD, incoming teachers averaged just over a third of a point  higher than outgoing teachers.

“The story seems to be one of general success in getting effective teachers in the door of these turnaround schools, and the iZone schools are also managing to keep and improve them,” said Vanderbilt’s Gary Henry, who co-authored the report.

Henry said disruption is a key part of school turnaround work, and that it might be necessary to lose some bad teachers before a school can thrive. But just as necessary is improving teachers already at a school — and that takes time.

“The iZone hired good teachers, kept good teachers, and their teachers improved,” he said.

Both iZones and the ASD had more difficulty recruiting good teachers for the schools they absorbed in the 2014-2015 school year. Henry said it’s not clear why that happened.

It could be because both the ASD and the Memphis iZone, the largest of the three, added high schools, and it’s typically harder to get effective high school teachers to switch schools. Or, it could be that Memphis, where nearly all of the ASD schools are located, needs more good teachers in general.

“Memphis might be reaching a ceiling on the number of effective teachers willing to move into priority schools,” he said of schools that are academically in the state’s bottom 5 percent. “They’re going to have to expand their pool in order to attract the type of talent needed to transform the lowest-performing schools.”

The researchers note that the iZone gains might not last. The one in Memphis has used teacher pay incentives to lure high-quality teachers to its schools, relying at least in part on philanthropic funds. Without those funds, it’s not clear if the iZone could be expanded or sustained.

“It’s terrific when philanthropies are able to support mechanisms proven to work,” he said, “but in the long run, it’s uncertain whether Memphis will be able to maintain these gains.”

ASD Superintendent Malika Anderson said she is heartened that more effective teachers have moved to working in historically low-performing schools. She attributed the ASD’s initial recruiting challenges to being “a big unknown,” but expressed optimism about the future.

“As we increase recruitment and retention of effective teachers in our schools, the ASD’s growing priority is to champion the efforts of local districts, community partners and the Department of Education to strengthen the pipeline and critical supports for effective teachers in all schools,” Anderson said in a statement.

This report follows a high-profile 2015 study that showed schools in Tennessee’s iZones had positive effects on student learning, while the ASD’s effects were statistically insignificant.  Henry said Vanderbilt researchers hope to examine in the future how school quality was impacted at the schools left by highly rated teachers to go to the iZone or the ASD.

You can read the full report here.