evaluation evaluation

City says teachers improved during pilot observation process

Distribution, by effectiveness rating, of 300 teachers who were part of a two-year observation pilot.

City teachers got better when they participated in a two-year teacher evaluation pilot program, Chancellor Dennis Walcott announced today.

Of 300 teachers who were observed and given systematic feedback multiple times for consecutive years, the number with the lowest rating on a four-tiered evaluation system fell by half and the number with the highest rating more than doubled. Officials said the trends were evidence that when used correctly, a citywide evaluation system would help teachers improve.

The teachers were among 5,000 who participated last year in the city’s Teacher Effectiveness Pilot, in which some schools practiced using a style of teacher observations called the Danielson Framework. The model is a way of advising and assessing teachers based on multiple observations throughout the year and is seen as likely to count for a significant component of teachers’ annual ratings in the future.

Walcott announced the numbers during an address at the Schools for Tomorrow conference hosted by the New York Times. His speech centered on the city’s efforts to boost teacher quality and took a gentler tone about the purpose of teacher evaluations at a time when city and union officials are expressing optimism about reaching a deal on instituting a new evaluation system. Gov. Andrew Cuomo has said he will withhold some state aid from districts that have not adopted new teacher evaluations by January 2013.

“Across all categories, from the weakest to the strongest, we saw teacher improvement,” Walcott said during his address. “It’s time to bring these results to every student in every school through a citywide evaluation deal.”

For the year that the city and United Federation of Teachers have been sparring over evaluations, city officials have typically argued that a tougher system is needed both to give teachers meaningful feedback and also to usher more weak teachers out of the classroom.

But Walcott’s speech did not mention the low ratings, which the Department of Education made available later. Instead, he focused on the teachers in the pilot with “effective” or “highly effective” ratings and on the improvement of individual teachers over time.

UFT President Michael Mulgrew said he was pleasantly surprised by the change in tone.

“I’m very happy that the chancellor is saying he can have an evaluation system that supports teachers,” he said. “Maybe they are taking us more seriously about how any evaluation has to be focused on how to help teachers get better.”

Chancellor Dennis Walcott at today's Schools For Tomorrow Conference.

The Danielson Framework is not part of the way teachers are currently rated. But the city has enlisted hundreds of schools to practice using it in the hopes that it will become part of whatever evaluation system the city and union ultimately negotiate. State law requires new evaluation systems to sort teachers into four categories from “highly effective” to “ineffective” and to use subjective measures such as observations for 60 percent of final scores. The other 40 percent must be based on student performance, including test scores.

In the Teacher Effectiveness Pilot’s first year, when only 20 schools and 600 teachers were included, 6 percent of teachers were rated “highly effective” and 10 percent were “ineffective,” according to data provided to GothamSchools by the department. Last year, with 108 schools and 5,000 teachers in the pilot, the number of “ineffective” teachers fell to 5 percent — and the proportion of highly effective teachers more than doubled, to 11 percent. This year year, 9,000 teachers at 215 schools are participating in the pilot.

But the 300 teachers who participated in the pilot for both years fared even better. In 2011, 7 percent of the teachers were “ineffective” and 5 percent were rated “highly effective,” according to city data. This year, after multiple rounds of feedback, just 3 percent of the teachers still had the lowest score — and the proportion with the highest rating had more than doubled, to 11 percent.

The findings have led department officials to conclude that consistent feedback really can lead to better teachers.

“I think biggest thing the data showed us is that the system is not a system of gotcha or a system to get rid of lots and lots of low performing teachers,”  said David Weiner, the deputy chancellor in charge of teacher quality, after Walcott’s speech. “It’s really a system to help teachers develop and, when implemented correctly, it really seems to actually help them get better and that really is the point of the new evaluation system.”

A year ago, when a teacher evaluation deal for some schools seemed near, emphasis on the Danielson Framework was at a fever pitch and concerns were widespread. Some school leaders said they worried about having the time to conduct observations in more depth and more frequently. And some teachers and the teachers union raised the alarm about some principals using the rubric inappropriately, a charge that the architect of the rubric herself supported.

Walcott said today that surveys of participants in the Teacher Effectiveness Pilot showed that most were satisfied with their experiences. Three quarters of the principals reported that giving feedback had boosted student achievement at their school. And three quarters of teachers said their students’ growth reflected their effectiveness, Walcott said. Weiner said the satisfaction numbers increased over the course of the pilot.

For the 300 teachers who participated in both years of the pilot, the city has also used the state’s new “growth scores” to figure out what they would have gotten on evaluations that adhere to the state’s requirements, Weiner said. He declined to share the overall ratings but said they correlated strongly with the teachers’ Danielson ratings.

Officials said they were particularly heartened to see that effectiveness ratings correlated to some of the ways that the city assesses school performance. For instance, there was a correlation between schools with high scores on their quality reviews and the number of effective teachers working in those schools. The same statistical relationship existed for schools that received positive feedback on surveys from teachers, parents and students.

There is also a significant correlation between a school’s overall progress report grade and the number of effective teachers who work there. There is no correlation to the progress component of the report card, however.

Weiner said that the city did not yet plug the state’s new “growth scores”, compiled from standardized test results, into the pilot evaluations. Those test scores are being used by other districts and nearly 85 percent of 36,000 teachers statewide who received a score rated highly effective or effective.

But teachers dropped out of higher rating categories once data analysts added in measures of learning that pilot schools used internally — such as interim assessments. For instance, the number of teachers rated effective and highly effective dipped by 15 percentage points once the assessment data was added. The rate of ineffective teachers climbed by 5 percentage points, from 10 to 15 percent.

But Weiner said it was promising that the majority of teachers stayed in the same rating category.

“So it wasn’t like we were seeing massive changes,” Weiner said, “which we consider, by the way, very good. It means the new observation process is basically aligned to what we’re seeing with metrics of student learning.”


Remarks of Chancellor Dennis M. Walcott
As delivered on September 13, 2012

Good afternoon. It’s a pleasure to be here and I appreciate the opportunity to be a part of this conversation.

As a former New York City public school student, now a grandfather of a New York City public school student, I wake up every morning blessed with the fantastic opportunity to lead the country’s largest school system and charged with shaping the destiny of 1.1 million students.

And, I taught kindergarten, so I know firsthand that teaching is the toughest job in the world.

Our teachers’ commitment has been a critical part of the progress our public schools have seen in the last 10 years: Graduation rates, test scores, college readiness – across any metric, our schools and students are improving. And we are proud of that success.

We are also far from done.

The Mayor and I believe, and the research shows, that the most important factor in a student’s success is a highly effective teacher in every classroom.

That’s why in New York City we have made teacher quality and support our priority.

First, we must recruit, reward and retain the best teachers. That’s why we’ve raised base salaries and continue to propose ways to attract the best and brightest.

Today, I would like to share – for the first time – results from our collaboration with the UFT on a teacher effectiveness pilot.

This pilot ran alongside our existing rating system, and aligns with the new state law requiring a rating system with four performance levels: highly effective, effective, developing or ineffective.

· When we started our pilot with 600 teachers in 2010, 5% of the teachers were rated highly effective, 45% were found to be effective.

· Now, 11% are highly effective and 49% effective.

· And across all categories, from the weakest to the strongest – we saw teacher improvement.

It’s time to bring these results to every student in every school through a citywide evaluation deal.

Let’s guarantee that quality in Tribeca is the same as quality in Tremont.

Teacher effectiveness will no longer be a matter of opinion.

We have established evaluation standards for high quality teaching that has proven to increase student achievement.

We are giving teachers objective assessments they can use to improve. Everyone can raise their game – from rookie teachers to 30 year veterans of the classroom.

We’ve invested over $25 million dollars, leveraging federal funds from Race to the Top, to get our teachers to the top.

We’ve learned from this pilot that standards work. Teachers can improve and they do.

Today, the pilot is in 215 schools citywide.

Giving 9,000 teachers real time, practical feedback and support so they can excel in the classroom.

Reaching 100,000 students every day.

And here’s what it looks like:

· Teachers get clear and rigorous expectations aligned with student achievement.

· Teachers are consistently observed and get meaningful and concrete feedback.

· Teachers get targeted professional development that’s just right for them.

Three out of four pilot teachers say their student’s academic growth and performance are a reflection of their effectiveness as teachers.

And our principals are on board too. Three out of four of them agree that providing feedback has improved student achievement.

When I visited Principal Danika Lacroix at Young Scholars’ Academy for Discovery and Exploration in Brooklyn, she told me that the pilot has transformed her school.

She and her dedicated teachers focus more on creating a culture of intellectual curiosity for teachers and students.

At the same school, Joyce Knight’s fourth graders were engaged in a lesson on London tied to the summer Olympics.

Just like those athletes, they were diving into exercises, vigorously challenging themselves and each other to answer increasingly complex questions about London’s history and culture.

Just as we believe in the unlimited potential of our students, we also believe in the unlimited potential of our teachers.

We’re identifying and uncovering talent within our teaching corps and creating pathways for leadership opportunities.

We’re encouraging hundreds of teachers across the city to become the next generation of school leaders.

Our rigorous principal training programs prepare standout teachers to take on the challenge to lead a New York City public school.

Some have taken their innovative ideas and energy and created exciting new schools. Kate Burch, a former teacher at Humanities Preparatory Academy is one such leader. As graduate student, her master’s thesis and her passion ultimately became Harvest Collegiate High School. She and a team of exceptional teachers developed the school’s mission, curriculum and instructional model. Harvest opened last week with a 9th grade class of about 130 students.

Groups of teachers like these will position our students to assume their roles as the next generation of leaders for our city and beyond.

The teacher effectiveness pilot has already improved education for 100,000 students.

A robust body of research tells us that this will strengthen their futures.

And, I am proud of this strong beginning, but we have 1 million more promises to keep.

Let’s work together to make high quality teaching and learning a reality for every teacher and every student.

Thank you. I look forward to hearing from the panel and audience.



Detroit week in review

Week in review: The state’s year-round scramble to fill teaching jobs

Miss Michigan Heather Heather Kendrick spent the day with students at the Charles H. Wright Academy of Arts and Science in Detroit

While much of the media attention has been focused this year on the severe teacher shortage in the main Detroit district, our story this week looks at how district and charter schools throughout the region are now scrambling year-round to fill vacant teaching jobs — an instability driven by liberal school choice laws, a decentralized school system and a shrinking pool of available teachers.

The teacher shortage has also made it difficult for schools to find substitutes as many are filling in on long-term assignments while schools try to fill vacancies. Two bills proposed in a state senate committee would make it easier for schools to hire retirees and reduce the requirements for certifying subs.  

Also, don’t forget to reserve your seat for Wednesday’s State of the Schools address. The event will be one of the first times in recent years when the leader of the city’s main district — Nikolai Vitti — will appear on the same stage as the leaders of the city’s two largest charter school authorizers. For those who can’t make it, we will carry it live on Chalkbeat Detroit.

Have a good week!

– Julie Topping, Editor, Chalkbeat Detroit

STATE OF THE SCHOOLS: The State of the Schools address will pair Vitti with the leaders of the schools he’s publicly vowed to put out of business, even as schools advocates say city kids could benefit if the leaders of the city’s fractured school system worked together to solve common problems.

LOOKING FOR TEACHERS: The city’s teacher shortage mirrors similar challenges across the country but the problem in Detroit is exacerbated by liberal school choice policies that have forced schools to compete with each other for students and teachers.

Hiring efforts continue at Detroit’s main school district, which is planning another job fair. Head Start centers are also looking for teachers. Three new teachers talk about the challenges, rewards and obstacles of the classroom.

WHOSE MONEY IS IT? The state Senate sent a bill to the House that would allow charters to receive a portion of property tax hikes approved by voters. Those funds have historically gone only to traditional district schools.

UNITED THEY STAND: Teachers in this southwest Detroit charter school voted to join a union, but nationally, union membership for teachers has been falling for two decades.

COLLEGE AND CAREERS: A national foundation based in Michigan granted $450,000 to a major Detroit business coalition to help more students finish college.

High school seniors across the state will be encouraged to apply to at least one college this month. The main Detroit district meanwhile showed off a technical center that prepares youngsters and adults for careers in construction, plumbing and carpentry and other fields.  

STEPS TO IMPROVEMENT: A prominent news publisher explains why he told lawmakers he believes eliminating the state board of education is the right thing to do. An advocate urged Michigan to look to other states for K-12 solutions. And one local newspaper says the governor is on the right track to improving education in Michigan.

This think tank believes businesses should be more engaged in education debates.

LISTEN TO US: The newly elected president of a state teachers union says teachers just want to be heard when policy is being made. She wrote in a Detroit newspaper that it takes passion and determination to succeed in today’s classrooms.

A PIONEER: Funeral services for a trailblazing African American educator have been scheduled for Saturday.

Also, the mother-in-law of U.S. Education Secretary Betsy DeVos, died in her west Michigan home.

FARM-TO-SCHOOL:  A state program that provides extra money to school districts for locally grown produce has expanded to include more schools.

BETTER THAN AN APPLE: Nominate your favorite educator for Michigan Teacher of the Year before the 11:59 deadline tonight.

An Ann Arbor schools leader has been named the 2018 Michigan Superintendent of the Year by a state group of school administrators.

MYSTERY SMELL: The odor from a failed light bulb forced a Detroit high school to dismiss students early this week.

EXTRA CREDIT: Miss Michigan encouraged students at one Detroit school to consider the arts as they follow their dreams. The city schools foundation honored two philanthropic leaders as champions for education.

And high school students were inspired by a former college football player. 

Struggling Detroit schools

The list of promises is long: Arts, music, robotics, gifted programs and more. Will Detroit schools be able to deliver?

PHOTO: Detroit Public Television
Detroit schools Superintendent Nikolai Vitti answers questions at a community meeting in Detroit.

Arts. Music. Robotics. Programs for gifted kids. New computers. New textbooks. Dual enrollment programs that let high school students take college classes. International Baccalaureate. Advanced Placement.

They’re all on the list of things that Detroit schools Superintendent Nikolai Vitti told a group of community members assembled in a Brightmoor neighborhood church that he would introduce or expand as soon as next school year.

Vitti didn’t get into the specifics of how the main Detroit district would find the money or partnerships needed to deliver on all of those promises, but they’re part of the plan for the future, he said.

The comments came in a question and answer session last month with students, parents and community members following Vitti’s appearance on Detroit Public Television’s American Black Journal/One Detroit Roadshow. The discussion was recorded at City Covenant Church. DPTV is one of Chalkbeat’s partners in the Detroit Journalism Cooperative.

Vitti has been appearing at community events since taking over the Detroit schools last spring. He is scheduled next week to join officials from two of the city’s major charter school authorizers, Central Michigan University and Grand Valley State University, at a State of the Schools address on October 25.


Watch the full Q&A with Vitti below.