added complexity

Proposal to refine state's "value-added" formula elicits concerns

ALBANY — A dozen new factors could be tossed into the state’s formula for measuring how much teachers have boosted their students’ state scores, according to a proposal that is dividing state education policy makers.

The state’s teacher evaluation law, passed in 2010, requires student performance to count in teacher ratings. Currently, the state calculates “growth scores” that count for a fifth of teachers’ overall ratings. But the law allows the state to increase the weight of its score to a quarter of teachers’ ratings once officials adopt a more complex “value-added” model for assessing teacher impact.

Both models are based on the principle that comparing students’ actual test scores with their predicted scores can show the impact their teachers had on their learning. The question is what variables to use when predicting scores so that teachers whose students have greater needs are not at a disadvantage.

The current growth model considers and controls for four basic characteristics: previous test scores, students with disabilities, students living in poverty, and students who are still learning English.

At Monday’s Board of Regents meeting, state education officials said they had come up with a value-added formula that includes 12 other factors, including students’ previous test scores in other subjects and whether they are overage for their grade. The officials want to adopt the new formula for use starting this year in districts that have teacher evaluation agreements. (New York City is one of a few districts that do not yet.)

The proposed value-added formula would also control for the first time for classroom variables, such as class size and the proportion of students with high needs.

The added factors represent an attempt to distinguish more precisely between students who share the same characteristics that are controlled for in the current growth model. Right now, the state’s formula treats students with special needs as all presenting the same challenge to teachers, for example, but the proposed formula would give a different weight to the scores of students with severe disabilities.

“All those variables are there to further refine similar students,” said Amy McIntosh, a senior fellow for the Regents Research Fund who oversees teacher evaluations, of the value added formula.

The Regents must approve the proposed formula before the State Education Department can use it to calculate this year’s ratings for math and English teachers in grades 4-8, who make up about 17 percent of teachers statewide.

At this week’s meeting, discussion of the value-added formula was unusually contentious. It came halfway through the state’s first round of tougher tests, which have drawn fire from those who think the scores should not be used in high-stakes decisions such as teacher evaluations.

The plan drew swift resistance from several Regents, including two from New York City, who have been critical of using student test scores in teacher evaluations in the first place. They said making the state’s measurement of teacher impact on student test scores more complex would not address some of the issues surrounding the value-added approach, which include year-to-year instability and a requirement for some teachers to score low.

“I have no confidence that this is going to give us what we’re looking for and that teachers will be evaluated fairly,” said Westchester County’s Harry Phillips.

Phillips and Roger Tilles, of Long Island, both urged the state to shelve the growth models or treat them as a low-stakes pilot for now.

A vote is scheduled at next month’s Regents meeting, where Commissioner John King and Chancellor Merryl Tisch promised to bring an updated proposal that would at least in part address the concerns raised. But King reiterated his support for using the value-added model, citing research from the Gates Foundation’s Measures of Effective Teaching study that compared several approaches to factoring student performance into teacher ratings.

“This approach has been used all throughout the country, quite extensively,” King said. “The methodology that we’re using is very similar to what’s been used and studied extensively.”

King said the state convened its own advisory group that included teachers, principals, and district officials from across the state On technical matters, it also consulted an advisory group of eight researchers from around the country, including Jonah Rockoff and Douglas Staiger, two economists who studied New York City’s value-added data.

At times, the advisory groups’ recommendations were at odds, state officials said. The state’s Regents advisory group recommended weighing students’ gender when calculating teachers’ impact, King said, but the technical advisors recommended against doing so. Gender is not a factor in the proposed value-added formula.

The composition of the technical advisory group drew criticism from several Regents. The Bronx’s Betty Rosa pointed out that all eight researchers in the group are men. And Kathy Cashin of Brooklyn said the group lacked a different kind of diversity.

“How do you have a panel with one point of view?” Cashin said, referring to the fact that the researchers’ work begins with an assumption that it is possible to isolate teachers’ contributions to student learning.

In addition to changing the formula for measuring student growth in teachers’ ratings, the State Education Department has also proposed introducing a growth measurement for high school principals, based on their students’ Regents exam pass rates.

And the department also wants to change the way that transient and chronically absent students are counted, an issue that has divided some school districts as they craft their education evaluation systems.

Last year, 16 percent of students statewide weren’t counted in growth models because they were not enrolled in a single school for the entire year. This year, students who enter just before the halfway point will be counted, meaning that the scores of an addition 150,000 students — who often have high needs — would count in teachers’ ratings.

Students with low attendance will also be counted, but only by the same rate at which they attended school, according to the proposal.

The description of the State Education Department’s advisory groups has been clarified since this story was originally published.

Here’s the slide from the State Education Department’s PowerPoint presentation that shows the new factors that could become part of the state’s value-added teacher evaluation formula. The full presentation is below.
Screen shot 2013-04-23 at 10.33.38 AM

meet the fellows

Meet the 38 teachers chosen by SCORE to champion education around Tennessee

PHOTO: SCORE
The year-long fellowships offered by the State Collaborative on Reforming Education were awarded to 38 Tennessee educators.

Six teachers from Memphis have been awarded fellowships that will allow them to spend the next year supporting better education in Tennessee.

The year-long fellowships, offered by the State Collaborative on Reforming Education, train and encourage teachers and other educators to speak at events, write publicly about their experiences, and invite policymakers to their classrooms. The program is in its fifth year through the nonpartisan advocacy and research organization, also known as SCORE, which was founded by former U.S. Senate Majority Leader Bill Frist from Tennessee.

The fellowships, known as the Tennessee Educator Fellowships, have been awarded to 150 educators since the program’s launch in 2014. This year’s class of 38 educators from around the state have a combined 479 years of experience.

“The fellows’ diverse perspectives and experiences are invaluable as they work both inside and outside the classroom and participate in state conversations on preparing all students for postsecondary and workforce success,” SCORE President and CEO Jamie Woodson said in a news release.

Besides the Shelby County teachers, the group also includes educators who work for the state-run Achievement School District, public Montessori schools, and a school dedicated to serving children with multiple disabilities.

The 2018-19 fellows are:

  • Nathan Bailey, career technical education at Sullivan North High School, Sullivan County Schools
  • Kalisha Bingham-Marshall, seventh-grade math at Bolivar Middle School, Hardeman County Schools
  • Sam Brobeck, eighth-grade math at Memphis Grizzlies Preparatory Charter Middle School. Shelby County Schools
  • Monica Brown, fourth-grade English language arts and social studies at Oakshire Elementary School, Shelby County Schools
  • Nick Brown, school counselor at Westmoreland Elementary School, Sumner County Schools
  • Sherwanda Chism, grades 3-5 English language arts and gifted education at Winridge Elementary School, Shelby County Schools
  • Richard J. Church, grades 7-8 at Liberty Bell Middle School, Johnson City Schools
  • Ada Collins, third grade at J.E. Moss Elementary School, Metropolitan Nashville Public Schools
  • Lynn Cooper,  school counselor at South Pittsburg High School, Marion County Schools
  • Colletta M. Daniels, grades 2-4 special education at Shrine School, Shelby County Schools
  • Brandy Eason, school counselor at Scotts Hill Elementary School, Henderson County Schools
  • Heather Eskridge, school counselor at Walter Hill Elementary School, Rutherford County Schools
  • Klavish Faraj, third-grade math and science at Paragon Mills Elementary School, Metropolitan Nashville Public Schools
  • Mavis Clark Foster, fifth-grade English language arts and science at Green Magnet Academy, Knox County Schools
  • Ranita Glenn, grades 2-5 reading at Hardy Elementary School, Hamilton County Department of Education
  • Telena Haneline, first grade at Eaton Elementary School, Loudon County Schools
  • Tenesha Hardin, first grade at West Creek Elementary School, Clarksville-Montgomery County Schools
  • Thaddeus Higgins, grades 9-12 social studies at Unicoi County High School, Unicoi County Schools
  • Neven Holland, fourth-grade math at Treadwell Elementary School, Shelby County Schools
  • Alicia Hunker, sixth-grade math at Valor Flagship Academy, Metropolitan Nashville Public Schools
  • Alex Juneau, third grade at John Pittard Elementary School, Murfreesboro City Schools
  • Lyndi King, fifth-grade English language arts at Decatur County Middle School, Decatur County Schools
  • Rebecca Ledebuhr, eighth-grade math at STEM Preparatory Academy, Metropolitan Nashville Public Schools
  • Aleisha McCallie, fourth-grade math and science at East Brainerd Elementary School, Hamilton County Department of Education.
  • Brian McLaughlin, grades 10-12 math at Morristown-Hamblen High School West, Hamblen County Schools
  • Caitlin Nowell, seventh-grade English language arts at South Doyle Middle School, Knox County Schools
  • Paula Pendergrass, advanced academics resources at Granbery Elementary School,  Metropolitan Nashville Public Schools
  • Julie Pepperman, eighth-grade science at Heritage Middle School, Blount County Schools
  • Kelly Piatt, school counselor at Crockett County High School, Crockett County Schools
  • Ontoni Reedy, grades 1-3 at Community Montessori, Jackson-Madison County Schools
  • Tiffany Roberts, algebra and geometry at Lincoln County Ninth Grade Academy, Lincoln County Schools
  • Craig Robinson, grades 3-5 science at Georgian Hills Achievement Elementary, Achievement School District
  • Jen Semanco, 10th- and 11th-grade English language arts at Chattanooga Girls Leadership Academy, Hamilton County Department of Education
  • Amanda Smithfield, librarian at Hume-Fogg Academic Magnet School, Metropolitan Nashville Public Schools
  • Cyndi Snapp, fourth-grade math at Carter’s Valley Elementary School, Hawkins County Schools
  • David Sneed, 12th-grade English at Soddy Daisy High School, Hamilton County Department of Education
  • Yolanda Parker Williams, fifth-grade math at Karns Elementary School, Knox County Schools
  • Maury Wood II, grades 4-6 technology at Westhills Elementary School, Marshall County Schools

work hard play hard

Memphis teachers share basketball, even if they don’t share a district

PHOTO: Laura Faith Kebede

Freedom Preparatory Academy is gathering teachers from district-run and charter schools to play basketball. The teachers, mostly black men, have turned it into a networking opportunity as well as a way to let off steam.