First Person

The Right To Know What?

Each fall, thousands of runners descend on the Big Apple to run the New York City marathon. They’ve trained hard all year, and give their all on the course. Long after the elite runners have finished, they stream across the finish line in clumps, exhausted at the end of their 26.2-mile journey. In the middle of the pack, as many as eight or 10 runners might cross the finish line in a single second, and nearly 400 in a single minute.

The difference between a time of 4:08:00 and 4:09:00, however, isn’t large enough to be important. It’s the difference between a rate of 9:28 per mile and 9:30 per mile. Given the vagaries of marathon running — the wind, the temperature, the features of the course — it would be unwise to conclude that the runner who crossed the finish line in 4:08:00 is a much better marathoner than the one who finished in 4:09:00.

But the runner with a time of 4:08:00 finished several hundred places ahead of the runner who finished in 4:09:00 — surely that counts for something! Not really, I’d say. We can quantify the difference, both in absolute terms and in relative position, but these differences are not large enough to be meaningful.

The same is true of the information in the Teacher Data Reports recently released in New York City. Small differences in the estimated effects of teachers on their students’ achievement can appear to be much larger, because most teachers are about equally successful with the assortment of students they teach in a given year, regardless of whether those students begin the year as low-achievers or high-achievers. A trivial difference can appear much larger than it actually is, because, like the marathoners, many teachers are “crossing the finish line” at about the same time.

Here’s an example drawn from the 2008-09 Teacher Data Reports. (I chose the example because it’s convenient and have no reason to believe it’s unusual.) In 2009, fifth-graders took New York State’s English Language Arts exam, which consisted of 24 multiple-choice test items and three constructed-response items, which were combined to create a raw score ranging from 0 to 31. The raw scores were then converted to scale scores, which were used to classify individual students into four levels of performance, with Level 3 representing grade-level proficiency. The average student in New York City got 25.5 raw score points out of 31, which in New York City’s scheme represented an average proficiency level of 3.29. (Sounds pretty good, right? Of course, this was before the state wised up that being proficient on the test didn’t mean a student was on track to graduate from high school ready for college.)

The logic of the city’s Teacher Data Reports is to estimate Teacher A’s contribution to his or her students’ test-scores by comparing how other students with the same measured characteristics would be expected to do on the state test, based on their prior achievement and individual and classroom characteristics, with how Teacher A’s students actually did on the test. If Teacher A’s students score at the same level as was predicted by a statistical model, Teacher A is claimed to not “add value” to her students. If Teacher B’s students perform better than expected, Teacher B is said to add value. (And poor Teacher C, whose students score lower than they are predicted to do, is subtracting value, I guess. Maybe we should call him Teacher F.) These “value-added” scores are then ranked, and a teacher is assigned a percentile value representing the percentage of other teachers teaching the same grade and subject who scored below he or she did.

An “average” teacher, according to this calculation, is one whose value-added score is 0. Of the 1,751 NYC teachers with three or more years of experience who received a value-added rating in fifth-grade English in 2008-09, 84 got a score that rounded to .00. Their percentile ratings—the number that’s getting all of the attention in the traditional and neo-tabloids—range from 53 to 58. A tiny shift of .01 in either direction yields an additional 152 teachers, and a percentile rating of 48 to 63. What seems to be a small range of value-added scores could be anywhere from the 48th to the 63th percentile, because the value-added scores in this range are clumped together.

But it’s hard to know whether a shift of .01 in either direction is large or small. How can we tell? Here’s an idea. Suppose that Ruiz had 20 students who took the fifth-grade English test in 2009, and they were at the city average of 25.5 out of 31 raw score points on the test. What if half of the students got one more question right on the test? Doesn’t seem like a big stretch, does it? Just like the variation in the conditions on marathon day, half of the students getting one more question correct on a given test on a given day doesn’t seem out of the realm of possibility.

If this were to happen, Ruiz’s value-added score would rise from 0 to .05. And the percentile range associated with a value-added score of .05 is 75 to 77. All of a sudden, an “average” teacher looks pretty good. And this isn’t due to the margin of error! It’s just because many teachers are about equally effective in promoting student achievement, according to the value-added model in use. A relatively small change in student performance shifts a teacher’s location in the value-added distribution by a surprisingly large amount.

To be sure, this example is based on one year of student test-score data, not multiple years. But that’s what New York State is proposing to rely on in its first year of the new Annual Professional Performance Review process, and it’s what other jurisdictions, such as Washington, D.C., use in their teacher-evaluation systems. And, as with the marathon, the clumping together of teachers is more of an issue in the middle of the distribution than among those in the lead or at the back of the pack. But that’s little consolation to the teachers whose percentile rankings will figure into annual evaluations that will determine whether they’re permitted to continue teaching.

Speaking at Coney Island Feb. 28, Mayor Bloomberg defiantly affirmed the public’s right to know the contents of teachers’ performance evaluations. “Parents have a right to know every bit of information that we can possibly collect about the teacher that’s in front of their kids,” he said.

That statement is utterly ridiculous. There’s no legitimate interest in information about teachers’ private lives if it has no bearing on their professional performance. But here’s something parents do have the right to know: just how fragile value-added measures based on the New York State testing system are. The New York State tests were never intended to be used to rate teachers’ contributions to student learning — and so it’s little wonder they do a pretty poor job of it.

This post also appears on Eye on Education, Aaron Pallas’s Hechinger Report blog.

In this story: Community

First Person

To close out teacher appreciation week, meet the educators whose voices help shape the education conversation

From designing puzzles to get kids fired up about French to being christened “school mama” by students, teachers go above and beyond to make a difference. Chalkbeat is honored to celebrate Teacher Appreciation week with stories of the innovation, determination, and patience it takes to teach.
Check out a few of the educator perspectives below and submit your own here.

1. First Person: When talking about race in classrooms, disagreement is OK — hatred is not by David McGuire, principal at Tindley Accelerated Schools and previously a teacher in Pike Township. McGuire is also a co-founder of a group called Educate ME.
2. First Person: What my Bronx students think about passing through scanners at school by Christine Montera, a teacher at East Bronx Academy for the Future in the Bronx. She is also a member of Educators 4 Excellence-New York.
3. First Person: What 100 ninth graders told me about why they don’t read by Jarred Amato, High School English teacher and founder of ProjectLITCommunity.
4. This fourth-grade teacher doesn’t take away recess or use points to manage the class. Instead she’s built a culture of respect by Liz Fitzgerald, a fourth-grade teacher at Sagebrush Elementary and Colorado Teaching Policy fellow.
5. First Person: Why I decided to come out to my second-grade students by Michael Patrick a second grade teacher at AF North Brooklyn Prep Elementary.
6. Meet the teacher who helped organize the Women’s March on Denver, a profile of Cheetah McClellan, Lead Math Fellow at Denver Public Schools.
7. First Person: At my school, we let students group themselves by race to talk about race — and it works, by Dave Mortimer, and educator at Bank Street School for Children.
8. What Trump’s inauguration means for one undocumented Nashville student-turned-teacher a profile of Carlos Ruiz, a Spanish teacher at STRIVE Prep Excel and Teach for America fellow.
9. First Person: ‘I was the kid who didn’t speak English’ by Mariangely Solis Cervera, the founding Spanish teacher at Achievement First East Brooklyn High School.
10. First Person: Why recruiting more men of color isn’t enough to solve our teacher diversity problem by Beau Lancaster, a student advocate at the Harlem Children’s Zone and  Global Kids trainer teaching, writing, and developing a civic engagement and emotional development curriculum.
11. Sign of the times: Teacher whose classroom-door sign went viral explains his message a profile of Eric Eisenstad, physics and biology teacher at Manhattan Hunter Science High School.
12. First Person: How teachers should navigate the classroom debate during a polarizing election year  by Kent Willmann, an instructor at the University of Colorado Boulder School of Education. He previously taught high school social studies in Longmont for 32 years.
13. First Person: I teach students of color, and I see fear every day. Our job now is to model bravery by Rousseau Mieze, a history teacher at Achievement First Bushwick charter middle school.
14. Pumpkin pie with a side of exhaustion: Why late fall is such a tough time to be a teacher by Amanda Gonzales, a high school special education teacher in Commerce City, Colorado.
15. This teacher was a ‘class terrorist’ as a child. Now he uses that to understand his students by Andrew Pillow a technology and social issues teacher at KIPP Indy College Prep Middle.
16. What this teacher learned when her discipline system went awry — for all the right reasons by Trilce Marquez, a fourth-grade teacher at P.S. 11 in Chelsea.
17. Here’s what one Tennessee teacher will be listening for in Haslam’s State of the State address by Erin Glenn, a U.S. history teacher at East Lake Academy of Fine Arts and Tennessee Educator Fellow with the State Collaborative on Reforming Education.
18. An earth science teacher talks about the lesson that’s a point of pride — and pain a profile of Cheryl Mosier, a science teacher at Columbine High School.
19. A national teacher of the year on her most radical teaching practice: trusting kids to handle their bathroom business by Shanna Peeples, secondary English language arts curriculum specialist for Amarillo ISD.
20. How this teacher went from so nervous her “voice was cracking” to a policy advocate by Jean Russell, a literacy coach at Haverhill Elementary School,  2016 Indiana Teacher of the Year and TeachPlus statewide policy fellow.

First Person

I’m a black man raised on the mistaken idea that education could keep me safe. Here’s what I teach my students in the age of Jordan Edwards

The author, Fredrick Scott Salyers.

This piece is presented in partnership with The Marshall Project

I worry a lot about the students in the high school where I teach. One, in particular, is bright but struggles in class. He rarely ever smiles and he acts out, going so far recently as to threaten another teacher. As a black, male teacher — one of too few in the profession — I feel especially compelled to help this young black man reach his potential. Part of that work is teaching him the dangers that might exist for him, including the police.

The killing of Texas teenager Jordan Edwards proves, though, that it’s not just black boys with behavior issues who are in danger. Jordan — a high school freshman, star athlete and honor student — was shot dead by a police officer last month while leaving a house party. As he rode away from the party in a car driven by his older brother, officers who’d been called to the scene fired multiple rifle rounds at the car. One bullet went through the passenger window, striking Jordan in the head. Murder charges have since been filed against the officer who fired the fatal shot.

It’s a near impossible task to educate black children in a society that constantly interrupts that work with such violence. Still, it’s incumbent on educators like me to guide our students through the moment we’re living in — even when we can’t answer all their questions, and even if we’re sometimes confused ourselves.

I began teaching in 2014, the year the police killings of Eric Garner, Michael Brown, and Tamir Rice dominated headlines. The tragedies have piled on, a new one seeming to occur every month since I first stepped into a classroom. I currently teach ninth-graders at a predominantly black charter school in Brooklyn, and I often find myself struggling to make sense of the events for my students.

I’ve shown them clips from popular films like “Selma” and “Fruitvale Station” and prepared lessons on the civil rights movement, and I’ve done my best to ground it all in the subjects I was hired to teach — American history, composition, and college readiness. My hope is that these films will encourage my students to connect today’s police violence to our nation’s history of racial injustice. And, because there are no easy answers, they’ll simply be encouraged by the perseverance of those who came before them.

I can’t help but worry I’m sending them mixed messages, however, teaching them lessons on resistance while also policing their conduct day to day. As an administrator and one of few black male teachers in my school, I’m often charged with disciplining students. I find myself having a familiar talk with many of them: “get good grades,” “respect authority,” “keep your nose clean.”

It’s instruction and advice that can feel pointless when a “good kid” like Jordan Edwards can have his life cut short by those sworn to serve and protect him. Still, I try in hopes that good grades and polite behavior will insulate my students from some of society’s dangers, if not all of them.

The Monday after police killed Edwards, I asked the students in my college readiness class to watch a news clip about the shooting and write out their feelings, or sit in silence and reflect. Many of them were already aware of what happened. I was proud that so many of them were abreast of the news but saddened by their reflections. At just 14 and 15 years old, many of them have already come to accept deaths like Jordan’s as the norm, and readily expect that any one of them could be next. “Will this police officer even be fired?” one asked. “Was the cop white?”

The young man I worry about the most was more talkative than usual that day. During the class discussion, he shared his guilt of being the only one of his friends who “made it” — making it meaning being alive, still, and free. The guilt sometimes cripples him, he said, and high-profile police killings like Jordan’s compound that guilt with a feeling of hopelessness. They make him think he will die in the streets one way or another.

I didn’t know what to say then, and I still don’t have a response for him. I’ve always taught students that earning an education might exempt them from the perils of being black in America, or at least give them a chance at something more. I was raised on that notion and believed it so much that I became an educator. But deaths like Jordan’s leave me choking on the reality that nothing I can teach will shield my students from becoming the next hashtag.

In lieu of protection, I offer what I can. I provide a space for my students to express their feelings. I offer love and consideration in our day-to-day interactions and do my best to make them feel seen and, hopefully, safe for a few hours each day.

Fredrick Scott Salyers teaches at a charter high school in Brooklyn. He began his career in education as a resident director at Morehouse College. Find more of his work here.