team of rivals

Seven ed research heavyweights to head to Albany to help direct evaluation overhaul

Education research heavyweights are headed to Albany next week to offer their advice about the state’s imminent overhaul of teacher evaluations, and they represent many sides of the contentious debates around how to rate teachers.

Seven researchers, economists, and professors accepted an invitation to weigh in on the debate at a May 7 summit being held by the State Education Department and Board of Regents, according to a department memo obtained by Chalkbeat. Officials are required by law to collect public comment on how to design the regulations that will govern how a teacher’s performance in the classroom gets graded, a process that must be complete by the end of June.

On Gov. Andrew Cuomo’s side is Thomas Kane, an economist from Harvard University who last week penned an op-ed praising the governor and the evaluation system he pushed into law earlier this year. Kane is best known for directing the Bill and Melinda Gates Foundation’s Measures of Effective Teaching study, an influential project that many states drew from when designing their new evaluation systems over the last half-decade. (Disclosure: Chalkbeat also receives some funding from the Gates Foundation.)

Kane’s three-year, $45 million project ultimately recommended that 33 to 50 percent of a teacher’s rating be determined by student growth as determined by their state test scores, 25 percent by student surveys, and the rest by classroom observations. (New York’s new system puts a heavier emphasis on student growth, but prohibits the use of student surveys.)

Kane will have some intellectual allies on the panel, but he’ll also be joined by several experts who are less supportive of Cuomo’s ideas. They include University of California at Berkley economist Jesse Rothstein, who analyzed data from Kane’s MET study and found substantial differences in value-added scores for the same teacher when different tests were used. Rothstein has also questioned whether state tests are the best assessments to capture teacher quality.

“If it’s right that some teachers are good at raising the state test scores and other teachers are good at raising other test scores, then we have to decide which tests we care about,” Rothstein told Chalkbeat in 2012. “If we’re not sure that this is the test that captures what good teaching is, then we might be getting our estimates of teaching quality very wrong.”

Also due to offer their opinions are Catherine Brown, vice president of the left-leaning think tank Center for American Progress, which has published papers endorsing the use of value-added methodologies; Manhattanville College professor Stephen Caldas, who once called New York’s evaluation system “psychometrically indefensible“; and Teachers College sociologist Aaron Pallas, who has been critical of New York’s system and served as an expert witness in lawsuits brought by teachers unions challenging low teacher ratings.

Balancing out the panel will be Sandi Jacobs, a vice president at the National Council on Teacher Quality, an organization that has pushed states to adopt stringent evaluation systems that rely more on student learning measures, and Leslie Guggenheim of TNTP, an advocacy organization whose influential 2009 paper “The Widget Effect” was critical of districts for not using teacher performance to make important policy decisions.

It’s unclear what influence the researchers and policy analysts will have on the state’s work, given that much of the evaluation system has been prescribed by the law passed in April. Still, officials have decisions to make about what types of student performance should be factored into evaluation plans and how those scores should be used.

According to the memo, the state’s invitation was turned down by several other prominent researchers. One was Stanford’s Linda Darling-Hammond, who said in an email that she was working with the California’s education department and couldn’t travel. Another was Sean Corcoran of New York University, who has found that the city’s teacher ratings calculated by value-added measures were highly volatile from one year to the next and often riddled with errors, and said he was traveling.

Six of the seven experts will appear in person next week, where representatives from teacher unions, superintendent associations, and other advocacy groups will also be in attendance. A spokesperson for the department said the experts will get about 45 minutes to present their views on teacher evaluation policy before taking questions from Regents members.

Meanwhile, the city teachers union got a jump start on its attempts to influence state education officials, sending a lengthy letter and documents to the Regents this week outlining its own goals for changes to teacher evaluations.

The letter stated for the first time that the union wants the state to eliminate the use of “group measures” of student growth, which can be used to give ratings to teachers based on test scores of students or subjects they do not teach. Those measures are among the most frustrating aspects of evaluations for teachers of non-tested subjects like art, music and physical education, but also allow schools to reduce the time students spend taking subject-specific tests.

The union also pushed for as many aspects of the evaluation system as possible be left to districts and their unions to negotiate, rather than be decided by state officials.

“Every district is different, and a top-down, one-size-fits-all system will not meet the needs of all students and schools,” Evelyn De Jesus, the union’s vice president for education wrote.

Parent-to-Para

How the Adams 14 school district is empowering parents to join the classroom

PHOTO: Yesenia Robles
A parent volunteer works with two kindergarteners on reading as part of a pilot program at Dupont Elementary School that is training parents to become paraprofessionals.

Raeann Javier would like to know what she can do to help her second-grader read better. Sometimes, sitting with her daughter, the best she could offer was, “You know how to do this.”

Javier, a single mother, also would love to land another job to earn more for her family.

A pilot program launched by Adams 14 School District in Commerce City may help her with both.

The school district is trying to build more knowledgeable, active parents through classes and volunteer time working with young students struggling to read. For those who are interested, the program also provides parents a path to become paraprofessionals, or teacher’s aides.

The initiative is one way the nearly 8,000-student suburban district — facing state intervention this year after years of poor academic performance — is trying to turn things around.

District surveys found parents were looking for ways to become more supportive.

Javier, one of 17 mothers in the program, said she already feels like she has become a more patient parent less than a month in. She also is interested in becoming a paraprofessional to supplement the income she earns as an at-home nurse.

“It’s a little bit tough. I make it work,” Javier said. “But this would really, really help.”

Other parents taking part in the pilot program already were volunteers at their kids’ schools.

“They usually just did the normal things like helping with copying or sorting papers,” said Jesse Martinez, Adams 14’s director for family and community engagement. “But we really wanted to change that dynamic. We wanted to pull in our parents to tap their potential and bring them in to support their children.”

One of the parent volunteers, Susana Torres, was an elementary school teacher for 10 years before coming to the United States. Now with three children in district schools, Torres jumped at the opportunity to get back into a classroom.

“This is my thing,” Torres said. “I love the program.”

Torres also helps other Spanish-speaking moms who are part of the program. She said that even though they don’t have the teaching background she does, the program has made it easy for all of them to learn to help kids. “All you need is a passion to make change,” she said.

Pat Almeida, the principal of Dupont Elementary, where the program is being piloted, said the goal is also to help more students become proficient in reading before third grade — especially those who are not far behind but just need a boost to get to grade level.

“We’re able to give them more repetition so they can apply that to their reading,” Almeida said. “If they’re able to have more repetition, their progress is going to be accelerated.”

Dupont Elementary is among the Adams 14 schools that is struggling, though the school isn’t yet facing sanctions like the district as a whole is this year.

District officials have been working on setting up reforms all year to present to the state as a suggestion for their corrective action, including getting help from an outside company for developing curriculum and testing. Increasing parental engagement through this and other new efforts, like having teachers visit families at home, are part of the work to improve the district.

The parent-to-para program is being funded with money from the Denver-based Rose Community Foundation (Rose also supports Chalkbeat) and Climb Higher Colorado, a coalition of advocacy groups that support strong academic standards and tests.

At Dupont, while the parent volunteers work with almost 75 students that they pull out of class for about an hour, teachers can spend the time in class working with students who need the most help.

An instructional coach supervises the moms to work with groups of two to six students and helps them plan lessons each day for kids.

During one lesson this week, parents were helping kindergarteners learn how to differentiate between capital and lowercase letters and how to sound out words. Some students were still having trouble identifying letters, while one boy was writing words so quickly he was standing up, moving around and at one point fell.

The volunteers said it’s rewarding to see the kids catching on.

“Knowing that just a little bit of our time can help them is a good feeling,” said volunteer Adelaida Guerrero. “It’s an excellent opportunity for them and for us.”

For Maria Rodriguez, the program has unexpectedly given her another benefit — bringing her closer to her teenage daughters. She said she joined the program because when a bilingual program for her two oldest daughters was removed seven years ago, she had stopped being able to help them on their school work.

When Rodriguez heard about the program, she thought she could prepare to help her younger children, a second and third grader, before they too required more help than she could offer.

“It’s brilliant,”Rodriguez said. “I’ve been helping them work on their vowels.”

Within the last week, the two older girls came to Rodriguez complaining that she hadn’t ever worked to help them in the same way, and asking to join in during the at-home lessons. Over time, the girls had kept their ability to speak Spanish, but never learned how to write it. Now they were asking to learn alongside their younger siblings.

“They have that apathy of adolescence that makes them not always want to get close to us as parents,” Rodriguez said, tearing up as she recalled the moment. “I honestly felt really good.”

the write way

What’s missing from the conversation about the state’s ditched literacy test for teachers?

PHOTO: Monica Disare
The Board of Regents applauds James Tallon at his last meeting, moments after officially voting to eliminate a literacy test for prospective teachers.

In a major change to teacher certification, New York officials decided prospective teachers will no longer have to pass an “academic literacy” test in order to enter classrooms.

It didn’t take long for media outlets to jump on the news, raising concerns that teachers who struggle to read and write could now be able to enter New York’s classrooms.

State officials say that argument is misguided. Since aspiring teachers must earn a college degree, and pass three other certification exams, they argue, illiterate applicants will not make the cut in the first place. The exam also is inherently flawed, they say, and kept a disproportionate number of black and Hispanic teachers out of schools.

But experts say that narrow debate about literacy misses a broader conversation. They argue that the test was never meant to protect against a flood of teachers unable to read and write. It was, however, intended to help ensure high teacher quality, they say, and the question is whether the current certification process furthers that goal.

The Academic Literacy Skills Test, which the state implemented a few years ago, was part of a larger movement to elevate the quality of the teaching profession. Officials thought at the time that a more rigorous test of reading and writing should be part of that mix.

But literacy tests for teachers got their start in a different era, said Linda Darling-Hammond, a leading national education researcher who now runs an education policy think tank. They were originally implemented in the 1980s when there were fewer hurdles to entering the teaching profession, she said.

“That might have made sense at that time in those places,” Darling-Hammond said, but added there is little evidence today that literacy tests are a good way to screen for effective teachers. There’s also no widespread concern, she said, that illiterate teachers are entering the profession.

“I think at this point, there is not strong evidence about that,” she said.

Ken Lindblom, dean of the School of Professional Development at Stony Brook University, who has taught prospective teachers, agreed that the focus on literacy is misplaced.

“It’s simply not the case that we have all these teachers … and they’re illiterate and we need to stop,” Lindblom said. “This is a false conundrum that we have invented.”

Dylan Roth, who is studying to become a teacher in a graduate program at Queens College, said he felt “insulted” by news coverage suggesting an epidemic of teacher illiteracy. “They speak of the ALST as if it were the line in the sand keeping horridly illiterate and unqualified teachers out of the classroom,” he said. “Yet besides brief mentions of teachers unions [in the articles], there is no virtually no input from teachers themselves who have gone through the process of certification,” he said.

Roth pointed out that the test’s fee (more than $100) poses a burden for aspiring teachers already paying for seminars, textbooks, tuition and more. Meanwhile, he said, the test is unnecessary when similar questions could simply be added to one of the three other certification tests, a proposal the state has offered.

Still, some say this conversation is about more than just a test — it’s about how the state can build a superior teacher workforce. Ian Rosenblum, executive director of the Education Trust-NY pointed to a 2007 study that found recruiting teachers with stronger certification status or SAT scores could improve student achievement.

“Research shows that having teachers with stronger academic skills makes a meaningful difference in student outcomes, and that is why we believed that maintaining the ALST … is important for equity,” Rosenblum said.

Daniel Weisberg, CEO at TNTP, an organization focused on creating more effective teachers, says the best way to attract high-quality teachers isn’t a tough literacy test. He thinks the emphasis should be on more teacher observation instead.

But he said, over the years, he has seen some prospective educators who want to become teachers even though they lack basic reading and writing skills. In order to avoid certifying those teachers, state officials could create a more narrow test of basic skills, he said.

“What you need is a surgical tool, not a chainsaw,” Weisberg said. “With a lot of these certification exams right now … they end up being a chainsaw, not a surgical tool.”

State Education Department officials plan to add a long reading and writing requirement to the Educating All Students Test, a change that is still being reviewed. They could not yet say whether a student who failed a new literacy portion of another exam could still become a teacher. According to a state education official, the test is expected to include the new literacy portions by January 2018.

The other certification tests already involve reading and writing. The edTPA, a performance-based assessment that asks students to videotape a lesson, requires them to write about their teaching practice. The exams require writing, but the edTPA handbook says the rubrics “do not address the quality of your writing,” and does not penalize test-takers for grammar and spelling errors, though it suggests the ability to effectively communicate is critical.

The other exams include content questions and some questions that require written responses. Supporters of eliminating the literacy test argue that even though prospective teachers are not given a writing score, literacy is embedded in the exams.

The edTPA “requires teacher candidates to organize their arguments, to logically sequence claims,” said Jamie Dangler, vice president for academics at United University Professions, which represents SUNY employees and who co-chaired the state’s edTPA task force. “That’s how you assess literacy. It’s the ability to write, but it’s more then that.”

Stephen Sigmund, executive director of High Achievement New York, a coalition of groups that promote rigorous standards, isn’t convinced. Literacy is crucial to teaching and should be assessed separately, he said. And while the state may include more literacy questions in a different exam, it’s a mistake to eliminate the test without having a fully developed alternative, he said.

“I don’t know enough about the specifics of the test but I take the [State Education] Department and the Regents’ word for it that they think there was a flawed test,” Sigmund said. “So fine, if there are problems with the test, fix the test.”