prep problems

A new study shows why it’s so hard to improve teacher preparation

Dramatically reshaping how teachers are trained — by emulating great teacher preparation programs and shutting down ineffective ones — has been a key priority of many states and even, under the Obama administration, the federal government.

Fierce debates have ensued over how to hold training programs accountable for making sure novice teachers are ready for the classroom on day one.

Now a new study casts doubt on those efforts for a simple reason: It’s hard to identify good or bad teacher preparation programs, at least as measured by student achievement.

That’s the provocative conclusion of research by Paul von Hippel of University of Texas at Austin and Laura Bellows of Duke University.

“It appears that differences between [programs] are rarely detectable, and that if they could be detected they would usually be too small to support effective policy decisions,” write von Hippel and Bellows.

The study, which has not been formally peer-reviewed, follows other peer-reviewed research comparing teacher training programs in Florida, Louisiana, Missouri, New York City, Texas and Washington.

Those studies try to isolate the impact of teacher preparation programs — including schools of education and alternative certification initiatives — on student test scores. It’s a difficult task, since there are two degrees of separation between a teacher training program and students taking state tests, and researchers use complex value-added models to control for a number of factors.

The studies come to differing conclusions. Some suggest that programs vary substantially in effectiveness, but most find few clear differences among a state’s programs.

In the latest research, von Hippel and Bellows reanalyze those six studies using a consistent method. They find that in all states the differences between teacher preparation programs are small and it’s difficult to pick out top-notch programs with confidence.

“This is troubling because singling out [programs] is a prerequisite to the policy goal of expanding strong [programs] and shuttering weak ones,” they write.

Indeed, a number of states — 16, according to the researchers — have made efforts to evaluate training programs based in part on value-added measures. The Obama administration issued regulations encouraging states to evaluate their teacher prep programs by measuring student learning, though they were scrapped by Congress and the Trump administration earlier this year.

Dan Goldhaber, who has studied Washington’s teacher training programs and is a professor at the University of Washington, said this latest study is consistent with his own findings.

“I think there’s relatively little variation in the value-added effectiveness of teachers who hold credentials from different programs,” he said.

Still, he notes, the size of the impact is in the eye of the beholder. At most, the difference between attending a good versus an average training program is comparable to the difference in effectiveness between the average first- and third-year teacher — definitely not big, but not necessarily zero.

An inherent limitation of this research is that it focuses exclusively on the fraction of teachers who end up in tested grades and subjects, largely fourth- through eighth-grade math and English.

It may be more helpful to judge teacher preparation programs by multiple measures. For instance, recent research has found that there is substantial variation in how different programs affect teachers’ scores on classroom observations, which can be used to evaluate all teachers, not just those in tested areas.

Still, isolating the impact of training remains a challenge, since teachers are not randomly assigned to schools, and some programs aim to place teachers in high-poverty schools where attaining high ratings may be more difficult.

Bellows, the Duke researcher, warned against chasing after programs that might be appear effective simply because of a statistical fluke.

“You don’t want to remodel our [teacher preparation programs] based on one that looks really good when … it’s just by chance,” she said.

However, Bellows and von Hippel’s research suggests that there is some reason for optimism. In five of the six states, there was at least one large program that appears significantly better at preparing teachers in at least one subject.

“If we are very careful, we can occasionally identify a [program] that is truly exceptional,” they write.

surprise!

Teachers in Millington and Knoxville just won the Oscar awards of education

PHOTO: Milken Family Foundation
Millington English teacher Katherine Watkins reacts after learning that she is the recipient of a 2017 Milken Educator Award.

Two Tennessee teachers were surprised during school assemblies Thursday with a prestigious national teaching award, $25,000 checks, and a visit from the state’s education chief.

Katherine Watkins teaches high school English in Millington Municipal Schools in Shelby County. She serves as the English department chair and professional learning community coordinator at Millington Central High School. She is also a trained jazz pianist, published poet, and STEM teacher by summer.

PHOTO: Milken Family Foundation
Paula Franklin learns she is among the recipients.

Paula Franklin teaches Advanced Placement government at West High School in Knoxville. Since she took on the course, its enrollment has doubled, and 82 percent of her students pass with an average score that exceeds the national average.

The teachers are two of 45 educators being honored nationally with this year’s Milken Educator Awards from the Milken Family Foundation. The award includes a no-strings-attached check for $25,000.

“It is an honor to celebrate two exceptional Tennessee educators today on each end of the state,” said Education Commissioner Candice McQueen, who attended each assembly. “Paula Franklin and Katherine Watkins should be proud of the work they have done to build positive relationships with students and prepare them with the knowledge and skills to be successful in college and the workforce.”

Foundation chairman Lowell Milken was present to present the awards, which have been given to thousands of teachers since 1987.

PHOTO: Milken Family Foundation
Students gather around Millington teacher Katherine Watkins as she receives a check as part of her Milken Educator Award.

The Milken awards process starts with recommendations from sources that the foundation won’t identify. Names are then reviewed by committees appointed by state departments of education, and their recommendations are vetted by the foundation, which picks the winners.

Last year, Chattanooga elementary school teacher Katie Baker was Tennessee’s sole winner.

In all, 66 Tennessee educators have been recognized by the Milken Foundation and received a total of $1.6 million since the program began in the state in 1992.

You can learn more about the Milken Educator Awards here.

Colorado Vote 2018

Polis campaign releases education plan, including new promise about teacher raises

Congressman Jared Polis meets with teachers, parents and students at the Academy of Urban Learning in Denver after announcing his gubernatorial campaign. (Photo by Nic Garcia/Chalkbeat)

Congressman Jared Polis, one of several Democrats running for governor, released an education plan for the state Wednesday that includes new details on tackling teacher shortages and better preparing high school students for work.

The Boulder Democrat wants to help school districts build affordable housing for teachers, increase teacher pay and make sure that “100 percent of Colorado’s school districts are able to offer dual and concurrent enrollment programs through an associate’s degree or professional certification, and work to boost enrollment in them.”

The education plan includes the congressman’s initial campaign promise to deliver free and universal preschool and kindergarten.

“Part of my frustration is that politicians have been talking about preschool and kindergarten for decades,” Polis said in an interview with Chalkbeat. “It’s time to stop talking … and actually do it.”

Big questions remain, however, about how Colorado would pay for Polis’s plans.

Free universal preschool and kindergarten would cost hundreds of millions of tax dollars the state does not have. Polis has acknowledged that voters will need to approve a tax increase to secure the funding necessary — and voters rejected Colorado’s last big statewide ask to fund education initiatives.

His additional promises, especially providing schools with more money to pay teachers, only adds to the price tag for his education plan. The campaign did not release any projections of how much his teacher pay raise proposal would cost.

“If a teacher can’t afford to live in the community they work in, that is not going to be an attractive profession,” he said. “We need to do a better job in Colorado making sure teachers are rewarded for their hard work.”

Other components to Polis’s plan includes providing student loan relief for teachers who commit to serving in high-need and rural areas, increasing teacher training and building and renovating more.

Polis is the latest Democrat to roll out an education platform.

Former state Sen. Michael Johnston released more details earlier this week about his campaign promise for tuition-free community college and job training.

Johnston’s campaign estimates that the initiative would cost about $47 million annually. The campaign provided specifics on how the state would pay for it: by combining existing federal grants and state scholarships, revenue from online sales tax, and state workforce development funding. Savings from volunteer hours put in by tuition recipients also are factored in.

Former state Treasurer Cary Kennedy released her education plan last month.

Like Polis, Kennedy is calling for teacher raises. She wants the state’s average salary to be closer to the national average. The former state treasurer also wants to expand preschool and job training for high school students. A key piece of Kennedy’s proposal to pay for her initiatives: reforming the state’s tax laws to generate more revenue.

Other Democrats running to replace Gov. John Hickenlooper, who is term-limited, include Lt. Gov. Donna Lynne and businessman Noel Ginsburg.

The Republican field to replace Hickenlooper, a Democrat, is also crowded. Attorney General Cynthia Coffman announced earlier this month that she’s running. Other leading Republican candidates include former Congressman Tom Tancredo, state Treasurer Walker Stapleton, and businessmen Doug Robinson and Victor Mitchell. George Brauchler, district attorney for the 18th Judicial District, dropped out of the race to instead run for attorney general.