Rating principals

Principals perform well in pilot test of evaluation system

PHOTO: Tajuana Cheshier/ Chalkbeat TN
Kenneth Woods and his daughters Breanna Rosser (r) and Taylor Woods (r) reviewed 12 powerful words with sixth grade language arts teacher Patricia Hervey.

Some 94 percent of participating Colorado principals and assistant principals were ranked as proficient or higher in a pilot test of the state’s evaluation system, according to a new report from the Department of Education.

But the results may not be indicative of how school leaders will perform when the full evaluation system, which will eventually incorporate measures of student growth on standardized tests, rolls out. In addition, the report included ratings for only 410 principals and assistant principals in 21 pilot districts. The state has more than 2,800 principals and assistant principals, as calculated on a full-time equivalent basis.

The overall ratings for pilot principals found 18 percent exemplary, 30 percent accomplished, 46 percent proficient and 5 percent partially proficient. No principals were rated as skills being “not evident,” the lowest category.

Although the percentage differences were relatively small, the principals received the highest ratings in managerial leadership and somewhat lower ratings on instructional leadership and external leadership (family and community involvement).

“Historically that’s we’ve asked them to do, [so]… it’s not surprising” principals rated highest in management, said Katy Anthes, executive director of educator effectiveness for CDE. Anthes recently briefed the State Council for Educator Effectiveness on the report.

Those results are similar to those for teachers evaluated under the 2012-13 pilot (see story).

Principals were the initial guinea pigs for the evaluation system. A smaller group of principals and assistants was evaluated during 2011-12, and the pilot continued with a larger group during 2012-13. This school year all principals and teachers are being evaluated under systems that comply with Senate Bill 10-191, the law that created the new system.

“A lot of people moved up a little bit” from the first year to the second, data analyst Britt Wilkinfeld told the council. Of the 196 principals who were evaluated both years, 36 percent improved their performance, she said.

“It’s skewed toward the positive, which isn’t surprising, she said, because “it’s still very early in the implementation” of the evaluation system.

“All findings should be considered preliminary,” the report cautions, because “educators “are still learning and becoming familiar with the system, there continues to be variability in the way districts are training and implementing the system and CDE is continuing to learn from and make improvements to the system.”

The report concluded that preliminary analyses of the pilot data “indicate that the professional practice rubric [score sheet] captures multiple aspects of school leadership and differences in principal practice.” Based on the preliminary findings, “CDE continues to find evidence for reliability and validity in the” principal evaluation system.

Principal standards
  • Strategic leadership
  • Instructional leadership
  • Equity leadership
  • HR leadership
  • Managerial leadership
  • External leadership

More info on standards & elements

The pilot principal evaluations were based on professional practices and lacked half of the evaluation data – measures of student growth. When the evaluations system is fully rolled out, both teacher and principal evaluations will be based half on professional practice and half on student growth. Both sets of data will be combined into ratings of highly effective, effective, partially effective or ineffective. Principals already can be fired at the will of their employers, regardless of evaluations ratings. But non-probationary teachers will lose that status if they have two consecutive years of ineffective or partially effective ratings.

Each of the six principal quality standards includes three or more detailed “elements” on which principals are evaluated. For instance, the managerial leadership standard contains six elements, including one for budget management.

The CDE study found that pilot principals were rated highest on such elements as commitment to the whole child, ensuring supportive environments, maximizing instructional time, fostering professional learning communities and conflict management.

Lowest rated elements were implementing high-quality instruction, setting high student expectations, creating school plans, setting instructional practices, family and community outreach and budgeting.

Other study findings include:

  • Elementary principals were rated somewhat higher.
  • More experienced principals received better ratings.
  • Principals scored better than assistant principals.
  • Female principals scored better than males, but there were no statistically significant difference based on ethnicity.
  • Principal ratings were not correlated with student demographics but were correlated with the number of points earned on a school’s performance rating.
  • Ratings were correlated to schools’ overall student growth data, but the correlation was not statistically significant for TCAP scores.
  • Principal ratings were correlated with positive responses on teacher school-climate surveys.

The department surveyed pilot principals about the evaluations both before the program started and after each school year. The surveys showed “a steady increase of positive responses,” the report said.

help wanted

What a dearth of teachers means for a school in a one-stoplight Colorado town

Retired English teacher Peggy Allen, center, speaks with Otis Principal Michelle Patterson, left, and Superintendent Kendra Anderson at Mama's, the town's lone restaurant. (Photo by Nic Garcia)

OTIS — Late last spring, after five of her two dozen teachers resigned with no replacements in sight, Superintendent Kendra Anderson reassured her school’s anxious principal that everything would be fine.

Then she walked the 25 feet between their two offices, sat down at her desk and said to herself: “Oh, crap.”

Anderson remembered a time — and not that long ago — when she could pick out a six-year veteran from a pile of resumes whenever she had an unexpected teaching vacancy.

“I don’t have that luxury anymore,” she said this summer, recalling the desperate situation she was in to replace a fourth of the teaching staff of the rural K-12 school in just a few months.

Anderson’s urgent need for teachers for her 230 students — half of them living in poverty in this one-stoplight Colorado town on the Eastern Plains — offers a window into how rural schools like hers are grappling with a dearth of teachers.

Otis’s challenges to keep and attract teachers are felt across the state. Low taxes make it nearly impossible to offer a competitive salary; one retired Otis teacher suggested she could make more money waiting tables. Increased regulations and unfunded mandates from the state have made the work nearly unbearable, educators say. And the school’s distance from the Front Range keep some urban solutions such as long-term substitutes or Teach For America corps out of their classrooms.

On the ground, the biggest challenge for superintendents like Anderson is the need to protect students from the most damaging impacts of the shortage, even as many of them would benefit from more resources, not fewer.

“The one thing that keeps me up at night is how we go years with some of our rural schools not having a math teacher,” said Robert Mitchell, the former director of educator preparation at the department of higher education. “These kids out here deserve the same opportunity as the kids in Boulder Valley. It’s not acceptable that we have vacancies and zero people apply.”

The problem is so pronounced that state education officials, at the legislature’s behest, fanned out across Colorado this summer — including a stop in Otis — to examine ways to turn around a shortage that is most severe in the state’s rural areas.

A plan informed by this statewide tour, which was recently completed, is due to state legislators by December.

Michelle Murphy, executive director of the Colorado Rural Schools Alliance, discusses the teacher shortage at the state’s town hall at the Otis school. (Photo by Nic Garcia/Chalkbeat)

No overflow

“Everything has to change” whenever a teacher leaves, Michelle Patterson, Otis’s principal said. The ripple effects, especially in areas with small staffs, are significant.

When the school’s agriculture teacher left this spring, administrators had to find a new teacher to take over his class sponsorship duties, which included helping students raise money for projects and providing them with emotional support through high school.

No one knew which conferences to register the Future Farmers of America club for, or which hotels to stay at when they went.

The district also had to hire a new bus driver, because the retired teacher, a 21-year veteran, had done that, too.

“It’s more than just that instruction for that content area that leaves us,” Superintendent Anderson said. “It’s the relationship with the students they developed over time. It’s the training we’ve given them that’s lost.”

The teacher shortage is both an old and new problem for rural schools.

“We’ve had a teacher shortage in rural Colorado since the 1970s,” said Michelle Murphy, executive director of the Colorado Rural Schools Alliance. “But we used to be able to get overflow from the metro area. Now, there’s no overflow.”

Since 2010, there’s been a 24 percent drop in graduates from the traditional teacher prep programs at the state’s colleges and universities. There’s also been a 23 percent drop in enrollment to those programs.

Alternative programs, such as residency programs, have seen a 40 percent increase in enrollment. However, those programs produce far fewer teachers than traditional programs and can’t keep up with demand. According to the state department of education, the state’s public schools employ more than 53,000 teachers.

The shortage is not evenly distributed across all classrooms. Math and science teachers are in short supply: Only 192 college students in 2016 graduated with credentials to teach those subjects. The same year, 751 students left with a degree to teach elementary school.

Officials believe a variety of factors are contributing to the shortage. The profession perceives that it is undervalued, and the pay in many communities does not cover basic costs of living. And as poverty rises, the scope of the job is expanding; students are coming to school with more trauma that educators must mitigate before they can even begin to teach phonics or subtraction.

Rural schools face additional challenges attracting new teachers away from urban centers.

Housing is in short supply — so much so that some school districts are building their own housing for teachers.

And while the cost of living might seem lower in rural areas, “gas, groceries and health insurance all are more expensive,” Anderson said. “We travel a long way to the grocery store, to work. The nearest Walmart is 50 miles away.”

It can also be lonely, especially for recent college graduates without any family nearby.

Caitlin Evans is Otis’s new high school English teacher. She sits in her barren classroom before the start of the school year. Evans was issued an emergency license so she could teach. (Photo by Nic Garcia/Chalkbeat)

A tale of two Otis teachers

Peggy Allen was one of the five Otis teachers to leave the classroom this spring.

Allen, who taught English, began her career in Otis as a secretary. After 17 years of running the school district’s office, she went to college to become a teacher.

“I loved teaching,” she said as she finished her lunch in Mama’s, Otis’s single restaurant, which also serves as its de facto town square. “You build a personal relationship with everyone at the school and in town. Everybody knows your business — and needs. We take care of each other.”

But after 12 years in the classroom, the 65-year-old decided to retire.

“I saw younger people with vigor and energy, and I thought: ‘I don’t have that anymore,’” she said.

Increased state regulations also became a burden. “I didn’t love jumping through all the hoops,” she said.

To find a replacement for Allen, Anderson reached out to a national network of principals and school officials she’s built through the years.

One woman who Anderson met at a conference several years ago had a daughter, Caitlin Evans, who had moved to a town 40 miles east of Otis. Evans, 33, had been teaching at Morgan Community College and was interested in switching to high schoolers.

Evans grew up in Brighton, a blue collar suburb of Denver. After high school, she enrolled at the University of Colorado. She remembers feeling far behind some of her fellow freshmen who attended East Coast prep schools.

Evans was excited about better preparing rural students for college to compete with their urban peers.

“If I can be a bridge for them, that’s a good thing,” she said.

But Evans had a newborn and no teaching license. So Anderson went to work helping her find childcare and working with state education officials to issue Evans an emergency license.

The state this year has issued 30 emergency licenses, which allow individuals to teach without meeting some state requirements.

State Rep. Jim Wilson, a Salida Republican, earlier this year sponsored a bill that would have allowed rural school districts like Otis to waive out of the state’s licensing practices all together. It was an idea that was backed by the Rural School Alliance but faced staunch opposition from the state’s teachers union. That opposition forced Wilson to spike his own bill.

Licensing reform, an issue that has vexed lawmakers and the governor alike, is likely to come up as the state education and higher education departments move forward with their plan to curb the shortage. But Superintendent Anderson is wary.

“I don’t want to give the perception that it’s easier to be a teacher than any other profession,” she said.

Otis school leaders were able to fill all of their vacancies, in part because Evans was issued an emergency license. However, it’s only good for one academic year. Anderson is already worrying about how to keep Evans in the classroom next year.

Farm equipment sit outside the Otis school, which is sandwiched between a Baptist church and a wheat farm. (Photo by Nic Garcia/Chalkbeat)

“We just need the resources”

More than 40 people showed up to the Otis school, which sits between a Baptist church and a corn, wheat and millet farm, for the state’s town hall on the teacher shortage.

In the audience were several members of the Otis community, including two school board members. There were executives from Denver-based education nonprofits. Educators from other Eastern Plains communities such as a principal from Julesburg and teachers from Yuma also attended.

State officials pleaded with the audience to focus on solutions — especially low-cost solutions. That doesn’t mean salary increases are off the table, the state officials said. It just means that everyone knows that teachers in the low tax state of Colorado could make a lot more money yet still trail far behind national average salaries.

This school year will be the first Otis teachers see a pay increase since the Great Recession. The starting salary will be $31,666. The average salary for an Otis teacher is $36,468, administrators said. And the highest paid teacher, a long time veteran, earns $46,258.

Part of the reason why the school district was able to afford the raises out of its $3.4 million budget was because of a rare savings in health care costs.

Anderson called it a gamble.

As the town hall began to wind down, Shea Smith, the Otis guidance counselor, snuck out and returned to her office, where she was preparing for the first day of school.

She and another teacher, Tenaly Bleak, reflected on the intersection of the teacher shortage and the changing demographics of their students.

As it becomes increasingly expensive to live along the Front Range, families are seeking low-cost housing on the plains. Since 2011, the school’s free or reduced-price lunch rate, a measure of poverty, has nearly doubled to 56 percent. Last year, the school enrolled its first homeless student. And there’s a good chance the school will need to hire a second special education teacher because a few new students with special needs enrolled this summer.

Smith, who has been in the Otis school for nine years, remembers the last time the school tried to hire a special education teacher. The job remained vacant for three years until the school’s leadership decided to take the job posting down and just do without.

As poverty has risen in Otis, teachers have taken on another role: caretaker.

“Somedays, the most you can do is love them and feed them and make them feel safe, and hope you can get a little reading in, and a little math in,” Smith said.

It’s unclear how student performance has shifted as poverty has increased in Otis. Poor students historically do not score as highly as their more affluent peers. Not enough Otis students are taking the state’s test for the state education department to report the results and provide a quality rating. 

The role poverty is playing in the classroom and the stress it has put on educators has been highlighted by Education Commissioner Katy Anthes.

Teachers are reporting to the department that “they’re spending more time on management and organization and meeting the basic needs of students than they ever have before,” Anthes told the State Board of Education at its August meeting.

So what can the state do to keep teachers from fleeing Otis and other rural school districts?

Bleak said more support would go a long way. For instance, she suggested, establishing a special fund for school supplies and candy that teachers can hand out would save her $100 a month, she guessed.

“We care,” she said. “We want to do the best job possible. We just need the resources.”

An intersection in Otis, Colorado. (Photo by Nic Garcia/Chalkbeat)

Incentives

Westminster district will give bonuses if state ratings rise, teachers wonder whether performance pay system is coming

PHOTO: Nicholas Garcia
Students work on an English assignment at M. Scott Carpenter Middle School in Westminster.

Teachers and employees in Westminster Public Schools will be able to earn a bonus if they help the struggling district improve its state ratings next year.

The district’s school board on Tuesday unanimously approved the $1.7 million plan for the one-year performance stipends, the district’s latest attempt to lift the quality of its schools.

School employees can earn $1,000 if their school meets a district-set score, or up to $2,000 if they reach a more ambitious goal the school sets. District employees, including the superintendent, can earn $1,000 if the district as a whole jumps up a rating next year.

“We recognize that everyone plays a critical role in increasing student achievement and we decided that if a particular school or the district as a whole can reach that next academic accreditation level, the employees directly responsible should be rewarded,” board president Dino Valente said in a statement.

The district is one of five that was flagged by the state for chronic low performance and was put on a state-ordered improvement plan this spring.

District officials have disputed state ratings, claiming the state’s system is not fairly assessing the performance of Westminster schools. Middle school teacher Melissa Duran, who also used to be president of the teacher’s union, drew a connection between that stance and the new stipends, saying any extra pay she gets would be based on one score.

“The district has gone to the state saying, ‘Why are you rating us on these tests, look at all the other things we’re doing’” Duran said. “Well, it’s the same thing for teachers. They’re still basing our effectiveness on a test score.”

Teachers interviewed Thursday said their first thoughts upon learning of the plan was that it sounded like the beginnings of performance pay.

“I already get the point that we are in need of having our test scores come up,” said math teacher Andy Hartman, who is also head of negotiations for the teacher’s union. “Putting this little carrot out there isn’t going to change anything. I personally do not like performance pay. It’s a very slippery slope.”

District leaders say they talked to all district principals after the announcement Wednesday, and heard positive feedback.

“A lot of the teachers think this is a good thing,” said Steve Saunders, the district’s spokesman.

National studies on the effectiveness of performance pay stipends and merit pay have shown mixed results. One recent study from Vanderbilt University concluded that they can be effective, but that the design of the systems makes a difference.

In Denver Public Schools, the district has a performance-pay system to give raises and bonuses to teachers in various situations. Studies of that model have found that some teachers don’t completely understand the system and that it’s not always tied to better student outcomes.

Westminster officials said they have never formally discussed performance pay, and said that these stipends are being funded for one year with an unanticipated IRS refund.

Westminster teachers said they have ideas for other strategies that could make a quick impact, such as higher pay for substitutes so teachers aren’t losing their planning periods filling in for each other when subs are difficult to find.

Waiting on a bonus that might come next year is not providing any new motivation, teachers said.

“It’s a slap in the face,” Duran said. “It’s not like we are not already working hard enough. Personally, I already give 110 percent. I’ve always given 110 percent.”

Last month, the school board also approved a new contract for teachers and staff. Under the new agreement, teachers and staff got a raise of at least 1 percent. They received a similar raise last year.