test

Evidence builds - corporate ed policies are failing

Lately, study after study, report after report is casting doubt on the efficacy of corporate education reform polcies. The ltest comes from The Broader Bolder Approach to Education

Pressure from federal education policies such as Race to the Top and No Child Left Behind, bolstered by organized advocacy efforts, is making a popular set of market-oriented education “reforms” look more like the new status quo than real reform.

Reformers assert that test-based teacher evaluation, increased school “choice” through expanded access to charter schools, and the closure of “failing” and underenrolled schools will boost falling student achievement and narrow longstanding race- and income-based achievement gaps.

KEY FINDINGS
The reforms deliver few benefits and in some cases harm the students they purport to help, while drawing attention and resources away from policies with real promise to address poverty-related barriers to school success:

  • Test scores increased less, and achievement gaps grew more, in “reform” cities than in other urban districts.
  • Reported successes for targeted students evaporated upon closer examination.
  • Test-based accountability prompted churn that thinned the ranks of experienced teachers, but not necessarily bad teachers.
  • School closures did not send students to better schools or save school districts money.
  • Charter schools further disrupted the districts while providing mixed benefits, particularly for the highest-needs students.
  • Emphasis on the widely touted market-oriented reforms drew attention and resources from initiatives with greater promise.
  • The reforms missed a critical factor driving achievement gaps: the influence of poverty on academic performance. Real, sustained change requires strategies that are more realistic, patient, and multipronged.

That's a troubling litanty of corporate education reform failure. You can read the report, here.

The Trouble with the Common Core

Via Rethinking Schools

It isn’t easy to find common ground on the Common Core. Already hailed as the “next big thing” in education reform, the Common Core State Standards are being rushed into classrooms in nearly every district in the country. Although these “world-class” standards raise substantive questions about curriculum choices and instructional practices, such educational concerns are likely to prove less significant than the role the Common Core is playing in the larger landscape of our polarized education reform politics.

We know there have been many positive claims made for the Common Core:

  • That it represents a tighter set of smarter standards focused on developing critical learning skills instead of mastering fragmented bits of knowledge.
  • That it requires more progressive, student-centered teaching with strong elements of collaborative and reflective learning.
  • That it equalizes the playing field by raising expectations for all children, especially those suffering the worst effects of the “drill and kill” test prep norms of the recent past.

We also know that many creative, heroic teachers are seeking ways to use this latest reform wave to serve their students well. Especially in the current interim between the roll-out of the standards and the arrival of the tests, some teachers have embraced the Common Core as an alternative to the scripted commercial formulas of recent experience, and are trying to use the space opened up by the Common Core transition to do positive things in their classrooms.

We’d like to believe these claims and efforts can trump the more political uses of the Common Core project. But we can’t.

For starters, the misnamed “Common Core State Standards” are not state standards. They’re national standards, created by Gates-funded consultants for the National Governors Association (NGA). They were designed, in part, to circumvent federal restrictions on the adoption of a national curriculum, hence the insertion of the word “state” in the brand name. States were coerced into adopting the Common Core by requirements attached to the federal Race to the Top grants and, later, the No Child Left Behind waivers. (This is one reason many conservative groups opposed to any federal role in education policy oppose the Common Core.)

Written mostly by academics and assessment experts—many with ties to testing companies—the Common Core standards have never been fully implemented and tested in real schools anywhere. Of the 135 members on the official Common Core review panels convened by Achieve Inc., the consulting firm that has directed the Common Core project for the NGA, few were classroom teachers or current administrators. Parents were entirely missing. K–12 educators were mostly brought in after the fact to tweak and endorse the standards—and lend legitimacy to the results.

The standards are tied to assessments that are still in development and that must be given on computers many schools don’t have. So far, there is no research or experience to justify the extravagant claims being made for the ability of these standards to ensure that every child will graduate from high school “college and career ready.” By all accounts, the new Common Core tests will be considerably harder than current state assessments, leading to sharp drops in scores and proficiency rates.

We have seen this show before. The entire country just finished a decade-long experiment in standards-based, test-driven school reform called No Child Left Behind. NCLB required states to adopt “rigorous” curriculum standards and test students annually to gauge progress towards reaching them. Under threat of losing federal funds, all 50 states adopted or revised their standards and began testing every student, every year in every grade from 3–8 and again in high school. (Before NCLB, only 19 states tested all kids every year, after NCLB all 50 did.)

[readon2 url="http://www.rethinkingschools.org/archive/27_04/edit274.shtml"]Continue reading...[/readon2]

Why Test Scores CAN'T Evaluate Teachers

From the National Education Policy Center. the entire post is well worth a read, here's the synopsis

The key element here that distinguishes Student Growth Percentiles from some of the other things that people have used in research is the use of percentiles. It's there in the title, so you'd expect it to have something to do with percentiles. What does that mean? It means that these measures are scale-free. They get away from psychometric scaling in a way that many researchers - not all, but many - say is important.

Now these researchers are not psychometricians, who aren't arguing against the scale. The psychometricians as who create our tests, they create a scale, and they use scientific formulae and theories and models to come up with a scale. It's like on the SAT, you can get between 200 and 800. And the idea there is that the difference in the learning or achievement between a 200 and a 300 is the same as between a 700 and an 800.

There is no proof that that is true. There is no proof that that is true. There can't be any proof that is true. But, if you believe their model, then you would agree that that's a good estimate to make. There are a lot of people who argue... they don't trust those scales. And they'd rather use percentiles because it gets them away from the scale.

Let's state this another way so we're absolutely clear: there is, according to Jonah Rockoff, no proof that a gain on a state test like the NJASK from 150 to 160 represents the same amount of "growth" in learning as a gain from 250 to 260. If two students have the same numeric growth but start at different places, there is no proof that their "growth" is equivalent.

Now there's a corollary to this, and it's important: you also can't say that two students who have different numeric levels of "growth" are actually equivalent. I mean, if we don't know whether the same numerical gain at different points on the scale are really equivalent, how can we know whether one is actually "better" or "worse"? And if that's true, how can we possibly compare different numerical gains?

[readon2 url="http://nepc.colorado.edu/blog/why-test-scores-cant-evaluate-teachers"]Continue reading...[/readon2]

The Arbitrary Albatross: Standardized Testing and Teacher Evaluation

On Chicago's streets and Hollywood's silver screens, education reform has been cast as a false dilemma between students and teachers. Reputable actresses and liberal mayors have both fallen prey. At the center of this drama lie teacher evaluations. A linchpin of the debate, they weigh especially heavily around the necks of educators like me.

Think: Shaky Foundation

With the arrival of spring, testing season is now upon us: America's new national pastime. I believe student results from standardized tests should not be used to evaluate teachers because the data are imprecise and the effects are pernicious. Including such inaccurate measures is both unfair to teachers and detrimental to student learning.

As a large body of research suggests, standardized test data are imprecise for two main reasons. First, they do not account for individual and environmental factors affecting student performance, factors over which teachers have no control. (Think: commitment, social class, family.) Second, high-stakes, one-time tests increase the likelihood of random variation so that scores fluctuate in arbitrary ways not linked to teacher efficacy. (Think: sleep, allergies, the heartache of a recent breakup.)

High-stakes assessments are also ruinous to student learning. They encourage, at least, teaching to the test and, at most, outright cheating. This phenomenon is supported by Campbell's law, which states statistics are more likely to be corrupted when used in making decisions, which in turn corrupts the decision making process itself. (Think: presidential campaigns.)

As a teacher, if my livelihood is based on test results, then I will do everything possible to ensure high marks, including narrowing the curriculum and prepping fiercely for the test. The choice between an interesting project and a paycheck is no choice at all. These are amazing disincentives to student learning. Tying teachers' careers to standardized tests does not foster creative, passionate, skillful young adults. It does exactly the opposite.

[readon2 url="http://www.edutopia.org/blog/standardized-testing-and-teacher-evaluation-aaron-pribble"]Continue reading...[/readon2]

The cheating will continue until morale improves

Atlanta wasn’t an isolated incident. Neither was El Paso, or Washington, DC, or Columbus. A new General Accounting Office report demonstrates that cheating by school officials on standardized tests has become commonplace despite the use of security measures the report recommends. The only solution is one that Education Secretary Arne Duncan has so far refused—removing the high stakes attached to standardized testing.

The latest embarrassment is in Columbus, where this month Ohio State Auditor Dave Yost seized records at 20 high schools. This is part of a two-year-old investigation into “scrubbing” 2.8 million attendance records of students who failed tests. Yost has recently widened his investigation to look into whether school administrators also changed grades to boost graduation rates.

A GOA reportreleased May 16 recommends adopting “leading practices to prevent test irregularities.” However, the report reveals that while all states and the District of Columbia use at least some of the recommended best practices, 33 states had confirmed instances of test cheating in the last two school years. And states where the worst offenses are occurring already have adopted most of the practices identified in the report, making it unlikely that greater security will improve test integrity.

Ohio employs five of the nine security plans recommended by the GOA report. Atlanta, where the superintendent and 34 other educators were recently indicted for changing test answers, has adopted eight of nine security practices, as has Texas, where the former El Paso superintendant is now in federal prison for a scheme to encourage low-performing students to drop out. And Washington, D.C., where 191 teachers at 70 schools were implicated in a rash of wrong-to-right erasure marks on tests, uses every single security measure.

The Department of Education responded to the GAO’s findings by holding a symposium on test integrity and issuing a follow-up report on best practices and policies. But the federal government convening a meeting and issuing yet another report might be even less effective at stopping cheating than increased security.

The report also noted that linking awards and recognition to improving test scores and threatening the jobs of principals for low test scores “could provide incentives to cheat.” But at a conference of education writers in April, Sec. Arne Duncan denied that linking test scores to career outcomes could drive educators to criminally manipulate the system.

“I reject the idea that the system forces people to cheat,” he said.

Maybe so, but cheating now seems inherent in the system, and our Education Secretary seems incurious as to why. It’s even hard to get him to admit there is an epidemic of test cheating. Asked about the Ohio investigation, Duncan said, “I almost don’t know of another situation like this.”

[readon2 url="http://jasonstanford.org/2013/05/the-cheating-will-continue-until-morale-improves/"]Continue reading...[/readon2]

Michelle Rhee and the unproven teacher evaluation

Via the LA Times

The debate -- and that’s putting it nicely -- over the use of standardized test scores in teacher evaluations has always confused me, because the answer seemed so simple. One of the things we ask of teachers -- but just one thing -- is to raise those scores. So they have some place in the evaluation. But how much? Easy. Get some good evidence and base the decisions on that, not on guessing. The quality of education is at stake, as well as people’s livelihoods.

Much to my surprise, at a meeting with the editorial board this week, Michelle Rhee agreed, more or less. As one of the more outspoken voices in the school-reform movement, Rhee is at least as polarizing as the topic of teacher evaluations, and her lobbying organization, Students First, takes the position that the standardized test scores of each teacher’s students should count for no less than 50% of that teacher’s rating on performance evaluations.

But asked where the evidence was to back up that or any other percentage figure, Rhee agreed quite openly that it’s lacking.

[readon2 url="http://www.latimes.com/news/opinion/opinion-la/la-ol-michelle-rhee-teachers-20130416,0,4487460.story"]Continue reading...[/readon2]