evidence

Charter School Authorization And Growth

If you ask a charter school supporter why charter schools tend to exhibit inconsistency in their measured test-based impact, there’s a good chance they’ll talk about authorizing. That is, they will tell you that the quality of authorization laws and practices — the guidelines by which charters are granted, renewed and revoked — drives much and perhaps even most of the variation in the performance of charters relative to comparable district schools, and that strengthening these laws is the key to improving performance.

Accordingly, a recently-announced campaign by the National Association of Charter School Authorizers aims to step up the rate at which charter authorizers close “low-performing schools” and are more selective in allowing new schools to open. In addition, a recent CREDO study found (among other things) that charter middle and high schools’ performance during their first few years is more predictive of future performance than many people may have thought, thus lending support to the idea of opening and closing schools as an improvement strategy.

Below are a few quick points about the authorization issue, which lead up to a question about the relationship between selectivity and charter sector growth.

The reasonable expectation is that authorization matters, but its impact is moderate. Although there has been some research on authorizer type and related factors, there is, as yet, scant evidence as to the influence of authorization laws/practices on charter performance. In part, this is because such effects are difficult to examine empirically. However, without some kind of evidence, the “authorization theory” may seem a bit tautological: There are bad charters because authorizers allow bad charters to open, and fail to close them.

That said, the criteria and processes by which charters are granted/renewed almost certainly have a meaningful effect on performance, and this is an important area for policy research. On the other hand, it’s a big stretch to believe that these policies can explain a large share of the variation in charter effects. There’s a reasonable middle ground for speculation here: Authorization has an important but moderate impact, and, thus, improving these laws and practices is definitely worthwhile, but seems unlikely to alter radically the comparative performance landscape in the short- and medium-term (more on this below).

Strong authorization policies are a good idea regardless of the evidence. Just to be clear, even if future studies find no connection between improved authorization practices and outcomes, test-based or otherwise, it’s impossible to think of any credible argument against them. If you’re looking to open a new school (or you’re deciding whether or not to renew an existing one), there should be strong, well-defined criteria for being allowed to do so. Anything less serves nobody, regardless of their views on charter schools.

[readon2 url="http://shankerblog.org/?p=8510"]Continue reading...[/readon2]

21 tough questions about school reform

Via the Washington Post, civil rights activist James Meredith, asks 21 tough questions about school reform

1.) Children’s Rights: Do you believe that every child in the United States has the right to an excellent public education delivered by the most qualified professional teachers; an education aggressively supported by the family and the community, and an education based on the best research and evidence?

2.) Parent Responsibilities: Would you support the idea of public schools strongly encouraging and helping parents to: be directly involved in their children’s education; support their children with healthy eating and daily physical activity; disconnect their children from TV and video games; and read books to and with them on a daily basis from birth through childhood?

3.) Educational Equity: Do you believe that America should strive to deliver educational equity of resources to all students of all backgrounds and income groups?

4.) Testing Reforms: Much of current education reform policy is built on the idea that the U.S. must catch up to nations that achieve high scores in the international PISA (Program for International Student Assessment) tests, like Finland, South Korea and Singapore. But since these nations rely on few if any of the reform strategies being promoted in the United States, like cyber-charters, frequent high-stakes standardized tests linked to teacher evaluation, teacher bonus pay, vouchers, and hiring teachers with no experience and no advanced degrees in education – - why would the U.S. implement these strategies without first field-testing them thoroughly?

5.) Teacher Qualifications: If a critical factor in the success of the highest-performing education nations like Finland, South Korea and Singapore, and of high-performing American private and parochial schools, is a highly professionalized, highly experienced and highly respected teacher force, why is the United States pursuing policies to de-professionalize the public school teacher force, including sending recent college graduates into our highest-needs, highest-poverty schools with five weeks of training, no education degree and no experience? What is the hard evidence that such policies improve student outcomes, versus teachers with at least 2 to 5 years of experience and advanced degrees in education?

6.) Evidence for Classroom Products: What rigorous, independent evidence supports the use of computer products to deliver academic benefit to K-8 students as support to, or replacements for, flesh-and-blood teachers? Specifically, what computer products have such evidence of improving student outcomes, when fully tested versus classrooms without such products, and versus classrooms without such products but with more experienced teachers?

7.) Taxpayer Spending on Products: Would you support requiring computer software and hardware companies to fund rigorous independent research to validate the delivery of academic benefit to K-8 students by their products, before billions of dollars of taxpayer money is spent on buying such products?

8.) Taxpayer Spending on Testing: According to one estimate, American taxpayers spend about $20,000,000,000 annually on standardized tests like multiple-choice “bubble tests” but many teachers and students are saying they are hijacking huge amounts of school time that should be used for authentic learning, and thereby seriously damaging our children’s education. What evidence is there that the money and time being spent on high-stakes standardized tests is improving student outcomes and delivering academic benefit to students?

9.) Dangers of Linking Standardized Testing to Teacher Evaluation: A number of experts assert that students standardized test data should not be linked to teacher pay or evaluation because the data can be highly unstable, volatile, misleading or invalid for such purposes and will incorrectly penalize teachers of both high-achieving and high-needs students; arguments presented, for example, on this fact sheet from the Center for Fair & Open Testing, or FairTest.

What is your point of view on this – are these experts correct or incorrect?

10.) Advantages for Students: If the children and grandchildren of people like President Obama and American politicians and business leaders enjoy the benefits of private schools with highly experienced teachers, small class sizes, frequent diagnostic testing and assessments designed by their teachers, rich and full curricula including the arts and physical activity, regular recess, and a minimum of standardized “bubble” tests, should we strive to give the same advantages to all public school students? If not, why not?

[readon2 url="http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/06/12/james-meredith-asks-21-tough-questions-about-school-reform/"]Continue reading...[/readon2]

ALEC's Report Card Receives Failing Marks

Via the Great Lakes Center

EAST LANSING, Mich. (May 9, 2013) – Ranking states is a popular tool for education advocacy groups, with the goal of advancing a policy agenda based on ideologically driven pre-packaged reforms. These report cards receive considerable media attention, although few reflect research-based evidence on the efficacy of particular polices. The 18th edition of the American Legislative Exchange Council's (ALEC) Report Card on American Education: Ranking State K-12 Performance, Progress, and Reform is no different according to an academic review.

Christopher Lubienski, associate professor of education policy and Director of the Forum on the Future of Public Education at the University of Illinois, and T. Jameson Brewer, a doctoral student at the University of Illinois, reviewed ALEC's Report Card for the Think Twice think tank review project. The review was produced by the National Education Policy Center (NEPC), with funding from the Great Lakes Center for Education Research and Practice.

Lubienski and Brewer find that ALEC draws its grades exclusively not from research organizations, but from like-minded market-orientated advocacy organizations.

"Furthermore, when studies are highlighted in this report, they do not represent the peer-reviewed research on a given issue, are often of extremely poor quality, and generally unsuited for supporting their claim."

In their review, Lubienski and Brewer provide two key areas – alternative teacher certification and school choice – to highlight gaps between ALEC's agenda and empirical evidence. Despite multiple claims that a "growing body of research indicates…" – the report offers absolutely no supporting evidence. Math results, which have a lower pass rate, were used to compare traditionally-certified teachers to alternatively-certified teachers. Meanwhile alternatively-certified teachers were portrayed using their reading results.

"Many of the grades given to states reflect the level to which pro-market policies have been implemented while the grades systematically ignore meaningful measurements of equality and outcomes" according to the review.

Readers of ALEC's Report Card should consider it a statement of policy preferences and not an overview of research on education reforms.

The reviewers conclude, "At best, the report serves as an amalgamation of other like-minded think tanks' assessments of states' adoption of pro-market policies, and thus offers nothing new … it provides little or no usefulness to policymakers."

Find the report by Lubienski and Brewer on the Great Lakes Center website: www.greatlakescenter.org

Michelle Rhee and the unproven teacher evaluation

Via the LA Times

The debate -- and that’s putting it nicely -- over the use of standardized test scores in teacher evaluations has always confused me, because the answer seemed so simple. One of the things we ask of teachers -- but just one thing -- is to raise those scores. So they have some place in the evaluation. But how much? Easy. Get some good evidence and base the decisions on that, not on guessing. The quality of education is at stake, as well as people’s livelihoods.

Much to my surprise, at a meeting with the editorial board this week, Michelle Rhee agreed, more or less. As one of the more outspoken voices in the school-reform movement, Rhee is at least as polarizing as the topic of teacher evaluations, and her lobbying organization, Students First, takes the position that the standardized test scores of each teacher’s students should count for no less than 50% of that teacher’s rating on performance evaluations.

But asked where the evidence was to back up that or any other percentage figure, Rhee agreed quite openly that it’s lacking.

[readon2 url="http://www.latimes.com/news/opinion/opinion-la/la-ol-michelle-rhee-teachers-20130416,0,4487460.story"]Continue reading...[/readon2]

Begone Ghosts of Reform Past!

The first few weeks of 2013 have greeted us like a trip with old Marley revisiting school reforms of the past. In the very first weeks, we have Michelle Rhee's StudentsFirst lobby announce letter grades for states based on their adherence to her favorite pillars of reform policies. John Merrow provided us with a reprise of her greatest hits as the head of DC schools, along with some news regarding the cheating that accompanied her regime.

And next the Gates Foundation has provided us with another example of the perils of mixing research with advocacy. Their multi-year, multi-million dollar Measures of Effective Teaching project has once again supported their belief that we can predict which teachers will get the best test scores next year by looking at who got the best test scores this year. The practice of actually observing a teacher to see how "effective" they are does not apparently add much accuracy to the prediction, but they keep it in there nonetheless, perhaps for sentimental reasons. Then we have tossed in a new element - student surveys. And the perfect evaluation is some balanced mixture of these three elements, which will turn VAM lead into gold.

One reformer, Michael Petrilli of the Fordham Foundation, has come right out and admitted what public school advocates have contended from the start. Many charter schools filter out difficult students, and whatever competitive performance advantages they have demonstrated are not credible evidence that they can do more with less. They can do more with more - and with fewer of the students most damaged by the scourge of poverty. Of course, Mr. Petrilli believes this ought to be celebrated, because like the Makers of Romneyan mythology, these students are "strivers," who ought to be well-served. The laggards they leave behind are of little concern. This is a frightening educational philosophy that runs counter to the main reform narrative, which has called upon civil rights rhetoric to justify school closures and charter expansion. But how can we reconcile an ethic supposedly based on equitable opportunities for all with a bare-knuckle life boat strategy that leaves many students behind to sink in under-funded public schools?

But alongside these visits from the ghosts of reforms past, we have some auspicious evidence that there may be a different future ahead.

[readon2 url="http://blogs.edweek.org/teachers/living-in-dialogue/2013/01/hopes_for_the_new_year_begone_.html"]Continue reading...[/readon2]

Power, Ideology, and the Use of Evidence

Consider the three-decade long, unrelenting promotion of classroom computers and online instruction. A recently mobilized corporate and civic-driven coalition chaired by two ex-state governors issued a report that touted online instruction as a way to transform teaching and learning in U.S. schools. (p. 19 of Digital Learning Now Report FINAL lists corporate, foundation, and top policymakers who participated).

Evidence that regular instructional use of these machines will transform teaching and learning is barely visible. Furthermore, evidence of students' academic achievement gains attributed to online instruction, laptops, and other hardware and software in schools is missing-in-action. And the dream that school use of these machines and applications will lead to better jobs (except in programs where technical certificates can lead to work - e.g., Cisco), well, I won't even mention the scarcity of evidence to support that dream.

So what do these two-governors champion in their Digital Learning Commission report?

"Providing a customized, personalized education for students was a dream just a decade ago. Technology can turn that dream into reality today. The Digital Learning Council will develop the roadmap to achieve that ultimate goal."

Sure, this is an advertisement pushing for-profit online outfits such as for-profit K12 and non-profit projects such as the Florida Virtual School and "hybrid" schools. See here and here. These ex-governors want states to alter their policies to accommodate this "Brave New World" where students get individual lessons tailored to what they need to learn.

Question: After decades of blue-ribbon commissions issuing utopian reports promising "revolutionary" and "transformed" schools, where is the evidence that such futures are either possible or worthwhile?

Answer: When it comes to technology policy, evidence doesn't matter.

[readon2 url="http://nepc.colorado.edu/blog/power-ideology-and-use-evidence-national-politics-and-school-reform"]Continue reading...[/readon2]