All posts by admin

True Grit

(Note: this blog post appears in a different form at http://pdfrontier.blogspot.com/2014/06/true-grit-is-duckworth-low-down-dirty.html)

The book How Children Succeed, by Paul Tough is an amazing piece of journalism/research summary, and one of those books that captured my thinking for quite a while after I finished it.

Paul Tough spent a couple years researching what he calls “social-emotional” factors that are associated with school success, and he was surprised to find that these factors seem to not only be important, it turns out that they are MORE important than factors like IQ that get a lot more attention in and outside of our school system. Tough makes the claim that our schools operate on what he calls the “cognitive hypothesis”: humans are born with a certain amount of intellectual potential, our environments influence how much of that potential we develop, and the job of the school is to help students use/develop this “cognitive potential” as much as possible. The cognitive hypothesis influences the ways we talk about students (“bright,” “A student,” “Math/science kid,” etc.) and even the structures of school (IQ/ability testing for gifted/talented programs and special education services, etc.) The cognitive hypothesis predicts that high intellectual potential will help students succeed, and schools need to be structured to help those students soar, and support students with “less” intellectual potential succeed as much as they can.

Tough spends the rest of the book carefully describing compelling research and case studies that point to the conclusion that the cognitive hypothesis might be dead wrong. Study after study and story after story pile on top on one another about how “non-cognitive” factors, like perseverance, “grit,” emotional intelligence, and curiosity may be more important in student success than “smarts.” Tough builds a compelling case, I think, that if one of our goals in schools is student success (in college, careers, and/or life), then there is ample evidence to support the claim that we better stop operating under the cognitive hypothesis and start paying attention to these social-emotional factors.

One of the researchers Tough often cites in the book is Angela Duckworth, a researcher from the University of Pennsylvania, and a recent MacArthur “genius” grant recipient. Duckworth got interested in why some people persist and persevere in the face of obstacles and others give up, how important this trait is to our success, and whether this attribute of “grit” can be measured. My favorite research finding: Duckworth studied an incoming class at West Point military academy. People who get admitted to West Point are already an impressive lot: the selection process is more stringent than any Ivy League school, and these are folks who have known much success in life. Duckworth’s team tested everything they could think of about these young people, including all sorts of intelligence and other “talent” measures, along with social-emotional factors like grit. When all the data came back, the only (only!) factor out of the hundreds of variables that actually predicted who would get through the first year of West Point and who wouldn’t was grit.

I asked some folks in my school district to read How Children Succeed and they were as impressed by it as I was, and we got more and more interested in how Duckworth measured grit. A couple middle schools started to measure grit with students, and one even got involved in Duckworth’s research team to help them collect data. Everyone was riding smoothly and happily, when suddenly I saw a blogger like to listen to lash out hard against Duckworth’s grit research. His beef is that Duckworth’s grit claim is darn similar to the same story he’s heard for years about the kids he works with (kids who live in tough family circumstances, well below the poverty line): all they need to do is get “better attitudes,” like grit, and then they can pull themselves up by their own (cowboy) boot straps.

I was shocked: I hadn’t thought of Duckworth’s research like this. I exchanged a few polite comments with some of the people in the anti-Duckworth posse, and one of the them told me to read the book Scarcity. That’s another good one, and it develops a point that Tough only mentions briefly in How Children Succeed: if kids are in conditions of scarcity (high stress, low time, low resources), maybe these conditions get in the way of using any of the social-emotional capabilities, whether or not they are “high grit” or not. Like Tough, these authors carefully use and explain research findings and case studies to prove that conditions of scarcity limit our abilities to think and use our social-emotional resources.

My conclusion right now (but it might change tomorrow) is best represented by what my friend Tom said about the controversy. He works in an elementary school with students who go home to very tough circumstances, and his mind is always on the topic of how to help all the little knee-biters in his school succeed. He said “This reminded me of Herb Kohl’s Not-learning in his essay I won’t learn from you. We need to have two eyes- one that understands the role of the individual and one that works collective to change the contexts of privilege and oppression”. I think that’s a good summary. Duckworth isn’t wrong, and neither are some of the criticisms of her, but neither of them are exclusively right. Just like always in teaching and learning, we have a bunch of different things to keep in mind, and for now, I think grit and scarcity will be close to the the top of my list.

Let it go

One of the most important ideas in David Labaree’s book Someone Has to Fail (http://books.google.com/books/about/SOMEONE_HAS_TO_FAIL.html?id=_vXWKjJAImYC) is his claim that U.S. education has always been locked in a mutually exclusive trap of competing ideas: our country wants education to be an egalitarian force (helping “level the playing field” for all students, being a force for equal opportunity) and a force to separate more capable students from the crowd (helping students with more “merit,” talent, intelligence, or other capability rise to the top). Our country wants schools to do both these tasks well, and at the same time. Labaree points out that a school or education reform effort that champions one of these ideas at the expense of the other will get slapped back. A school that focuses too much on opportunity for all will be criticized for not letting the “best and brightest” go as far and fast as they can. A school that focuses on identifying exceptionally talented, etc. students and supporting their advancement will be criticized for elitism. Maybe this is one of the factors behind what many of us who have been in education for a long time experience as the “pendulum” of school reform: it goes back and forth, from one idea to another and often back to a new version of an older idea. What goes around comes around, because as you favor one “side,” you will experience a push back.
Neither of the “sides” are wrong, but there is inherent tension between the ideas of “opportunity for all” and “identifying and support merit,” and that tension should be recognized and admitted. We need to admit these kinds of conflicts, because if we don’t uncover them, or admit them, we may be surprised later when the pendulum swings back and hits us. There are heaps and mounds of research evidence that tracking based on perceived ability (math ability, reading ability, etc.) may not be a good idea. Why is tracking still the norm? Any effort that tries to disrupt tracking (an egalitarian idea, helping all students) will run into concerns about merit, and why students with perceived “higher” abilities shouldn’t be grouped together so that they can go “farther or faster.” Both sides of this discussion want what they see as “best” for kids, and any policy or practice change favoring one side or the other will get pushed back, so many schools and districts shoot the middle: rhetoric and some practices that de-track, while maintaining many tracked classes without fanfare.
Every educational reform should start with a clearly identified problem statement and end with an offered solution to that problem (I think I’m misquoting Ted Hamann, but I suspect he’ll forgive me). Somewhere in the middle there, maybe it would be useful to acknowledge any of these tensions, these pressures between mutually exclusive but compelling ideas. Education is such a complex endeavor that a move one way means a move away from an attractive and compelling path. A move toward de-tracking classes is a move away from “advanced” or accelerated courses for students who may be “ready” for that environment. Acknowledging that “sacrifice” is not only honest, it’s needed. We need to acknowledge what path we aren’t taking and why, to talk about the path we’re not taking, even talking about what might be good about that path and why we’re giving up those good things in favor of something else.
We may have to start giving some things up, letting them go, in education, in order to make more reasoned and lasting choices, in order to avoid getting smacked in the head by the pendulum. If we really believe in constructivism, what should we acknowledge about the strengths of input-output or transmission models? If we really believe in the importance of critical thinking, what should we acknowledge about the importance of recall of a “core” set of knowledge? What are we willing to let go? Why are we letting it go? What are we moving toward, and what is that path more important?

High Stakes Corrupt

These two articles got me thinking about the relationship between grades and cheating:

“To Stop Cheating, Nuclear Officers Ditch The Grades” – http://www.npr.org/2014/07/28/334501037/to-stop-cheating-nuclear-officers-ditch-the-grades
– “Wrong Answer: In an era of high-stakes testing, a struggling school made a shocking choice.http://www.newyorker.com/magazine/2014/07/21/wrong-answer
Both articles are dramatic, and about more important issues than “just” grades, but that’s the connection that got me thinking: in an essay about assessment and accountability, Lee Schulman (in one of my favorite articles – http://www.changemag.org/Archives/Back%20Issues/January-February%202007/full-counting-recounting.html) wrote that “High stakes corrupt.” The NPR article about nuclear missile training is an obvious example of this, and their “grading reform” – getting rid of letter grades and their connection to competition and damaging perfectionism in favor of cooperation and pass/fail marks – makes a lot of sense, and apparently works, which is a bonus in the context of folks who can fire a nuclear missile.
The New Yorker article is a heart-breaking, in-depth, moving story about one teacher’s encounter with a test that felt very high stakes to students and teachers in their school. I’m sure that administrators and others in that district (and their state department of education) wouldn’t call it a high stakes test: it’s a statewide achievement test without impact for individual students. But the article made it clear that the culture of the school, and possibly the district, created the context that this test was definitely high stakes for teachers and schools. I bet there’s a document floating around that district somewhere that says something like “this test is only one measure of achievement, and data from this test should be triangulated with other sources of achievement data before daring any conclusions…” blah blah blah. But what ends up happening is familiar to anyone teaching somewhere with a statewide test (which is, now, every public school, I suspect): the statewide test gradually dominates any conversation about student achievement, and doing “badly” on the statewide test feels like a big deal to everyone, even if official rhetoric claims otherwise.
The articles also differ in many ways, including one very important one: the conclusions. In the NPR story, someone decides to dramatically change their old perfection/competition/ego based A-F grading system in favor of an evaluation system that communicates proficiency and acknowledges that people should probably work, you know, together to prevent nuclear accidents from happening. In the New Yorker article, the passionate teacher gets prosecuted, not the overall system that promotes the test craziness, and that school/district/students lose the chance to work with someone who sounds like a fascinating, dedicated teacher.
As I think about this, I can feel myself shrinking away from the implications. Traditional A-F grading isn’t going away any time soon in middle and high schools, and many good folks (like O’Connor, Guskey, and many others) put a lot of effort into “fixing” grading practices. I like reading their thinking and they are definitely trying to help teachers and students. But the contrast between these articles makes me wonder if all the fixes are ultimately very temporary patches on a tire that isn’t getting anyone where they really want to go.

Putting large-scale assessment in it’s place

Some writers I respect (like Diane Ravitch, Joe Bower, and many others) want large-scale assessment out of schools, period. None of it. Get it the heck out of this school. Thanks, so long, see you later, and let’s get down to the business of teaching and learning. I sympathize with that sentiment, but I don’t share it completely.

(terminology note: I’m using the term “large-scale assessment” to refer to a standardized assessment administered to many students. Usually, these are state-developed or publisher developed tests, like the SAT, ITBS, etc. Many folks call these “standardized tests,” but that term is a bit misleading, I think, because any test a teacher gives in the same way across classes is “standardized.” So I’ll call them large-scale)

I sympathize because of the damage large scale assessment has done and continues to do in schools. The demands of No Child Left Behind and Race to the Top pressure schools and districts to use large-scale tests, which in turn pressure districts and schools to focus more on what the large-scale tests measure, which pressures teachers and others to spend more time on what the tests measure, which reduces the amount of time students get to spend learning what the tests don’t measure, which reduces students’ ideas about what “important” learning is and how they relate to (and like) school, and in the end what the large-scale tests measure define “learning.” The measurement ends up defining learning rather than describing it. (Others have described this process much more thoroughly than I have, such as Diane Ravitch’s excellent book, The Death and Life of the Great American School System)
But I don’t completely share “throw the bums out!” sentiment toward large-scale assessment because I think districts and schools can USE them rather than getting used by them. Large-scale assessments can be good for very specific purposes, and, like Liam Neeson, they have a very “specific set of skills.” If a district/school wants to compare assessment data (achievement, ability, whatever) to a national sample, then you’ve got to use a large-scale assessment. All the statistical trappings that go along with a large scale assessment (like percentile ranks, stanines, etc.) result from the way they’re built and maintained. Districts can use these data for useful purposes (they often used to, in pre-NCLB days), and I think they can again.
But having acknowledged all these potential uses, uses of large-scale assessment data are all kinds of out of whack right now. Let’s not even talk about the most egregious uses (like the really wacko teacher evaluation practices that rely on large-scale assessment results, and “merit pay” value-added schemes encouraged by the race to the top program). All large-scale assessments claim to be “reliable and valid,” but validity is a score use issue not an inevitable “trait” of a test that gets bestowed and never challenged. Large-scale tests are built for specific purposes, and using data from large-scale assessments in ways that they were never designed for (like teacher evaluation) is a serious threat to validity.
Maybe a ruthless “cost-benefit” analysis would be useful. How much value would a district/school have to get from a large-scale assessment in order for the assessment to justify it’s existence? How much “gain” would have to result to justify the expense, hassle, stress, and unintended consequences of a large-scale assessment? I think most (all?) state accountability tests would fail this (non-large-scale, non-standardized) test.

Not for Points blog

I decided to start this blog because I’d like to share some conversations about assessment. Many of these conversations 5c94f320def98767192bd7190985996corbit around the idea that assessment, lately, gets used as a weapon against teachers and students.

It doesn’t have to be that way. Classroom assessments, designed and controlled by teachers, can be a powerful part of learning, instead of getting in the way or learning (or, worse, intimidating people out of learning, or turning school into a “point game.”) Assessments can be empowering, inspiring, exciting, and useful. Right now large-scale assessments (like state accountability tests) get more attention than they deserve. I hope we can put them in their rightful place, and reclaim assessment as tools teachers and students use together for learning.