
Psychology Professor Michael Inzlicht has a confession to make. He’s been peddling shoddy wares – his words. And he’s feeling quite bad about the whole thing. The work wasn’t just intellectually weak. It did real harm. Though his own proposals to popularise his ideas were knocked back, the so-called “marshmallow effect” went viral.
As you’ll probably recall, in the 1960s, psychologist Walter Mischel ran experiments on children who were told they could have one treat (a marshmallow, an Oreo) now, or two if they waited. Years later, Mischel discovered striking correlations. Children who’d resisted the treat fared better: higher academic achievement, lower body mass.
A parable was born: delay the marshmallow, win at life. With self-control such a powerful predictor of future success Inzlicht and co sold that story to those who’d listen. They’d help them master their impulses and improve their lives.
Many years later they reviewed the evidence. And it showed “three surprising things”.
First, people with more consistent {long-term self-control habits} actually engage in less moment-to-moment struggle, not more. Second, exerting effortful control in the moment doesn’t reliably predict long-term success. And third, while people can sometimes {sustain self-control for a period}, these improvements tend to disappear faster than a New Year’s resolution in February.”
I respect Inzlicht’s candour. Yet even with his mea culpa I am not sure the real issue has been addressed. If the original picture was wrong, what exactly made it wrong? What kind of mistake was it — and what does it reveal about the way that knowledge was built?
The mistake
At its simplest, the mistake involved assuming causation from correlation.
But there are deeper problems.
Treating “self-control” as a unitary trait seems reasonable enough to modern sensibilities. But until modern times, such decontextualisation wasn’t really a thing. I think the decontextualisation is in large part an artefact of the scientistic method of modern academic psychology. Doing experiments and trawling existing data, it discovers regularities. These then stand in their reified glory. (For more on this see the next item below on abstractions).
In the case of self-control, there’s no shortage of richer contexts within which might understand the kinds of problems Inzlicht discusses. Aristotle framed self-control not as resistance to temptation but as the alignment of desire with reason. It is a habituated virtue, cultivated over time. It aims at eudaimonia—a flourishing life—not productivity or compliance with something imposed from without. At least in this context, William James’ ideas were similar.
So why weren’t ideas like these considered before Inzlicht and his colleagues raced off in the direction they did?
As he confesses, “We were rewarded for splashy findings, big effects, simple stories, and counterintuitive results. These were the kinds of papers that got published, cited, and funded.” He might have added that that’s what’s rewarded in the marketplace – for books and ‘content’ and short personal and professional development courses.
Science or practical wisdom?
There’s a deeper point. Aristotle distinguished between episteme and phronesis or in our language, between science and practical wisdom. The former is our knowledge of the world as it is. Practical wisdom is our capacity to operate in that world and to improve it for our purposes. Herbert Simon references this distinction when he distinguishes between science and design.
The natural sciences are concerned with how things are. Design, on the other hand, is concerned with how things ought to be, with devising artifacts to attain goals. … Engineering {and} medicine … are concerned not with the necessary but with the contingent – not with how things are but with how they might be – in short, with design.
Now I have a view – contrary to Simon – that all those disciplines by which we try to better understand human society (in which I’d include psychology, sociology, and economics) should be thought of as disciplines of practical wisdom, not as sciences. But I wont pursue that here.
What I will say is that, had Izlicht and his colleagues been proposing a new medicine or bridge building material, they wouldn’t have simply announced the new material together with some observed patterns. They wouldn’t have proposed using the new knowledge in practical settings until they’d identified the steps in the process from action to desired outcome and sought to test the efficacy and risks of the new approach all along that causal pathway.
My main point is not that they should have taken fewer risks with those who took their advice – though Inzlich clearly thinks this. It’s that the way they’re operating isn’t really serious. It’s obviously unfit for purpose. Even if their initial research into whether their treatment worked or not was inadequate, if the process was at all serious, it would have quickly turned up clear evidence that it wasn’t working.
But that wasn’t how the discipline was built. And it continues to this day with practitioners at the commanding heights of the discipline of psychology throwing off ‘evidence-based’ odds and ends which people go out and market for all their worth.
Izlicht’s disowns the old model only to propose a new one – now split between “trait” and “state” self-control – as if this clears the confusion. But, as before, these abstract categories float freely, disconnected from any deeper suggestions of how the psyche works, or of the kind of insights into the phenomenology of the will that William James offered.
“Revisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes” Watts, Duncan, Quan expanded the test and sowed that socioecomonic status was a big part of it.If you are secure and can trust adults will give you things later, you can wait. IF you don’t know if there really will be another marshmallow, you don’t.
It’s clear that psychology has the worst case of what might be called the Feynman Social Science Problem. From my Troppo post on this:
“… in most social science situations, it’s nearly impossible to isolate the relevant variables in an economic study with enough certainty to reach a conclusion. In physics, controlling for variables is often possible. In social science, it almost never is.
“Most people don’t like to say this very loudly.
“The famed physicist Richard Feynman was an exception: he called social science a pseudo-science:
To my delight, I’m currently working on a project where the client is willing to say that a lot of the supposed science underpinning a problem is not actually well-grounded. Here’s the rub, though: they’re willing to say that only because there is better science to say that the bad science is bad.
Good social science is a slog. Its incentive system currently seems pretty broken. Given its methodological challenges, we might not even want to raise expectations by calling it social “science”.
But Inzlicht takes seriously the Popperian insights into the methodological power of science when used correctly. It seems to me we all need to keep doing this. Feynman certainly thought so. I doubt William James’ emphasis on lived experience and the power of belief will get us there.
Science and practical wisdom are not either-or. If you don’t know how the world works you cannot influence it as an agent of change.
So I only half agree with you Nick that economics etc. should be thought of as disciplines of practical wisdom, not as sciences. The science behind social psychology is frequently bad. So their practical application is also lacking. But you cannot just focus on the application without the foundational understanding.
Is that what you think medicine and engineering do – “focus on the application without foundational understanding”?
Because the answer is “yes”. Each will use foundational understanding if it’s useful. And they’ll also pursue that same usefulness without the understanding if they don’t have it. As the Egyptians used aspirin without understanding how it worked. As an engineer will use an alloy for some quality it has even if they don’t understand why it has that quality.
But, because utility is their direct aim, with fundamental understanding being subordinate to it, they will go to great lengths to ensure that, even when they don’t understand why they work, the methods they use really do work and work safely and reliably.
Something our friend Izlicht didn’t bother himself with.