You might know Dan from his book Predictively Irrational, which was a huge pop science success about behavioral economics/general science. I never loved the book because his conclusions were too glib, and the studies statistically thin, but it never occurred to me that he was using falsified data. Background is below, but the latest is that the Journal of Marketing Research has “expressed concern” about one of his studies, basically saying that they tried to duplicate it and failed (in fact, found a small effect in the opposite direction), but used his data instead and duplicated it, but have concerns about that data’s provenance.
My take on this is that just for that one auto study, nobody was statistically knowledgeable enough to do basic exploratory data analysis (or they would have seen that discrepancy), or even sophisticated enough to fake the data better. Basically: people doing statistics who shouldn’t.
Hmmm, looks like I might’ve been the only one interested in this topic.
A new blog post from the excellent Data Colada dropped today; they got access to the data for a 2002 study about procrastination that has over 2,100 citations about procrastination. That original data provided by Ariely is very strange looking, as they document very well, and his co-author has asked that it be retracted. Ariely says it’s too far back for him to remember the details, but he encourages the appropriate review.
I follow a couple of bloggers who regularly detail fraud in paper publications, and the reality is that it’s rampant, and consequences are rarely meaningful. But all of it is very depressing.
Gotta thank you for this. I passed it along to Spouse Weasel who enjoys tearing studies apart. I don’t have the requisite knowledge to evaluate it myself (although even I know that is a crazy huge effect size) but if I keep reading the site, maybe I will!
Interesting to consider the media coverage of this story, and the fact that Ariely is still employed by Duke, in the light of what happened to Jason Arday.
Jokes aside, I have to wonder how this got picked up 24 years after the study was published. It gives the author a lot of plausible deniability in saying he doesn’t remember. He might not.
It’s a kinda fascinating story. In 2006 a PhD student interested in the topic of procrastination asked for the files, and Ariely sent them. He didn’t do anything with them, however…flash forward to 2023, and the same guy is now a full professor and he and another researcher decide to do a big updated version of it. The new study fails, so they go back to the original data to see what was different. It looks so weird that they first ask Ariely about it, and he blows them off, so they send it to Data Colada.
There’s a question in all this about why he would send the guy the data,..hubris? Didn’t really think about it? The kinds of data profiling that are available/standard now were much more manual back then? I dunno.