Small Stuff for BuzzFeed News; Getty Images (4); Alamy (2)
The Smarter Lunchrooms Movement, a $22 million federally funded program that pushes healthy-eating strategies in almost 30,000 schools, is partly based on studies that contained flawed — or even missing — data.
The main scientist behind the work, Cornell University professor Brian Wansink, has made headlines for his research into the psychology of eating. His experiments have found, for example, that women who put cereal on their kitchen counters weigh more than those who don’t, and that people will pour more wine if they’re holding the glass than if it's sitting on a table. Over the past two decades he’s written two popular books and more than 100 research papers, and enjoyed widespread media coverage (including on BuzzFeed).
Yet over the past year, Wansink and his “Food and Brand Lab” have come under fire from scientists and statisticians who’ve spotted all sorts of red flags — including data inconsistencies, mathematical impossibilities, errors, duplications, exaggerations, eyebrow-raising interpretations, and instances of self-plagiarism — in 50 of his studies.
Journals have so far retracted three of these papers and corrected at least seven. Now, emails obtained by BuzzFeed News through public information requests reveal for the first time that Wansink and his Cornell colleague David Just are also in the process of correcting yet another study, “Attractive names sustain increased vegetable intake in schools,” published in Preventive Medicine in 2012.
The most recent retraction — a rare move typically seen as a black mark on a scientist’s reputation — happened last Thursday, when JAMA Pediatrics pulled a similar study, also from 2012, titled “Can branding improve school lunches?”
Brian Wansink in 2007.
Stan Honda / AFP / Getty Images
Both studies claimed that children are more likely to choose fruits and vegetables when they’re jazzed up, such as when carrots are called “X-Ray Vision Carrots” and when apples have Sesame Street stickers. The underlying theory is that fun, descriptive branding will not only make an eater more aware of the food, but will “also raise one’s taste expectations,” as the scientists explained in one of the papers.
The studies have been cited more than 75 times by others, according to Web of Science, and were funded by a grant of nearly $99,000 from the Robert Wood Johnson Foundation’s Healthy Eating Research program. The foundation told BuzzFeed News it hasn’t awarded him any grants since then.
The two studies have also been touted as evidence for the Smarter Lunchrooms Movement, cofounded by Wansink and Just in 2010. It promotes “simple evidence-based strategies” to encourage students to make healthy choices, participate in federally subsidized lunch programs, and waste less food. The USDA has funded $8.4 million in research grants related to the program to date, according to an agency spokesperson. Since 2014, it’s also awarded nearly $14 million in training grants. Almost 30,000 schools have adopted those techniques, and the government pays each one up to $2,000 for doing so. (The program says it’s also funded by Target and Wansink’s Cornell lab.)
One of the program’s recommendations is that school cafeterias feature a fruit or vegetable of the day and label it with “a creative, descriptive name.” Suggestions include “orange squeezers,” “monkey phones (bananas),” “snappy apples,” “cool-as-a-cucumber slices,” and “sweetie pie sweet potatoes.” Branding food in this way “can increase consumption by over 30%,” according to the program’s website. As proof, the Smarter Lunchrooms Movement cites the JAMA Pediatrics and Preventive Medicine studies, among others.
View Video ›
facebook.com
The USDA told BuzzFeed News that it has been talking to Cornell’s Center for Behavioral Economics in Child Nutrition Programs (the BEN Center), which administers the Smarter Lunchrooms Movement, about some of the allegedly flawed research. The agency “believes that scientific integrity is important, and that program and policy decisions should be based on strong evidence,” wrote USDA spokesperson Amanda Heitkamp.
“We have discussed these concerns with the BEN Center, and they have plans to address them in consultation with the Cornell University Office of Research Integrity and Assurance,” Heitkamp said. But the evidence behind the Smarter Lunchrooms Movement, she noted, comes from other work as well. “Smarter Lunchroom strategies are based upon widely researched principles of behavioral economics, as well as a strong body of practice that supports their ongoing use.”
A spokesperson for the Smarter Lunchrooms Movement echoed this sentiment, pointing to studies done by non-Cornell researchers that support the program’s strategies.
Cornell and Wansink did not return requests for comment, and Just declined to speak with BuzzFeed News. In previous public comments, Wansink dismissed some of the errors as minor and inconsequential to the studies’ overall conclusions. He also claimed that his studies have been replicated by other researchers. “One reason some of these findings are cited so much is because other researchers find the same types of results,” he told Retraction Watch in February. In March, he told the Chronicle of Higher Education that field studies should be taken with a grain of salt, as opposed to research done in a controlled setting like a laboratory. “Science is messy in a lot of ways,” he said.
But his critics take these problems very seriously, pointing out how rapidly his research has been adopted into the real world.
“It’s not sufficient evidence to roll out interventions in thousands of schools, in my opinion,” said Eric Robinson, a behavioral scientist at the University of Liverpool, who has found that several of Wansink’s studies cited by the Smarter Lunchrooms Movement made the strategies sound more effective than the data showed.
Others are disappointed that Wansink has, by and large, failed to adequately address most of the alleged mistakes — particularly when the entire field of psychological research is being dissected for studies that fail to hold up in repeat experiments.
Tim van der Zee, a graduate student at Leiden University in the Netherlands and one of the first researchers to spot errors in Wansink’s work, said that aside from correcting and sharing data for a handful of the challenged papers, the professor, his coauthors, and Cornell “remain inexplicably hidden in silence.”
“One of the fundamental principles of the scientific method is transparency — to conduct research in a way that can be assessed, verified, and reproduced,” he told BuzzFeed News. “This is not optional — it is imperative.”
youtube.com
Wansink began drawing scrutiny last November when, in a now-deleted blog post, he praised a grad student for taking the data from a “failed study” of an all-you-can-eat Italian lunch buffet and reanalyzing it multiple times until she came up with interesting results. These findings — that, for example, men overeat when women are around — eventually resulted in a series of published studies about pizza consumption.
To outside scientists, it reeked of statistical manipulation — that the data had been sliced and diced so much that the results were just false positives. It’s a problem that has cropped up again and again in social science research, and that a growing number of scientists are trying to address by replicating studies and calling out errors on social media.
Over the winter, van der Zee saw that Wansink’s blog post was accruing dozens of disapproving comments. He teamed up with two other scientists who were similarly intrigued: Nicholas Brown, also a graduate student in the Netherlands, and Jordan Anaya, a computational biologist in Virginia. At first they exchanged emails with Wansink about apparent errors in four of the pizza papers, van der Zee said. But when he stopped replying to them, they decided to go public with the 150 errors they’d found in the four papers. Then Andrew Gelman, a statistician at Columbia University, accused Wansink’s lab of manipulating the data — or using “junk science,” in his words — to dress up their conclusions.
These critiques soon captured journalists’ attention. In early February, Retraction Watch interviewed Wansink about his disputed work, and New York magazine declared that “A Popular Diet-Science Lab Has Been Publishing Really Shoddy Research.”
The next day, Wansink wrote an email to more than 40 friends and collaborators with the subject line “Moving forward after Pizza Gate.” He called the barrage of criticism “cyber-bullying,” and seemed to dismiss the errors, explaining that most stemmed from “missing data, rounding errors, and [some numbers] being off by 1 or 2.”
He told the other scientists that the mistakes didn’t change the conclusions of the four papers, and sought to reassure them that they were on the right side of history.
“For a group of people who are so innovative, so hard-working, and who try so tirelessly to make the world healthier, this could be disheartening,” he wrote. “Fortunately, we have too many other great ideas and solutions that keep our eyes fixed on the horizon in front of us.”
The horizon, as it turned out, was darker than he anticipated, as shown in dozens of emails between Wansink and collaborators who work at public universities, obtained via records requests by BuzzFeed News.
After helping to dissect the pizza papers, Brown turned his sights on the now-retracted “Can branding improve school lunches?”
The study claimed that elementary school students were more likely to choose an apple instead of a cookie if the apple had an Elmo sticker on it. The takeaway: Popular brands and cartoons could successfully promote healthy fare over junk food.
View Video ›
facebook.com
In a blog post, Brown expressed concern about how the data had been crunched, and confusion about how exactly the experiment had worked. He noted that a bar graph looked much different in an earlier version. And, he pointed out, the scientists had said their findings could help “preliterate” children — which seemed odd, since the children in the study were ages 8 to 11.
In yet more scathing blog posts, Anaya and data scientist James Heathers pointed out mistakes and inconsistencies in the Preventive Medicine study, “Attractive names sustain increased vegetable intake in schools,” which claimed that elementary school students ate more carrots when the vegetables were dubbed “X-ray Vision Carrots.”
Both papers were written by Wansink and Just, as well as Collin Payne, an associate professor of marketing at New Mexico State University. (Payne declined to comment.)
Wansink wrote to his coauthors and a few others who had helped with the papers on Feb. 21: “Back here in Ithaca we’re busy with a bunch of crazy stuff.”
“One of the things we’re facing is people challenging some of our old papers,” Wansink wrote. “What our critics want to do is to show there [sic] are bogus so they can challenge all of the Smarter Lunchrooms policies.”
But there was a problem: He couldn’t find the data for either study. “We can’t seem to find them,” he wrote. “Any chance you have them in any files.”
The following week, Brown blogged about several papers in which Wansink appeared to have plagiarized from his previous work, and New York magazine wrote about it. Wansink wrote an apologetic email to several deans at Cornell, trying to explain the “newest saga.” He admitted that there were duplications, but believed them all to be justified, saying at one point that certain paragraphs were “important enough to be repeated.”
“For someone who’s been a noncontroversial person for 56 years, this has been an upsetting month, and I’m ashamed of the difficulties it has given you, and our great Dyson School, College, and University,” Wansink wrote.
“All the numbers seem to be within one baby carrot of each other.”
Quelle: <a href="Emails Show How An Ivy League Prof Tried To Do Damage Control For His Bogus Food Science“>BuzzFeed
