Deconstructing Bunk Reporting in Five Easy Steps
By Beth Skwarecki
Bitch Magazine
British scientists have uncovered the truth behind one of modern culture’s greatest mysteries: why little girls play with pink toys. Is it because toy companies flood whole store aisles with the color? Or because well-meaning relatives shower girl babies with pink blankets and clothing? Nope. According to the men in lab coats, it’s purely biological.
Apparently, women are hardwired to like pink because our cavewoman foremothers spent their days gathering red leaves and berries amongst the trees while their husbands were out hunting. Later, women needed to notice red-faced babies and blushing boyfriends. And why do men like blue? Because it’s the color of the sky.
This evolutionary just-so story takes up three pages of a 2007 issue of Current Biology. To back up the assertion that pink is a universal girly preference worth examining, the authors refer to a 1985 study finding that little girls use more pink and red crayons in their drawings than little boys do.
Dig further, however, and the story completely falls apart. British women do prefer pink, but the author’s claim of a “robust, cross-cultural sex difference” turns out to be neither. The scientists compared British natives with Chinese immigrants to Britain, and glossed over the differences. For example: The girliest color in the British results, a purplish-pink, was in fact the Chinese men’s favorite.
Nowhere do scientific findings get more mangled than when they’re about the differences between men and women. According to the science pages, women aren’t just biologically hardwired to prefer pink to blue. We’re also predisposed to backstab one another in the workplace, cry in the boardroom, and have both lower iqs and less of a sense of humor than men.
Some misleading stories come from bad science, where the study authors’ conclusions aren’t supported by their own data. Others are well-conducted studies whose conclusions mutate upon contact with the mainstream media. Newspapers and websites are prone to playing fast and loose with their reports on studies, often neglecting to reveal salient facts about a study’s sample group or methodology.
The fact is that science articles aren’t designed to be read by non-scientists. College and grad students in the sciences are trained in how to do it: They review papers and discuss them in journal clubs; learn how to question methodologies (Is that sample really big enough? Was that the right test to use?); and learn how to be critical of authors’ interpretations (Do the results really mean what they say they mean?). Students also know to look at context for each study, looking up previous papers on the subject, reviewing the authors’ previous work, and searching out any evidence of bias that might color a study’s findings.
Journalists looking for a quick story, however, do little such research. And in an age where news sites, wire services, and blogs pick up stories with lightning-fast speed, bad research gets around. When London’s Sunday Times reported on a 2007 study claiming that men get dumber in the presence of blond women, the paper got the name of the journal wrong, citing the Journal of Experimental Psychology rather than the Journal of Experimental Social Psychology. Nearly every subsequent news article repeated the error because they were content to simply reword the Times’ version of the story rather than finding and discussing the study itself.