Cracking Down On p-Hacking

Trying to make correlations appear among data where there is none should be considered intellectual dishonesty but as is the case, this has been happening as mainstream practice in the highest levels of academia. Only recently are statisticians cracking down on these misconducts.

Playing with data to meet the significance thresholds required for publication — known as p-hacking — is an actual thing in academia. In fact, for decades, it’s been mainstream practice, partly due to researchers’ lack of understanding of common statistical methods.
But in recent years, many academics have gone through a methodological awakening, taking a second look at their own work, in part due to heightened concern and attention over p-hacking.
Perhaps the most high-profile recent case of mining and massaging of data was that of food scientist Brian Wansink, who eventually resigned from Cornell University after being found to have committed scientific misconduct.

(Image credit: PhotoMIX-Company/Pixabay)


Newest 3
Newest 3 Comments

I've never liked that quote, as it seems to add to the black magic nature people attribute to statistics. To me it is the same as saying there are lies, damned lies and big words. If you misuse a big word or statistics, it is either a regular lie or mistake. Otherwise at some point the onus is on reader to understand, look up, or realize they don't understand.
Abusive comment hidden. (Show it anyway.)
Statistics is a very rigorous branch of mathematics. But at lower levels it is taught as if it were a bunch or oracles in black boxes that spit out answers. Learning where those tools come from can make their limits and uses much clearer. But without that knowledge, a fully well intentioned and honest researcher could get garbage out of a tool and not realize is the tool was inappropriate.

It is like giving someone a recipe vs. teaching them cooking techniques and ingredients. Things work fine if you have exactly what you need, but go awry if you need substitutes. Sometimes novices don't even realize they made a substitute. And there are the few special ones that will not realize they should sometimes peel a shrimp or remove the seeds from hot pepper, and then say the recipe is broken because that was not spelled out.
Abusive comment hidden. (Show it anyway.)
Login to comment.




Email This Post to a Friend
"Cracking Down On p-Hacking"

Separate multiple emails with a comma. Limit 5.

 

Success! Your email has been sent!

close window
X

This website uses cookies.

This website uses cookies to improve user experience. By using this website you consent to all cookies in accordance with our Privacy Policy.

I agree
 
Learn More