Big Data vs. Pig Data
Yesterday I posted a tongue-in-cheek remark about “pig data” on facebook [ https://www.facebook.com/photo.php?fbid=10152278337104002 ]
Pig Data
If big data are muddy, then they need to be cleaned up before there is any potential to profit from them. Big data with only hope to help them “emerge” from the chaos are of little or no more value than the pigs above emerging from the mud.
As John Battelle thinks out loud about “potential information” (which is, I feel, just another way of saying “data yet to be collected”) [ http://battellemedia.com/archives/2014/03/unleashing-potential-information.php ], I hope he devotes some attention to the research methodologies that are fundamental to how “science” works, Very few of the data being collected or shared online are “scientifically” collected, scientific methodology is not very widespread online. In other words: Most of the so-called data are useless.
This will probably change over time, but the main reason why it might change is not down to some process of “natural emergence” from chaos, but rather because someone is willing to pay for reliable and verifiable research methods to be employed.
nmw 17:45:59 on 2014/03/23 Permalink
This article this quote is from is a colorful description of how a healthy appreciation of science and scientific methods are vital to being able to draw upon a useful pool of usable data:
http://paolov.wordpress.com/2014/03/19/what-is-a-curator
Personally, I prefer self-reliance to self-regulation | Services 08:45:40 on 2014/03/28 Permalink
[…] See also http://businesses.entrechat.org/2014/03/big-data-vs-pig-data […]
Pig Data Longitudinal Analysis: Size Doesn't Matter | Home Office 10:21:51 on 2014/04/01 Permalink
[…] More on big pigness: http://businesses.entrechat.org/2014/03/big-data-vs-pig-data/ […]