I Like Big Data and I Cannot Lie | HumorOutcasts

I Like Big Data and I Cannot Lie

September 8, 2015
By

I like big data and I cannot lie. You other brothers can’t deny. When a gal walks in and presents a legitimate case by shoving fact based statistics in my face, I get…

Wait. What am I talking about? Every time I turn around, a business or someone is talking about Big Data, and how it’s going to change the world. But then I read another article which tells me it won’t. Who do I believe, and what is Big Data anyway?

It turns out the answer is both simple and complex. The simple answer is that “big data’ is simply a large set of information too large for a single computer to handle. Examples might include the library of Chuck Norris jokes, things we thought caused cancer that are now good for you, but might cause cancer again someday, and Kanye West’s list of things he likes about himself.

People take “big data” and analyze it to come to certain conclusions. This data is characterized by four “V’s”. The first is volume, completely unrelated to the level your college age neighbors play their music on Friday nights. It refers to how much data the world has on various different subjects.

The speed that data is streamed via the internet is called velocity. While network connections get faster every year, they have yet to top my ex-wife, who could recall conversations from nine years before within half a second of the same subject being mentioned during an argument. She is still being studied.

Variety refers to the various subjects we have gathered big data about. As an autodidact (look it up) and a self-proclaimed nerd, I like this a lot, and I’ll talk about it more in a moment. Suffice it to say there are no statistics on the number of autodidacts in the country.

The final “V” referring to Big Data is Veracity. This refers to how much the data can be trusted. Much like the citizens with the Clintons or Fox news, one in three business leaders don’t trust the data they are given, and 27% of the respondents in one survey were uncertain how much of the data they received was inaccurate.

Veracity

Photo credit: University of Wisconsin See the Full Infographic here.

 

So what are we using this amazing capability for? Well, a recent study shared with us the most used Emoji in each state.

Popular emoji

Photo Credit: Mental Floss See the full article here.

We’ve got data on everything from this list of 261,930 past Jeopardy questions, useful if you want to be the next Ken Jennings or try to beat Watson.

Watson
There is a set of user submitted data that tracks the price of marijuana from 2010 to the present. Texas has graciously gathered the last words of “executed offender” since 1984.

You may want to use the million song dataset which includes a metric for danceability to try to predict what songs a user will like and listen to. You can even enter a contest on Kaggle. Or to analyse the relationship of other songs to Jungle Boogie.

jungle boogie

Photo credit: Ethanhein

 

As an author, my favorite set is Wordnet, not just your average dictionary. Oh, I am sure there are other useful data sets out there. I am just as sure they all rate high on the Veracity scale.,

Every now and then I just scan Google or wherever I happen to be, and see what the newest set of big data out there is. You never know when you might need a social graph of the Marvel Universe. Because I like big data.

I cannot lie.

Troy Lambert

Troy Lambert is a bestselling thriller writer and a blogger. His blog posts tend to be much funnier than his books, because his dog helps write them. More writng, and Troy's Books at troylambertwrites.com or follow him on Twitter @tlambertwrites

More Posts - Website - Twitter - Facebook

Share this Post:

9 Responses to I Like Big Data and I Cannot Lie

  1. September 9, 2015 at 2:52 pm

    Wonder if that emoji data reveals anything about the the presidential election possibilities. Or, maybe even the outcome of the next campaign debate. A frightening thought.

    • September 9, 2015 at 2:55 pm

      I may have to write another post about the role of social media in politics. But I am not sure the emoji can be tied in. Although I have some personal ideas about which candidates might fit with the eggplant emoji.

  2. September 8, 2015 at 11:13 pm

    I was always told, “It’s not the size of the data…”

    • September 9, 2015 at 8:54 am

      Indeed. It’s all about how you use it.

  3. Bill Spencer
    September 8, 2015 at 9:53 am

    Very instructive. Thank you. Does big data all start with a big datum? And if so, how can I get a big datum?

    • September 8, 2015 at 9:55 am

      I get some strange e-mails recommending some kind of pills. I don’t know if they work though.

  4. September 8, 2015 at 9:35 am

    You know, it was that Kanye West factoid that made this soooo clear! Don’t worry if managers of small data write in, I have your back. 🙂

    • September 8, 2015 at 9:37 am

      Thanks. I knew that would clear things up.

  5. September 8, 2015 at 9:24 am

    I hope no one managing small data is offended…



User Login

Help Keep HumorOutcasts Going!

New Release
How to Write and Share Humor
By Donna Cavanagh Published by HumorOutcasts Press

Available in Paperback and Kindle


New Release
Maybe Kevin
By Brian Kiley and HumorOutcasts Press

Available in Paperback and Kindle



New Release
Daddy duJour
By Barbara Hammond and Shorehouse Books

Available in Paperback and Kindle



Archives