What is Big Data? The Basics – Meaning and Usage

Posted by on , in Category General with Tags
Arun Kumar is a Microsoft MVP alumnus, obsessed with technology, especially the Internet. He deals with the multimedia content needs of training and corporate houses. Follow him on Twitter @PowercutIN

7 Comments

  1. roraniel

    The company I used to own wrote a GUI for a “BIG DATA” analysis program for the state DOT to conduct traffic studies. The DOT purchased data subscriptions that were automatically imported into our GUI and then the DOT could organize the data into things like travel distance to an intersection, traffic volumes at all hours, speed, demographics of vehicle passengers, as well as dozens of other criteria. It gave the DOT much more useful information than the standard axle counters stretched across the road gave them.

  2. DataH

    Arun, very nice Big Data article. When considering a big data strategy, I think it’s worth mentioning HPCC Systems from LexisNexis. Designed by data scientists, HPCC Systems is an open source data-intensive supercomputing platform to process and solve Big Data analytical problems and can help companies derive actionable insights from their data.

    HPCC Systems provides proven solutions to handle what are now called Big Data problems, and have been doing so for more than a decade. The main advantages over other alternatives are the real-time delivery of data queries and the extremely powerful ECL language programming model. More info at http://hpccsystems.com

  3. Arun Kumar

    I am reading about the different options available for data analysis. The link you gave is a useful resource. Thank you 🙂

  4. Arun Kumar

    Do you mean using a customized option is better instead of going for ready-made products like Hadoop etc?

  5. DataH

    You’re welcome! You might also want to check out their free online ECL training at http://learn.lexisnexis.com/hpcc

  6. Detailed archiving of your info; be it family albums or music files will be an ongoing task but well worthwhile.
    With a few keystrokes you can automatically catalog existing “MPG” video, “MP3” audio, “JPG” pictures and “TXT” email records & notes etc.
    Moments later you will be randomly sampling your data treasures.

    It takes some time for Your personal database to become large enough to make searching interesting. If your memory is short then not so long.

    This app plows through text files at 20,000,000 CPS and beyond on a 8 year old LapTop..

    I have completed over 4 Dozen Telephone and CableSystem billing conversions (ETL) 95% of that data came
    in text files, a small percent was packed integer and real numbers etc. The Export data included toll files, work orders, customer details etc. These data were no problem for this app.

    Many of these IT jobs were for some of the largest companies in the Western Canada and US.
    The so called “Big Data” isn’t that BIG for today’s computers. I have more personal data than all the ETLs combined!!!

    To keep You in touch with the massive amounts of DATA you’ll collect; the app can randomly sample Video or audio segments as easily as family pictures.
    Text data can be displayed “in context” or “matching lines only” along with match counts, line counts and elapsed time.

    Without a Random option; computer resources go unused and your data mining tools will fall short.
    Video playback options such as Fast Forward, Slow Motion and Large font captioning mixed with Video segments are a few of the
    main features. There is no more useful app than this.

    See the thread “nobody shares knowledge better than this” for all the details

  7. Balamurugan

    Nice Explanation

Leave a Reply

Your email address will not be published. Required fields are marked *


1 + 3 =