It takes some time for Your personal database to become large enough to make searching interesting. If your memory is short then not so long.

This app plows through text files at 20,000,000 CPS and beyond on a 8 year old LapTop..

I have completed over 4 Dozen Telephone and CableSystem billing conversions (ETL) 95% of that data came
in text files, a small percent was packed integer and real numbers etc. The Export data included toll files, work orders, customer details etc. These data were no problem for this app.

Many of these IT jobs were for some of the largest companies in the Western Canada and US.
The so called “Big Data” isn’t that BIG for today’s computers. I have more personal data than all the ETLs combined!!!

To keep You in touch with the massive amounts of DATA you’ll collect; the app can randomly sample Video or audio segments as easily as family pictures.
Text data can be displayed “in context” or “matching lines only” along with match counts, line counts and elapsed time.

Without a Random option; computer resources go unused and your data mining tools will fall short.
Video playback options such as Fast Forward, Slow Motion and Large font captioning mixed with Video segments are a few of the
main features. There is no more useful app than this.

See the thread “nobody shares knowledge better than this” for all the details

You’re welcome! You might also want to check out their free online ECL training at http://learn.lexisnexis.com/hpcc

Do you mean using a customized option is better instead of going for ready-made products like Hadoop etc?

I am reading about the different options available for data analysis. The link you gave is a useful resource. Thank you :)