Businesses are generating tremendous volumes of data – both as a result of transactions being automated, as well as increasing pervasiveness of richer context data being captured around the transactions. For example, in the online world, it is not only possible to capture the shopping transaction itself, but also information about the referring I.P. Address, the geography of the user, the browser in use, the OS in use, screen resolution of the customer. In the past, it might have been a tradeoff for businesses to actually collect and store all this data and retain over a long period of time. Costs of computing, storage and limited value in Analytics would have made any long term value to be questioned.
However, storage and computing prices have come down significantly and that enables the capture and storage of large volumes of data, which opens up the possibility of creating unique insights from volumes of data that might have gone un-used in the past.
In-addition, organizations that had started with data warehousing many years ago are now sitting on peta-bytes of data in their data warehouses. Organizations that are at the forefront of clinical research are working on genomics, correlation between conditions, genetics, demographics, clinical trials for new drugs.
As is the case with any data intensive analysis, the need to run high processing power intensive jobs and transactions are increasingly coming to the forefront. With parallel processing and serial processing capabilities that are becoming available to increasingly wider spectrum of businesses through various open source and proprietary projects like HPCC from LexisNexis, Hadoop, schedulers like Torque, PBS, file systems like Lustre etc, it is only a matter of time when super computing power is available to mainstream businesses at reasonable costs.
Healthcare is ripe for the mainstream value that such computing power has the potential to bring. From gene sequencing to clinical research, the ability to churn through tremendous volumes of data quickly to create competitive advantage will drive organizations towards the next generation of corporate super computing.
No comments:
Post a Comment