Hadoop vendor and Yahoo-spinoff Hortonworks published a blog post on Tuesday laying out the case for building a Hadoop object store called Ozone. The addition of such an option to the Hadoop ecosystem would make the platform more compelling as a webscale or even cloud data store.
This is especially important, post authors Jitendra Pandey and Sanjay Radia argue, because the YARN resource-management framework is opening up Hadoop to more consideration as a platform capable of hosting all sorts of big data applications beyond just MapReduce, Spark or other traditional data-processing jobs. As evidence that multi-tenant Hadoop environments are coming, they point to an ongoing effort by [company]Hortonworks[/company] (and Altiscale, I’ll add) to integrate YARN with both Docker and Google’s Kubernetes tool for managing Docker environments.
The authors give the following list of goals for Ozone:
Scale to trillions of data objects.
View original post 163 mots de plus