Pivotal, the big data and cloud computing company that spun out of EMC and VMware in 2013, is putting its financial and engineering muscle behind an open source project called Tachyon. Developed at AMPLab, the same University of California, Berkeley, group responsible for the wildly popular Apache Spark data-processing framework, Tachyon is a distributed in-memory file system that lets multiple applications access the same data at the same high speed.
In a blog post published Tuesday, explained its interest in Tachyon as part of the « data lake » strategy the company is pushing, whereby companies would store all their data using Pivotal’s Hadoop technology and access it using a variety of tools layer on top:
In partnership with the AMPLab at UC Berkeley, Pivotal envisions this future architecture will incorporate an in-memory data exchange platform based on Tachyon and in-memory compute layer augmented by Apache Spark.
View original post 290 mots de plus