 |
9th Parallel Data Storage Workshopheld in conjunction with SC14Chairs:
|
KEYNOTE SPEAKER: sage weil, redhat
Ceph: from HPC to cloud...and back again?
abstract: Although Ceph was architected for HPC workloads, the project gained traction and community in the cloud space as a unified solution providing object, block, and file interfaces. The core focus has been on scalability, reliability, strong consistency semantics on commodity hardware. While this has proven a winning combination for scale-out cloud infrastructure and next-gen enterprise platforms, it has ironically been a hard sell in traditional HPC environments where high availability tends to be addressed in hardware and users are reluctant to abandon years of investment in performance work in other solutions.
This talk will look at some of Ceph's architectural features that make it unique in the space, how they have played out in the scale-out cloud space, and some key lessons learned. This will include the rich object data model and RADOS classes (active objects), our experiences making a distributed, peer-to-peer approach to consistency work at scale, some of our challenges in meeting the requirements of enterprise deployments with a distributed architecture, and general lessons learned building open source infrastructure software and communities. (slides)
speaker bio: Sage Weil helped develop Ceph as part of his PhD research in Storage Systems at the University of California, Santa Cruz. Since graduating, he has continued to refine the system with the goal of providing a stable next generation distributed storage and file system for Linux. In 2012 he co-founded Inktank to help productize Ceph for enterprise and cloud environments. He is now working for Red Hat (who acquired Inktank in 2014) where he is still responsible for guiding the development of the open source project and community.