Loading…
OpenStack Liberty Design Summit has ended
Back To Schedule
Monday, May 18 • 4:40pm - 5:20pm
From Archive to Insight: Debunking Myths of Analytics on Object Stores

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Many people believe running analytics on a Swift object store has to be a painful experience.  Either the analysis can be run directly on the Swift cluster using specialized architectures, which never match native performance, or the data must be migrated out into a separate analytics cluster, delaying time to insight.

This talk presents an architecture for running an analytics tool such as Hadoop natively on a Swift object store without performance loss nor requiring any data movement.  Through use of the SwiftOnFile open-source project, we will go through an evaluation of running Hadoop directly against the underlying objects, allowing users to transform archive data to useful insights more quickly.
Speakers
avatar for Dean Hildebrand

Dean Hildebrand

Research Staff Member - IBM Research, IBM Research - Almaden
Dean Hildebrand is a researcher at the IBM Almaden Research Center and a recognized expert in the field of object storage as well as distributed and parallel file systems. Dr. Hildebrand pioneered pNFS, demonstrating the feasibility of providing standard and scalable access to any... Read More →
avatar for Simon Lorenz

Simon Lorenz

Advisory Software Engineer, IT Architect, IBM
Simon Lorenz is an IT Architect in IBM Research and Development in Mainz, Germany. Hejoined IBM Germany in 1993 and worked on productivity and manufacturing qualityimprovements within IBM Disk Drive Manufacturing Management software. Duringinternational assignments, he helped to improve... Read More →
avatar for Bill Owen

Bill Owen

Senior Software Engineer - IBM, IBM
Bill Owen is Senior Software Engineer with IBM's General Parallel File System team.  He is responsible for the integration of OpenStack with GPFS.  He has worked in various development roles within IBM for the past 15 years.  Prior to joining IBM, Bill developed and deployed grid... Read More →
avatar for Luis Pabon

Luis Pabon

Principal Software Engineer, CoreOS
Luis Pabón is a software engineer at CoreOS. Prior to joining CoreOS in November of 2016, he worked at Red Hat Storage, NetApp Advanced Technology Group, and at EMC on various storage products. He also previously presented at Vault in 2016 and 2015.

Monday May 18, 2015 4:40pm - 5:20pm PDT
Room 109
  Conference, Storage

Attendees (0)