This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Monday, May 18 • 4:40pm - 5:20pm
From Archive to Insight: Debunking Myths of Analytics on Object Stores

Sign up or log in to save this to your schedule and see who's attending!

Many people believe running analytics on a Swift object store has to be a painful experience.  Either the analysis can be run directly on the Swift cluster using specialized architectures, which never match native performance, or the data must be migrated out into a separate analytics cluster, delaying time to insight.

This talk presents an architecture for running an analytics tool such as Hadoop natively on a Swift object store without performance loss nor requiring any data movement.  Through use of the SwiftOnFile open-source project, we will go through an evaluation of running Hadoop directly against the underlying objects, allowing users to transform archive data to useful insights more quickly.

avatar for Dean Hildebrand

Dean Hildebrand

Research Staff Member - IBM Research
Dean Hildebrand is a researcher at the IBM Almaden Research Center and a recognized expert in the field of object storage as well as distributed and parallel file systems. Dr. Hildebrand pioneered pNFS, demonstrating the feasibility of providing standard and scalable access to any file system. He received a B.Sc. degree in computer science from the University of British Columbia in 1998 and M.S. and PhD. degrees in computer science from... Read More →
avatar for Simon Lorenz

Simon Lorenz

Advisory Software Engineer, IT Architect, IBM
Simon Lorenz is an IT Architect in IBM Research and Development in Mainz, Germany. Hejoined IBM Germany in 1993 and worked on productivity and manufacturing qualityimprovements within IBM Disk Drive Manufacturing Management software. Duringinternational assignments, he helped to improve fully automated chip factories in the US andAsia. Simon has held various positions within IBM Research and Development. Since 2009,he has worked on Storage... Read More →
avatar for Bill Owen

Bill Owen

Senior Software Engineer - IBM, IBM
Bill Owen is Senior Software Engineer with IBM's General Parallel File System team.  He is responsible for the integration of OpenStack with GPFS.  He has worked in various development roles within IBM for the past 15 years.  Prior to joining IBM, Bill developed and deployed grid management software for electric utilities.
avatar for Luis Pabon

Luis Pabon

Principal Software Engineer, Red Hat
Luis Pabon is a Principal Software Engineer member of Red Hat Storage working on OpenStack Storage. Prior to joining Red Hat in February of 2013 he worked at NetApp Advanced Technology Group and at EMC on various storage products.

Monday May 18, 2015 4:40pm - 5:20pm
Room 109

Attendees (29)