VS
Venky Shankar
@efault
GlusterFS "Big Data" Interface
Submitted Jul 17, 2012
Section:
Big Data Infrastructure & Processing
Technical level:
Intermediate
Session type:
Demo
Infrastructure for Big-Data processing (drop-in replacement for Hadoop Distributed File System - HDFS)
Outline
GlusterFS is an open source, distributed file system capable of scaling to several petabytes and handling thousands of clients. GlusterFS clusters together storage building blocks over Infiniband RDMA or TCP/IP interconnect.
GlusterFS can also be used as a replacement for HDFS and to run Map/Reduce jobs on data residing on it. GlusterFS Hadoop plugin allows exisitng Map/Reduce jobs to seamlessly work without any changes. This is done by using Hadoop’s FileSystem interface and communicating to GlusterFS via it’s native protocol (using FUSE).
Requirements
Basic know-how of GlusterFS
Distributed File System
Working knowledge of Hadoop
UNIX
Speaker bio
Venky Shankar works on GlusterFS at Red Hat. He is a Team lead for the Replication team and is also responsible for designing and implementing the Hadoop compatibility plugin in GlusterFS. He has about six years of experience in the industry. His interests include System Programming, Distributed Systems, Big Data.
Links
- www.gluster.org
- http://www.gluster.org/community/documentation/index.php/Hadoop
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}