The Fifth Elephant 2015

A conference on data, machine learning, and distributed and parallel computing

Securing your Enterprise Hadoop Cluster

Submitted by Manoj Sundaram (@manojsundaram) on Wednesday, 27 May 2015

videocam_off

Technical level

Intermediate

Section

Full Talk

Status

Submitted

Vote on this proposal

Login to vote

Total votes:  +33

Objective

Hadoop was originally developed for crawling the Internet and indexing - where security is not a concern. But we have come a long way since then. Major banks and organizations are adopting Hadoop as their preferred Big Data platform and there is a growing emphasis on securing the Data and the Cluster components/resources. In a complicated, distributed system like Hadoop, there are several attack vectors that need to be mitigated and companies need to comply with standards like PCI, SOX, HIPAA and so on.

This session will help the audience understand the different levels at which security can be enforced to truly protect your data and your Hadoop cluster.

Description

Data Breaches are costly to any organization and the number of incidents keep going up every year. For a nice visual of some of the largest data breahes in histroy, please check the below URL, I was able to find on the internet.
http://www.informationisbeautiful.net/visualizations/worlds-biggest-data-breaches-hacks/ http://www.networkworld.com/article/2861023/security0/worst-security-breaches-of-the-year-2014-sony-tops-the-list.html

Okay, we get it. Secuirty threats are everywhere and can occur anytime, but how do we alleviate them? This is what I will be covering in my talk.

High level overview of topics to be covered:
1. Why Security has become imperative for a Hadoop cluster?
2. The pillars of Security
3. Securing the perimeter (Apache Knox, others)
4. Authentication frameworks (Kerberos/AD/LDAP integration)
5. Authorization (RBAC/Project Sentry/Intel Rhino)
6. Data protection/Encryption (Encryption at Rest, Transit, How to encrypt without a large performance hit?)
7. Auditing and Data Governance
8. Sensitive Data Redaction (a very recent advancement to Hadoop! a much needed one!)
9. What’s in store for the future of Hadoop security?

Speaker bio

Manoj leads the APAC team at Intel for the Big Data Solution Enablement Organization. He works with customers on a daily basis to help them design, plan and deploy Hadoop clusters; securing the platform; troubleshooting and performance tuning.

He is an expert in Hadoop operations, Operating Systems, Networks and Security administration. He is also a Red Hat Certified Architect (RHCA), Red hat Certified Security specialist (RHCSS), Red hat certified Datacenter Specialist (RHCDS) and a Cloudera Certified Administrator in Hadoop (CCAH).

More details @ https://in.linkedin.com/in/manojsundaram

Links

Comments

Login with Twitter or Google to leave a comment