Rootconf 2014

On devops and cloud infrastructure

Hadoop Cluster Setup and Monitoring Parameters

Submitted by Jabir Ahmed (@jabirahmed) on Wednesday, 29 January 2014

videocam_off

Technical level

Beginner

Section

Workshops

Status

Submitted

Vote on this proposal

Login to vote

Total votes:  +19

Objective

Hadoop Cluster Setup and Monitoring Parameters

  1. How to setup Hadoop Cluster.
  2. Important Monitoring Parameters.
  3. Profiling a cluster.

Description

Will setup a hadoop cluster and understand how it functions from an administrators perspective.

Requirements

linux host / VM
with basic knowledge of installing and managing packages and configuration

Speaker bio

Jabir Ahmed.
Hadoop Big Data Platform Team @ Inmobi
http://in.linkedin.com/in/jabirahmed/

Mohammed Iliyas Shirol
BigData/Cloud Evangelist at InMobi
http://www.linkedin.com/pub/mohammed-iliyas-shirol/43/217/a52

Comments

  • 1
    Vamsee Kanakala (@vamsee) 4 years ago

    Hi Jabir / Iliyas,

    Can you guys explain a bit of the rationale behind this talk? Why would the audience member listen to your talk instead of reading a manual?

  • 1
    Jabir Ahmed (@jabirahmed) Proposer 4 years ago

    @vamsee this is a workshop session , it would be good if people can really try it out instead of just reading

  • 1
    sandeep (@sss) 4 years ago

    @jabir - how is the setup going to work ? One of the big problems has always been how to use automation (like chef) to setup and administer a hadoop cluster.

    Are you going to cover building those scripts, or is it going to be a vanilla manual setup ?

  • 1
    Jabir Ahmed (@jabirahmed) Proposer 4 years ago

    @sandeep we can possibly talk about some automation we have in place using puppet, and how we do it in our org.

  • 1
    sandeep (@sss) 4 years ago

    @jabir - actually it would be great if you could lead from an automation perspective. There's a lot of hadoop tutorials (and even talks at The Fifth Elephant) that talk about setting up a playful hadoop cluster on your laptop ... but none that actually show how a production quality setup is done using automation, etc.

  • 1
    Jabir Ahmed (@jabirahmed) Proposer 4 years ago

    +1 done !

Login with Twitter or Google to leave a comment