Submitted May 23, 2014

Lambda Architecture

Section: Full talk Technical level: Intermediate

Educate and discuss on principles and best practices to build large scale data processing architectures.
Introduction to “Lambda Architecture” proposed by Nathan Marz (Storm guy)

Outline

Lambda architecture proposed by Nathan Marz is growing in popularity in technology community. This presentation would introduce what is Lambda architecture and various aspects of it like Batch Layer, Service Layer and Speed Layer. Various architectural patterns and best practices to implement large scale data processing systems that are fault-tolerant, highly scalable.
Also share the experience of building such architecture in practice.

Speaker bio

Nitin Supekar is Technical Director in Symantec with 15+ years of experience. He holds Bachelors degree in Computer Science and has very keen interest BigData technologies and Machine Learning.For past 2 years, Nitin is exploring and working on large scale data processing systems architecting, designing and implementing solutions using open source technologies like Storm, Kafka, Cassandra etc.

Comments

Up next

Extracting and Employing Domain-Specific Knowledge Graphs (DKGraphs)

Assume that you got an opportunity to work with vast amount of unstructured and semi-structured text data in a specific domain e.g. automobiles, agriculture, medical, internet, etc. Your task is to derive business value out of this textual data by extracting a domain-specific knowledge graph (DKGraph) and employing it for various business use cases. In this problem, there are several key challenges:

May 13, 2014

The Fifth Elephant 2014