The Fifth Elephant 2017
On data engineering and application of ML in diverse domains
Jul 2017
24 Mon
25 Tue
26 Wed
27 Thu 08:15 AM – 10:00 PM IST
28 Fri 08:15 AM – 06:25 PM IST
29 Sat
30 Sun
On data engineering and application of ML in diverse domains
Jul 2017
24 Mon
25 Tue
26 Wed
27 Thu 08:15 AM – 10:00 PM IST
28 Fri 08:15 AM – 06:25 PM IST
29 Sat
30 Sun
Ananth Packkildurai
Slack is a collaboration tool for teams. We’re on a mission to make your working life simpler, more pleasant, and more productive. Search is the core feature of Slack offerings as Slack itself is an acronym for “Searchable Log of all conversation & knowledge”.
At Slack, we experiment frequently with various machine learning models to improve search experience so rebuilding search indexes are critical for search infrastructure.
This talk will centre around lambda architecture, common pitfalls of lambda architecture and best practices, an overview of Slack search infrastructure and our experience in building Solr offline indexing at scale.
This talk will be around,
Some basic understanding of mapreduce and stream processing.
Ananth Packkildurai is currently working as a Senior Data Engineer at Slack Technologies, San Francisco and has over thirteen years of experience in building systems at scale. Prior to Slack, Ananth worked as a senior data engineer at Bazaarvoice Inc to build large scale consumer reviews analytical platform. He works closely with Hadoop, Apache Crunch, Kafka, Apache Solr, Apache Spark, Druid and other big data platform tools.
Linkedin: https://www.linkedin.com/in/ananthdurai
https://speakerdeck.com/vananth22/search-infrastructure-using-lambda-architecture
Jul 2017
24 Mon
25 Tue
26 Wed
27 Thu 08:15 AM – 10:00 PM IST
28 Fri 08:15 AM – 06:25 PM IST
29 Sat
30 Sun
Hosted by
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}