This is a meetup for users of Elastic Search. We will share experiences and war stories of building infrastructure and productionizing data science using Elastic Search.
Who should attend:
- Data engineers
- Data and ML engineering teams from companies actively using Elastic Search
- Individuals and companies who are considering use of Elastic Search and want to hear from experiences of others
Date: Thursday, 4 July
Time: 6:30 PM - 8:00 PM
Venue: House number 2699, 19th Main, 5th cross, HAL 2nd stage, Indiranagar, Bangalore - 560008
This event is free to attend. RSVP by registering for a ticket below.
About the organizers:
This event is curated and produced by The Fifth Elephant. The Fifth Elephant is a growing community of data engineers, ML engineers, data scientists and stakeholders invested in the data ecosystem.
The Fifth Elephant thanks Elastic for sponsoring this meetup and supporting The Fifth Elephant.
For details, contact HasGeek on firstname.lastname@example.org or +91-7676332020
Elasticsearch as consistent Lookupstore
Elasticsearch is a distributed system which is highly scalable, performant and provides near-real time search capability. But elasticsearch don’t have a concept of transactions and is infamous for losing data or serving stale data. Can Elasticsearch be used as a consistent lookup data store, where we can ensure that any write that has happened is available for all future lookups? Can we ensure that we always gets the latest document for a search request?
- What is lookupstore?
- Consistency & resiliency issues in ES
- How are we trying to make it consistent
- Trade offs of the approach.
- Is the solution enough?
Go through this doc for more on what ES team is doing - https://www.elastic.co/blog/resiliency-elasticsearch
I am SDE 2 in Flipkart and am a part of Logistics Insights team building data streaming pipeline to enable the data driven decisions.