Applying Lambda Architecture in Machine Learning realm

Jul 2018

23 Mon

24 Tue

25 Wed

26 Thu 07:45 AM – 06:15 PM IST

27 Fri 07:45 AM – 05:35 PM IST

28 Sat

29 Sun

Make a submission

NIMHANS Convention Centre, Bengaluru

##About the conference and topics for submitting talks:
The Fifth Elephant is rated as India’s best data conference. It is a conference for practitioners, by practitioners. In 2018, The Fifth Elephant will complete its seventh edition.

The Fifth Elephant is an evolving community of stakeholders invested in data in India. Our goal is to strengthen and grow this community by presenting talks, panels and Off The Record (OTR) sessions that present real insights about:

Data engineering and architecture: tools, frameworks, infrastructure, architecture, case studies and scaling.
Data science and machine learning: fundamentals, algorithms, streaming, tools, domain specific and data specific examples, case studies.
The journey and challenges in building data driven products: design, data insights, visualisation, culture, security, governance and case studies.
Talks around an emerging domain: such as IoT, finance, e-commerce, payments or data in government.
**

##Target audience:
You should attend and speak at The Fifth Elephant if your work involves:

Engineering and architecting data pipelines.
Building ML models, pipelines and architectures.
ML engineering.
Analyzing data to build features for existing products.
Using data to predict outcomes.
Using data to create / model visualizations.
Building products with data – either as product managers or as decision scientists.
Researching concepts and deciding on algorithms for analyzing datasets.
Mining data with greater speed and efficiency.
Developer evangelists from organizations which want developers to use their APIs and technologies for machine learning, full stack engineering, and data science.

##Perks for submitting proposals:
Submitting a proposal, especially with our process, is hard work. We appreciate your effort.
We offer one conference ticket at discounted price to each proposer, and a t-shirt.
We only accept one speaker per talk. This is non-negotiable. Workshops may have more than one instructor.
In case of proposals where more than one person has been mentioned as collaborator, we offer the discounted ticket and t-shirt only to the person with who the editorial team corresponded directly during the evaluation process.

##Format:
The Fifth Elephant is a two-day conference with two tracks on each day. Track details will be announced with a draft schedule in February 2018.

We are accepting sessions with the following formats:

Full talks of 40 minutes.
Crisp talks of 20 minutes.
Off the Record (OTR) sessions on focussed topics / questions. An OTR is 60-90 minutes long and typically has up to four facilitators and one moderator.
Workshops and tutorials of 3-6 hours duration on Machine Learning concepts and tools, full stack data engineering, and data science concepts and tools.
Pre-events. Birds Of Feather (BOF) sessions, talks, and workshops for open houses and pre-events in Bangalore and other cities between October 2017 and June 2018.** Reach out to info@hasgeek.com should you be interested in speaking and/or hosting a community event between now and the conference in July 2018.

##Selection criteria:
The first filter for a proposal is whether the technology or solution you are referring to is open source or not. The following criteria apply for closed source talks:

If the technology or solution is proprietary, and you want to speak about your proprietary solution to make a pitch to the audience, you should pick up a sponsored session. This involves paying for the speaking slot. Write to fifthelephant.editorial@hasgeek.com
If the technology or solution is in the process of being open sourced, we will consider the talk only if the solution is open sourced at least three months before the conference.
If your solution is closed source, you should consider proposing a talk explaining why you built it in the first place; what options did you consider (business-wise and technology-wise) before making the decision to develop the solution; or, what is your specific use case that left you without existing options and necessitated creating the in-house solution.

The criteria for selecting proposals, in the order of importance, are:

Key insight or takeaway: what can you share with participants that will help them in their work and in thinking about the ML, big data and data science problem space?
Structure of the talk and flow of content: a detailed outline – either as mindmap or draft slides or textual description – will help us understand the focus of the talk, and the clarity of your thought process.
Ability to communicate succinctly, and how you engage with the audience. You must submit link to a two-minute preview video explaining what your talk is about, and what is the key takeaway for the audience.

No one submits the perfect proposal in the first instance. We therefore encourage you to:

Submit your proposal early so that we have more time to iterate if the proposal has potential.
Talk to us on our community Slack channel: https://friends.hasgeek.com if you want to discuss an idea for your proposal, and need help / advice on how to structure it. Head over to the link to request an invite and join #fifthel.

Our editorial team helps potential speakers in honing their speaking skills, fine tuning and rehearsing content at least twice - before the main conference - and sharpening the focus of talks.

##How to submit a proposal (and increase your chances of getting selected):
The following guidelines will help you in submitting a proposal:

Focus on why, not how. Explain to participants why you made a business or engineering decision, or why you chose a particular approach to solving your problem.
The journey is more important than the solution you may want to explain. We are interested in the journey, not the outcome alone. Share as much detail as possible about how you solved the problem. Glossing over details does not help participants grasp real insights.
Focus on what participants from other domains can learn/abstract from your journey / solution. Refer to these talks from The Fifth Elephant 2017, which participants liked most: http://hsgk.in/2uvYKI9 and http://hsgk.in/2ufhbWb
We do not accept how-to talks unless they demonstrate latest technology. If you are demonstrating new tech, show enough to motivate participants to explore the technology later. Refer to talks such as this: http://hsgk.in/2vDpag4 and http://hsgk.in/2varOqt to structure your proposal.
Similarly, we don’t accept talks on topics that have already been covered in the previous editions. If you are unsure about whether your proposal falls in this category, drop an email to: fifthelephant.editorial@hasgeek.com
Content that can be read off the internet does not interest us. Our participants are keen to listen to use cases and experience stories that will help them in their practice.

To summarize, we do not accept talks that gloss over details or try to deliver high-level knowledge without covering depth. Talks have to be backed with real insights and experiences for the content to be useful to participants.

##Passes and honorarium for speakers:
We pay an honorarium of Rs. 3,000 to each speaker and workshop instructor at the end of their talk/workshop. Confirmed speakers and instructors also get a pass to the conference and networking dinner. We do not provide free passes for speakers’ colleagues and spouses.

##Travel grants for outstation speakers:
Travel grants are available for international and domestic speakers. We evaluate each case on its merits, giving preference to women, people of non-binary gender, and Africans. If you require a grant, request it when you submit your proposal in the field where you add your location. The Fifth Elephant is funded through ticket purchases and sponsorships; travel grant budgets vary.

##Last date for submitting proposals is: 31 March 2018.
You must submit the following details along with your proposal, or within 10 days of submission:

Draft slides, mind map or a textual description detailing the structure and content of your talk.
Link to a self-recorded, two-minute preview video, where you explain what your talk is about, and the key takeaways for participants. This preview video helps conference editors understand the lucidity of your thoughts and how invested you are in presenting insights beyond the solution you have built, or your use case. Please note that the preview video should be submitted irrespective of whether you have spoken at past editions of The Fifth Elephant.
If you submit a workshop proposal, you must specify the target audience for your workshop; duration; number of participants you can accommodate; pre-requisites for the workshop; link to GitHub repositories and a document showing the full workshop plan.

##Contact details:
For more information about the conference, sponsorships, or any other information contact support@hasgeek.com or call 7676332020.

Hosted by

The Fifth Elephant

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

All submissions

Previous Next

Applying Lambda Architecture in Machine Learning realm

Submitted Mar 31, 2018

Section: Full talk Technical level: Intermediate

In mature information retrieval systems, predictions and scoring happen in multiple layers in cascaded fashion. In batch processing layer, update intervals are big and disperse. In the ingestion layer, it is done as and when the updates arrive,close to near real time. This layer is non user-path but still carries a reasonably wide feature set. Lastly, final scoring is done in user path using a much smaller yet important feature set. These layers can be seen as part of a spectrum covering a range of tradeoffs in computing predictions. To build non-overlapping layers, we need to introduce feature classification as,

Product Features - slow changing
User Features - available only in request path (Geo, various user affinities e.g. brand etc)
Fast Changing business metric governing features - e.g. price, offers and availability. Needed for freshness and for an optimal ordering of products to users

On the spectrum from pure batch(left) to pure real-time(right), the cost of sourcing features and score computation involved varies immensely. The batch size reduces drastically from left to right. Feature fluctuations increase from left to right. Sensitivity to latency increases from left to right. The batch get normalized on aggregate data and is not as pure as real-time. While implementing these layers, we observed that all parts of this spectrum are equally important to counterbalance anomalies introduced by individual layers.

Putting succinctly, in this talk we’ll cover few use cases where we did a series of experiments at different layers with varying feature sets. We’ll go into how these patterns are applied at scale in Flipkart search and recommendation systems for scoring candidate result set, given the query or product context respectively.

Outline

In this talk, we’ll cover :
a) Overview of different feature types for information retrieval and ranking systems, and how important is the freshness aspect
b) Different processing layers : Batch, Indexing and Real-Time, characterized by the reaction time to feature updates
c) Tradeoffs of doing scoring computation in a cascaded fashion in the real world
d) Case Studies : Taking examples from Flipkart search and recommendation systems, we’ll cover how these different layers are employed for production use cases of retrieval and ranking

Speaker bio

Akash is a software developer with Search Relevance team at Flipkart, working on improving Autosuggest. Previously, he has worked on building Flipkart Recommendation System. He designed real time and batch pipelines to power recommendations, including use cases such as product bundling, similar products and personalisation. He is interested in applying Machine Learning for pattern mining, and deploying data processing pipelines at scale. He graduated with a dual degree in Computer Science & Engineering from IIT Delhi.