Submissions for MLOps November edition

On ML workflows, tools, automation and running ML in production

This project is accepting submissions for MLOps November conference edition.

The first edition of the MLOps conference was held on 23, 24 and 27 July. Details about the conference including videos and blog posts are published at https://hasgeek.com/fifthelephant/mlops-conference/

Contact information: For inquiries, contact The Fifth Elephant on fifthelephant.editorial@hasgeek.com or call 7676332020.

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Praveen Dhinwa

@pdhinwa

ML Infrastructure for Feed Recommendations at ShareChat

Submitted Jul 14, 2021

Overview

In this talk, we will describe ShareChat’s feed recommendation infrastructure in detail. The talk will delve into various ml-infrastructure related aspects, such as model training, serving, design, and development of feature-store, and also feature-computation pipelines. The subject matter will also provide insights and learnings that we have obtained via building these large-scale, low latency and fault-tolerant systems. Additionally, we will describe strategies we have employed for disaster management and automated recovery.

Outline of the talk:

Introduction

Scale of our feed system

General outline of the recommendation pipeline

Model Training at ShareChat

  • Incremental models
  • Real time models
  • Ranker related models

Model serving:

  • Realtime model inferencing , model versioning, hot reloading and tools that we use.

Feature Store:

  • Requirements
  • Initial version of feature store at ShareChat, what we tried, what didn’t work.
  • Current structure

Feature computation pipelines:

  • Batch and real time pipelines with details

Feature logging and model monitoring

Disaster management:

Learning and Conclusion:

Future Directions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more