The Fifth Elephant For members

The Fifth Elephant 2023 Monsoon

On AI, industrial applications of ML, and MLOps

Make a submission

Accepting submissions till 04 Jul 2023, 12:30 PM

Bangalore International Centre (BIC), Bengaluru

Tickets

Loading…

The Fifth Elephant 2023 Monsoon Edition event recap is now up here . The event was attended by 192 participants, of which one-fourth were women. The Fifth Elephant videos are available to watch here

Event highlights:




Editors

The 2023 Monsoon edition is curated by:

  1. Nischal HP, Vice President of Data Engineering and Data Science at Scoutbee. Nischal curated the MLOps conference which was held online between 23 and 27 July 2021.
  2. Sumod Mohan, Founder and CEO at AutoInfer. Sumod curated Anthill Inside 2019 edition, held in Bangalore on 23 November.

Tracks and themes

  1. AI and Research - covers research, findings, and solutions for challenges on building models in various areas such as fraud detection, forecasting, and analytics. This track delves into the latest methodologies for handling challenges such as large-scale data processing, distributed computing, and optimizing model performance.
  2. Industrial applications of ML - covers implementation of AI in the industry, with more focus on the AI models, the issues in training, gathering data so, and so forth. ML is being used at scale in industries such as automotive, mechanical, manufacturing, agriculture, and such domains. This track focuses on the challenges in this space, as we see innovation coming out of these industries in the pursuit of using ML on a second-to-second basis.
  3. AI and Product - covers strategies for building AI products to scale and mitigating challenges. This track provides insights on incorporating AI tools and forecasting techniques to improve model training, developing a working model architecture, and using data in the business context.

There are three phases in the lifecycle of an application - research, application and aftermath of the application.

  1. Assess capabilities, determining the new frontiers for AI.
  2. Find a use for the application.
  3. Learn how to run it, monitor it and update it with time.

The three tracks at the 2023 Monsoon edition of The Fifth Elephant will cover this lifecycle.

Members-only conference

The Fifth Elephant 2023 Monsoon edition will be held in-person. Attendance is open to The Fifth Elephant members only. Pick a membership to attend the in-person conference. If you have questions about participation, post a comment here.

Who will benefit from participating in The Fifth Elephant community:

  1. Data/MLOps engineers who want to learn about state-of-the-art tools and techniques, especially from domains such as automobile, agri-tech and mechanical industries.
  2. Data scientists who want a deeper understanding of model deployment/governance.
  3. Architects who are building ML workflows that scale.
  4. Tech founders who are building products that require AI or ML.
  5. Product managers, who want to learn about the process of building AI/ML products.
  6. Directors, VPs and senior tech leadership who are building AI/ML teams.

Sponsorship

Sponsorship slots are open for:

  1. Infrastructure (GPU, CPU and cloud providers) and developer productivity tool makers who want to evangelise their offering to developers and decision-makers.
  2. Companies seeking tech branding among AI and ML developers.
  3. Venture Capital (VC) firms and investors who want to scan the landscape of innovations and innovators in AI and who want to source leads for investment in the AI and ML space.

Contact information

Join the @fifthel Telegram group or follow @fifthel on Twitter. For any inquiries, call Hasgeek at +91 7676 33 2020.

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Supported by

India’s Top Advanced Cloud GPU Provider. H100, A100, L4, A40,& A30 Sign up here: https://bit.ly/vc_desk more

Hareesh Kumar Gajulapalli

Online ML model performance benchmarking at Linkedin Scale : Implementation & Applications

Submitted Jun 30, 2023

Abstract

At LinkedIn, we serve 100000s of inferences per second across 100s of ML models concurrently in our online systems. ML models have different system performance characteristics - ranging from lightweight XGBoosts to memory intensive recommendation models, to the newer Generative AI models, which are both compute and memory intensive. We run these models across different hardware profiles - across different CPU and GPU SKUs. Taking these into account, we have built a performance benchmarking system for ML models at LinkedIn based on the MLPerf Inference Benchmark paper. This system plays a crucial role in ensuring optimal performance and resource utilization. The system streamlines the ML model serving process, allowing ML engineers to launch models seamlessly, without the need to delve into complex hardware configurations.

We further explore the practical applications of the performance benchmarking system, which are as follows:

  • Enable ML engineers and data scientists to iterate and experiment faster with models without worrying about hardware, performance characteristics and capacity estimation.
  • Reduce costs through increased resource utilization by tuning system configurations.
  • Build guardrails to identify and prevent regressions during rollout of new models and system software.

Outline

  • Landscape of online ML inference at Linkedin
  • MLperf Inference benchmarks
  • Architecture
  • Applications
  • Challenges faced and solutions
  • Future work and conclusion

Authors / Presenters

  • Karan Goyal
  • Hareesh Kumar Gajulapalli
  • Ameya Karve

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Make a submission

Accepting submissions till 04 Jul 2023, 12:30 PM

Bangalore International Centre (BIC), Bengaluru

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Supported by

India’s Top Advanced Cloud GPU Provider. H100, A100, L4, A40,& A30 Sign up here: https://bit.ly/vc_desk more