Rootconf Hyderabad edition

At MadStreetDen, We are building multiple products for the retail industry on top of a single platform of microservices which process data, build machine learning models and scale with traffic. We are also constantly adding new products to our product suite which solve interesting new usecases. As the systems continuously evolved, we realized the set of services which powers the underlying platform should be modular, easily maintainable and multi-functional. While designing these microservices, there were several questions/learnings along the way on the choice of microservices.

What are the essential microservices?
How do they connect and communicate with each other?
How do we manage the growth of the number of services?
Should I write a new microservice for this functionality or add this as a feature to existing microservice?

Being a machine learning company large amounts of data is at the core of our products.
Focusing our microservice design on top of the data design reduced overhead and helped us build our products faster.
In this talk, we will go through the architecture design workflow by which we designed our platform architecture.

Outline

• Introduction
• Datastores overview
• Usecases Definition
  1. Image Classification
  2. Product Recommendations
• Architecture and workflow of each usecase
• Merge the workflows into single architecture
• Core Platform Architecture v0.1
• Design Considerations
  1. Grouping Microservices
  2. Latency & throughput
  3. Geographic availability
  4. Deployment strategy
  5. Logging & Monitoring
  6. Microservice Registry & Interservice Communication
  • Wayne
    1. Design Principles
    2. Architecture
    3. Config change for single service
    4. Config change between microservices
• Core platform architecture v0.2
• Learnings from design
• Questions ?

Requirements

None

Speaker bio

I am Jambunathan, Director of Engineering at MadStreetDen. For the past 2 years, we have been working on scaling our machine learning platform on AWS which supports the multiple products at https://vue.ai.

Links

• https://www.linkedin.com/in/jambunathan-ramanathan-72564a34/
• https://vue.ai

Slides

https://docs.google.com/presentation/d/11YNbq6wd5OVD-YK_ILEJYMvHPyi36b-m428vHD3FrSE/edit#slide=id.p