26 Fri 12:00 PM – 03:00 PM IST
18 Fri 12:00 PM – 02:50 PM IST
Accepting submissions till 31 Jan 2022, 11:00 PM
Hasgeek survey; Rootconf Cloud Costs conference announcement The audience research team at Hasgeek has started a survey to understand the Rootconf community better, and what individuals expect from memberships on <hasg… more
The evolution of the cloud in the last decade has radically simplified software deployment. Undoubtedly, major providers like AWS, Azure, GCP, Alibaba Cloud have removed entry barriers for developers to either launch a new product or to scale infinitely. However, no software company can keep scaling without taking a look at the cost of infrastructure as a percentage of revenue.
Many companies today are struggling with cloud costs eating up a significant portion of their gross margins. In this programme, we will discuss the following:
After the conference you will walk away with:
Who should participate:
If you want to share your case study, share details at https://hasgeek.com/rootconf/optimizing-costs-of-cloud-infrastructure/comments
Today, data platforms workloads constitute a major portion of the cloud spend. With every company increasingly using data driven decisions, this share of cost can wildly go out-of-hand if not governed and optimized effectively.
At Capillary, we have been building data driven products since the last 12 years. Over the years, our data platform has evolved through many big data systems to a domain-centric, multi-tenant data lake powered by Spark running on EMR and Databricks. The data lake is deep embedded inside our Engagement platform, Loyalty platform, Insights and AI/ML products.
This talk will focus on how we do data platform cost governance and manage the cost with growing adoption of more and more data related feature requirements.
Participants will learn
Co-relating data platforms metrics and cloud cost metrics to derive insights
Tuning Data Engineering pipelines to reduce wastage (Query Optimizations)
Fleet design for ETL pipeline with cost considerations (Instance Selection, On-demand/Spot management)
Architectural patterns while designing for interactive workload (Reports / Dashboards)
Cost Governance around Ad Hoc Analytics (Notebooks)
Primary focus of the talk will be on Apache Spark based systems.
Prakhar Verma is the Principal Architect with Capillary Technologies. He has over 12 years of experience in building data-driven products.