Cloud Costs Optimization
Rootconf For members

Cloud Costs Optimization

Practical case studies, experience reports and tooling use cases from startups and enterprises

Tickets

Loading…

The evolution of the cloud in the last decade has radically simplified infrastructure deployment. Undoubtedly, major providers like AWS, Azure, GCP, Alibaba Cloud have removed entry barriers for developers to either launch a new product or to scale infinitely. However, no software company can keep scaling without taking a look at the cost of infrastructure as a percentage of its revenue.

Many companies today are struggling with cloud costs eating up a significant portion of their gross margins. In this conference, we will discuss the tools, techniques and best practices for monitoring and controlling cloud costs.

Key takeaways for participants

  1. Best practices for monitoring and auditing cloud costs.
  2. Techniques and design choices for controlling cloud costs.
  3. Case studies and experience reports.

Who should participate

  1. CTOs and VP engineering of startups in the growth phase, who are expecting their cloud costs to go up in the near future; interested in case studies and tools.
  2. Engineering Manager of a large organization who is interested in controlling the costs for their division; interested in case studies and tools.
  3. Senior engineers who are interested to know about architectural choices and how they affect the cloud costs.

Speaking

If you are interested in speaking at the conference, submit your talk idea here. The editors - Anand C and Raghdip Panesar - will review your talk description and give feedback.
Guidelines for speaking, speaker honorarium policy, and travel grant policy details are published here.

About the editors

This conference is curated by Anand Chitipothu and Raghdip Singh Panesar.
Anand has been building software, managing servers and infrastructure for over two decades. He has curated the Scaling from First Principles series of discussions with Rootconf.
Raghdip is Staff Engineer - Network at Google. Prior to joining Google Raghdip spent nine years at Flipkart as network architect and senior staff engineer.

Become a Rootconf member to join

This is a community-funded conference. It will be held in-person. Attendance is open to Rootconf members only. Support the conference with a membership to join. If you have questions about participation, post a comment here.

Sponsorship

Sponsorship slots are open for:

  1. Cloud providers who want to evangelise their efforts on optimizing the costs of cloud, and showcase customer success stories.
  2. Tool providers.
  3. Companies seeking tech branding for hiring.
    Email sponsorship queries to sales@hasgeek.com

Contact information

Join the Rootconf Telegram group at https://t.me/rootconf or follow @rootconf on Twitter.
For inquiries, contact Rootconf at +91-7676332020.

Hosted by

Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more

Supported by

Sponsor

Businesses are more digital today than ever before. They need to build, deploy and run real-time services in order to stay ahead of the curve. The notion of real-time is not just a nice-to-have anymore. It’s an expectation. It is what sets a merely good user experience apart from a great one. A rea… more

Sponsor

Delivering the expert solutions for MySQL, MongoDB, PostgreSQL, TiDB, and other distributed databases. Carving the real performance with the existing infrastructure and tuning the prodcution systems which leads to right instance sizing and enhanced performance in the production environment. DB solu… more

Partner

FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India. more

Preeti Shrimal

Snowflake: New kid on block in the world of Cloud Cost Optimization

Submitted Jun 30, 2023

Snowflake: New kid on block in the world of Cloud Cost Optimization

Introduction

Unlike the world of AWS/GCP optimization, data clouds like Snowflake are a different beast to tame.

Chaos Genius is a pioneer in the field of Data Cloud Cost optimization starting with Snowflake. Chaos Genius provides solutions to organizations to reduce their spend on Snowflake and maximize query performance.

In this talk, we want to talk about the growing footprint of data warehouses like Snowflake, Databricks, Bigquery in enterprises and share our learnings from working with some of the largest Snowflake customers in the world and how Chaos Genius helped them reduce their Snowflake costs while improving their query performance.

Snowflake: How do costs work?

Here we will talk about how Snowflake has a unique cost structure where it divides your consumption across Compute, Storage and Data Transfer costs. For most parts, Compute costs make up for majority of Snowflake spend. These costs comprise of warehouse consumption, and usage of various serverless services like Snowpipe, Auto-clustering, Search Optimization, Query Acceleration etc. This is mostly followed by Storage costs which can slowly stack up over time specially a large number of tables which go unused.

What does Snowflake optimization comprise?

Here we will talk about our pioneering approach towards data cloud optimization consisting of:
Visibility
Why & How tracking down costs down to user and query level is the most important aspect of reducing your data cloud costs
Optimization
There are 3 legs to optimizing your data cloud costs
Warehouse Right-sizing: Finding your over-provisioned and under-provisioned warehouses using unique metrics like Warehouse Utilization, Disk Spillage, warehouse configs, clustering, etc.
Workload Optimization: Identifying most expensive workloads using unique technology like Query Fingerprinting and tuning them.
Storage Optimization: Identify storage cost structure across active storage, time-travel, fail-safe, cloning etc. and also identifying dormant tables.
Observability
Cost and performance optimization is not a one time exercise and we will talk about the importance of on-going observability using techniques like anomaly detection and alerting

Learnings from Snowflake Summit 2023: Generative AI & data cost implications

Here we will talk about the impact of generative AI on data costs and why it will make data costs one of the most important pillars of keeping your infra costs under control while maximising data ROI.

Speaker: Preeti Shrimal, Co-Founder & CEO, Chaos Genius

Outline Draft: https://docs.google.com/document/d/1ZGolk6c2mVkjUTzL_QZ4o7hVG2TjUxHM2OKR9p4TQec/edit?usp=sharing

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more

Supported by

Sponsor

Businesses are more digital today than ever before. They need to build, deploy and run real-time services in order to stay ahead of the curve. The notion of real-time is not just a nice-to-have anymore. It’s an expectation. It is what sets a merely good user experience apart from a great one. A rea… more

Sponsor

Delivering the expert solutions for MySQL, MongoDB, PostgreSQL, TiDB, and other distributed databases. Carving the real performance with the existing infrastructure and tuning the prodcution systems which leads to right instance sizing and enhanced performance in the production environment. DB solu… more

Partner

FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India. more