Rootconf Mini 2024 (on 22nd & 23rd Nov)

Geeking out on systems and security since 2012

Arun

Arun

@arun_s

AWS Cloud Cost Optimization at Xflow

Submitted Oct 1, 2024

Introduction

As cloud adoption surges, optimizing costs is vital, especially for startups. This article shares Xflow’s successful strategies that slashed our AWS bill from ~$25,000 to ~$11,500, saving ~$12,500 monthly after adjusting for additional non-AWS costs, resulting in a savings of ~$150,000 annually!

Architecture Overview

To illustrate our cost-saving measures, we provide a brief overview of our engineering architecture. Our APIs leverage API Gateway and EKS clusters for scalable service delivery. Transactional data is managed using MySQL, while search queries are handled by OpenSearch. We utilize Debezium and Kafka Connect for change data capture, with Kafka for message storage and Flink for processing. For observability, we employ a combination of CloudWatch and New Relic.

Component Wise Savings

  • CloudWatch + NewRelic : ~$3500
  • RDS : ~$2900
  • Kinesis Data Analytics : ~$3700
  • EKS+EC2 : ~$2000
  • Others : -$400
  • Total : ~$12500

We’ll explore each component’s optimization techniques, discuss opportunities like MSK vs. SQS where we could have saved cost, but chose not to and why, and share ongoing cost-saving initiatives.

Key Takeaways

  • Effective strategies for AWS cost optimization
  • Insights for startups on infrastructure cost management
  • Guidelines for continuous cost control

This talk will provide a comprehensive overview of our cost reduction journey at Xflow, alongside practical strategies for maintaining budget efficiency.

Target Audience

  • Engineering Leaders
  • Architects/Cloud Engineers/SREs

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

We care about site reliability, cloud costs, security and data privacy

Supported by

Platinum Sponsor

Nutanix is a global leader in cloud software, offering organizations a single platform for running apps and data across clouds.

Platinum Sponsor

PhonePe was founded in December 2015 and has emerged as India’s largest payments app, enabling digital inclusion for consumers and merchants alike.

Silver Sponsor

The next-gen analytics engine for heavy workloads.

Sponsor

Community sponsor

Peak XV Partners (formerly Sequoia Capital India & SEA) is a leading venture capital firm investing across India, Southeast Asia and beyond.

Venue host - Rootconf workshops

Thoughtworks is a pioneering global technology consultancy, leading the charge in custom software development and technology innovation.

Community Partner

FOSS United is a non-profit foundation that aims at promoting and strengthening the Free and Open Source Software (FOSS) ecosystem in India. more

Community Partner

A community of Rust language contributors and end-users from Bangalore. We have presence on the following telegram channels https://t.me/RustIndia https://t.me/fpncr LinkedIn: https://www.linkedin.com/company/rust-india/ Twitter (not updated frequently): https://twitter.com/rustlangin more