Rootconf 2019

Rootconf 2019

On infrastructure security, DevOps and distributed systems.

About Rootconf 2019:

The seventh edition of Rootconf is a two-track conference with:

  1. Security talks and tutorials in audi 1 and 2 on 21 June.
  2. Talks on DevOps, distributed systems and SRE in audi 1 and audi 2 on 22 June.

Topics and schedule:

View full schedule here: https://hasgeek.com/rootconf/2019/schedule

Rootconf 2019 includes talks and Birds of Feather (BOF) sessions on:

  1. OSINT and its applications
  2. Key management, encryption and its costs
  3. Running a bug bounty programme in your organization
  4. PolarDB architecture as Cloud Native Architecture, developed by Alibaba Cloud
  5. Vitess
  6. SRE and running distributed teams
  7. Routing security
  8. Log analytics
  9. Enabling SRE via automated feedback loops
  10. TOR for DevOps

Who should attend Rootconf?

  1. DevOps programmers
  2. DevOps leads
  3. Systems engineers
  4. Infrastructure security professionals and experts
  5. DevSecOps teams
  6. Cloud service providers
  7. Companies with heavy cloud usage
  8. Providers of the pieces on which an organization’s IT infrastructure runs – monitoring, log management, alerting, etc
  9. Organizations dealing with large network systems where data must be protected
  10. VPs of engineering
  11. Engineering managers looking to optimize infrastructure and teams

For information about Rootconf and bulk ticket purchases, contact info@hasgeek.com or call 7676332020. Only community sponsorships available.

Rootconf 2019 sponsors:

Platinum Sponsor

CRED

Gold Sponsors

Atlassian Endurance Trusting Social

Silver Sponsors

Digital Ocean GO-JEK Paytm

Bronze Sponsors

MySQL sumo logic upcloud
platform sh nilenso CloudSEK

Exhibition Sponsor

FreeBSD Foundation

Community Sponsors

Ansible PlanetScale

Hosted by

Rootconf is a forum for discussions about DevOps, infrastructure management, IT operations, systems engineering, SRE and security (from infrastructure defence perspective). more

Venkatraman J

@venkatraman123

Case Study: Transitioning from Batch processing to Event streaming architecture to enable Real time Streaming analytics

Submitted Jan 16, 2019

Batch processing and Stream processing are two different patterns of solving problems in analytics space. Analytics has transitioned from traditional batch oriented to real time stream oriented with Sub second Latency SLA. Smart end points and dump pipes are the current way of architecting data oriented solutions. This talk is a case stufy of why we(Metapack) transitioned from Traditional Batch oriented ETL to Event streaming architecture. It starts with the problem statement of what we were trying to solve and how streaming architecture helped us to solve that problem. The talk discusses the pros and cons of event streaming and stream processing and what approaches we took to solve those problems. It ends with a positive note of how streaming architecture helped us to create data lake and make the data available further for machine learning, adhoc Reproting and other applications.
Key take aways
1. Event streaming and stream processing concepts
2. When is streaming architecture relevant.
3. Pros and Cons of eventual consistency in Streaming architecture
4. Approaches to solve eventual consistency in streaming scenarios.
Any software engineers, architects and data engineers whishing to hear more about streaming architecture are good to attend the talk.

Outline

The slides would be divived into the following topics
First part - Concepts of Event streaming and streaming architecture in brief.
Second Part - How and why we migrated from Batch oriented ETL’s to Event streaming architure, and how we did stream processing.
Third part - Microservices architecture we built to do stream processing.
Fourth part: Lessons learnt while developing and supporting the streaming solutions in Live, approaches we took to solve the issues faced.
Fifth part: Discussing popular alternatives to Native stream processing/micro batching
Questions?.

Speaker bio

I am a Senior software engineer working at Metapack London with over 14+ years of experience building complex software systems from low end mobile devices to high end application servers.I am part of the team which built this transition architecture from Batch oriented ETL’s to Stream oriented architecture and running it in Live for big customers in e-commerce space.I hold a Bachelor’s degeree in Electronics and Communication from NIT Kurukshetra and Masters in Advanced Computing from University of London.

I have previously given a talk at ODSC india 2018 reading fake news classification with CNN.
https://www.youtube.com/watch?v=soPQupdc-uE&list=PL9Z-JgiTsOYTtwaIoUKbUzWN4uSElmRX5&index=15&t=0s

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Rootconf is a forum for discussions about DevOps, infrastructure management, IT operations, systems engineering, SRE and security (from infrastructure defence perspective). more