Rootconf 2019
Rootconf For members

Rootconf 2019

On infrastructure security, DevOps and distributed systems.

Tickets

Loading…

##About Rootconf 2019:
The seventh edition of Rootconf is a two-track conference with:

  1. Security talks and tutorials in audi 1 and 2 on 21 June.
  2. Talks on DevOps, distributed systems and SRE in audi 1 and audi 2 on 22 June.

##Topics and schedule:
View full schedule here: https://hasgeek.com/rootconf/2019/schedule

Rootconf 2019 includes talks and Birds of Feather (BOF) sessions on:

  1. OSINT and its applications
  2. Key management, encryption and its costs
  3. Running a bug bounty programme in your organization
  4. PolarDB architecture as Cloud Native Architecture, developed by Alibaba Cloud
  5. Vitess
  6. SRE and running distributed teams
  7. Routing security
  8. Log analytics
  9. Enabling SRE via automated feedback loops
  10. TOR for DevOps

##Who should attend Rootconf?

  1. DevOps programmers
  2. DevOps leads
  3. Systems engineers
  4. Infrastructure security professionals and experts
  5. DevSecOps teams
  6. Cloud service providers
  7. Companies with heavy cloud usage
  8. Providers of the pieces on which an organization’s IT infrastructure runs -- monitoring, log management, alerting, etc
  9. Organizations dealing with large network systems where data must be protected
  10. VPs of engineering
  11. Engineering managers looking to optimize infrastructure and teams

For information about Rootconf and bulk ticket purchases, contact info@hasgeek.com or call 7676332020. Only community sponsorships available.

##Rootconf 2019 sponsors:

#Platinum Sponsor
CRED

#Gold Sponsors
Atlassian Endurance Trusting Social

#Silver Sponsors
Digital Ocean GO-JEK Paytm

#Bronze Sponsors
MySQL sumo logic upcloud
platform sh nilenso CloudSEK

#Exhibition Sponsor
FreeBSD Foundation

#Community Sponsors
Ansible PlanetScale

Hosted by

Rootconf
Rootconf
Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more
All submissions

Powered by VideoKen

Venkatraman J

@venkatraman123

Case Study: Transitioning from Batch processing to Event streaming architecture to enable Real time Streaming analytics

Submitted Jan 16, 2019

Section: Full talk of 40 mins duration Technical level: Intermediate

Batch processing and Stream processing are two different patterns of solving problems in analytics space. Analytics has transitioned from traditional batch oriented to real time stream oriented with Sub second Latency SLA. Smart end points and dump pipes are the current way of architecting data oriented solutions. This talk is a case stufy of why we(Metapack) transitioned from Traditional Batch oriented ETL to Event streaming architecture. It starts with the problem statement of what we were trying to solve and how streaming architecture helped us to solve that problem. The talk discusses the pros and cons of event streaming and stream processing and what approaches we took to solve those problems. It ends with a positive note of how streaming architecture helped us to create data lake and make the data available further for machine learning, adhoc Reproting and other applications.
Key take aways
1. Event streaming and stream processing concepts
2. When is streaming architecture relevant.
3. Pros and Cons of eventual consistency in Streaming architecture
4. Approaches to solve eventual consistency in streaming scenarios.
Any software engineers, architects and data engineers whishing to hear more about streaming architecture are good to attend the talk.

Outline

The slides would be divived into the following topics
First part - Concepts of Event streaming and streaming architecture in brief.
Second Part - How and why we migrated from Batch oriented ETL’s to Event streaming architure, and how we did stream processing.
Third part - Microservices architecture we built to do stream processing.
Fourth part: Lessons learnt while developing and supporting the streaming solutions in Live, approaches we took to solve the issues faced.
Fifth part: Discussing popular alternatives to Native stream processing/micro batching
Questions?.

Speaker bio

I am a Senior software engineer working at Metapack London with over 14+ years of experience building complex software systems from low end mobile devices to high end application servers.I am part of the team which built this transition architecture from Batch oriented ETL’s to Stream oriented architecture and running it in Live for big customers in e-commerce space.I hold a Bachelor’s degeree in Electronics and Communication from NIT Kurukshetra and Masters in Advanced Computing from University of London.

I have previously given a talk at ODSC india 2018 reading fake news classification with CNN.
https://www.youtube.com/watch?v=soPQupdc-uE&list=PL9Z-JgiTsOYTtwaIoUKbUzWN4uSElmRX5&index=15&t=0s

All submissions

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Register
Hybrid access (members only)

Hosted by

Rootconf
Rootconf
Rootconf is a community-funded platform for activities and discussions on the following topics: Site Reliability Engineering (SRE). Infrastructure costs, including Cloud Costs - and optimization. Security - including Cloud Security. more