##About Rootconf Hyderabad:
Rootconf Hyderabad is a platform for:
- DevOps engineers
- Site Reliability Engineers (SRE)
- ML and data engineers
- Security and DevSecOps professionals
- Software engineers
to discuss real-world problems around:
- Site Reliability Engineering (SRE)
- Data and AI engineering
- Distributed systems -- observerability, microservices
- Implementing Infrastructure as Code
Speakers from Flipkart, Hotstar, Intuit, GO-JEK, MadStreetDen and Trusting Social will share their experiences with the above challenges.
##Event venue:
Rootconf Hyderabad will be held at T-Hub, IIIT-Hyderabad Campus, Gachibowli, Hyderabad, Telangana - 500032
##Contact information:
For bulk ticket purchases,sponsorship and other inquiries, contact sales@hasgeek.com or call 7676332020
#Sponsors:
Click here to view the Sponsorship Deck.
Rootconf Hyderabad 2019 sponsors:
#Platinum Sponsor
 |
 |
#Bronze Sponsors
 |
 |
 |
For information about the event, tickets (bulk discounts automatically apply on 5+ and 10+ tickets) and speaking, call Rootconf on 7676332020 or write to info@hasgeek.com.
RC
Ramanaresh Challa
@ramanareshchalla
CI/CD in Data Engineering @ Nike Tech
Submitted Jun 14, 2019
Session type:
Short talk of 20 mins
At Nike Tech, we have a diverse technology landscape with teams working on building apps for the end consumer to dashboards for our internal business stakeholders. All this is done at massive scale and a strong focus on CI/CD.
CI/CD in data engineering is a often neglected area and weak practices leads to inefficiencies which hurt in the long run. With a focus on delivering highly trusted and consistent data to business in order to make decisions, the development and testing process needs to be watertight before things move to production.
CI/CD is also usually an afterthought when we are designing and building the data engineering applications. We here at Nike do it differently and ensure CI/CD is a key focus area from the very beginning and design accordingly. This talk throws light into our thinking process when it comes to CI/CD, the tools we use and design examples for a couple of use cases.
Outline
•What is CI/CD?
•Why CI/CD in data engineering?
•How to simplify CI / CD for Airflow using Jenkins and Code Repos like Git/Bitbucket
•How to simplify CI / CD for Nifi using Jenkins/Nifi Registry/Terraform
Speaker bio
Ram is a lead engineer at Nike Enterprise data and analytics organization working in the space of real time master data management, data ingestion and data science engineering.
Links
Slides
https://drive.google.com/file/d/1dI2fsehxJvI3s4IGGnv84ShNrAnCN9KJ/view?usp=sharing
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}