A Mighty elephant's journey to the cloud - How Twitter made the elephant fly?

Aug 2020

27 Mon

28 Tue

29 Wed

30 Thu

31 Fri

1 Sat 10:30 AM – 01:00 PM IST

2 Sun

Make a submission

Accepting submissions till 27 Jul 2020, 11:59 PM

https://linkedin.zoom.us/j/95812516656?pwd=eWRzYTlpZHh3VnBOeW1LR3FRaER6UT09

Infrastructure engineering @Scale is a growing community that focuses on sharing our learnings around infrastructure engineering. The gatherings we make revolve around the following primary areas,

infra scalability challenges
cloud migration stories
design patterns
distributed systems, service discovery/fleet management
novel ideas around infra operating mechanisms
infrastructure security and monitoring systems
bleeding edge technologies that’re worth socializing

Hosted by

Infrastructure Engineering @Scale

Welcome to the meetup page for Infrastructure Engineering @Scale more

All submissions

This submission has been added to the schedule

A Mighty elephant's journey to the cloud - How Twitter made the elephant fly?

Submitted Jul 27, 2020

The mission we serve at Twitter is to give everyone the power to create and share ideas and information instantly without barriers. And with people tweeting more and more every day, the data produced by these tweets starts to add up that calls for the need for more storage and more compute power. To keep processing massive amounts of data 24/7 and after a careful evaluation, we kicked off an initiative to move the Hadoop ad-hoc and cold clusters to Google cloud services. This initiative, which we fondly call as Partly cloudy. This talk provides insights into the current Hadoop infrastructure @Twitter and its journey to cloud.