A Mighty elephant's journey to the cloud - How Twitter made the elephant fly?

Aug 2020

27 Mon

28 Tue

29 Wed

30 Thu

31 Fri

1 Sat 10:30 AM – 01:00 PM IST

2 Sun

https://linkedin.zoom.us/j/95812516656?pwd=eWRzYTlpZHh3VnBOeW1LR3FRaER6UT09

All submissions

This submission has been added to the schedule

A Mighty elephant's journey to the cloud - How Twitter made the elephant fly?

Submitted Jul 27, 2020

The mission we serve at Twitter is to give everyone the power to create and share ideas and information instantly without barriers. And with people tweeting more and more every day, the data produced by these tweets starts to add up that calls for the need for more storage and more compute power. To keep processing massive amounts of data 24/7 and after a careful evaluation, we kicked off an initiative to move the Hadoop ad-hoc and cold clusters to Google cloud services. This initiative, which we fondly call as Partly cloudy. This talk provides insights into the current Hadoop infrastructure @Twitter and its journey to cloud.