Understanding the challenges posed while dealing with ‘Big Data’, in terms of time, processing and storage with special emphasis on social media intelligence systems which require the crawling and processing terabytes of data within a ‘reasonable’ time frame.

Outline

The extreme virality of Social data makes near real-time alerting and response systems essential to the success of Social Media monitoring and engagement platforms. From live storage systems, modified caching mechanisms and combinations of SQL and NoSql systems, we discuss new requirements, challenges and limitations that have forced us to combine, modify and at times rebuild several of these systems.

Requirements

None

Speaker bio

Harish is the CTO at Webfluenz Pte Ltd and Director at 4am Design and Technology Labs.

Harish drives the creation of proprietary Webfluenz Intelligence and Data Gathering systems by combining established computer science concepts with cutting edge and continuously evolving technologies.

In the past Harish has worked on various intelligent search systems in different environments.