The Fifth Elephant 2012

Finding the elephant in the data.

Big Data in a Small Startup

Submitted by Pramod Biligiri (@pramodbiligiri) on Sunday, 20 May 2012

videocam_off

Technical level

Beginner

Section

Big Data Infrastructure & Processing

Session type

Lecture

Status

Submitted

Vote on this proposal

Login to vote

Total votes:  +12

Objective

What unexpected problems and challenges will you find when you go tackling big data problems, esp. if you're a bootstrapped startup with resource constraints?

How do you stay agile and not sacrifice user workflow with technology choices designed for big enterprises?

Description

Based on my experience building DistilBio.com, I'll talk about the technology challenges as we keep scaling our data. I'll touch upon NoSQL systems like Solr, Redis, MongoDB, graph database (Virtuoso), build-vs-buy, hardware-vs-software optimization, Cloud vs On Premise and framework-vs-libraries.

Keeping in mind that all the while your company is still trying to achieve Product/Market fit.

Speaker bio

Working on data processing and query performance at DistilBio.com. Using Scala, JVM and some NoSQL systems. Used to be an Application Developer at ThoughtWorks.

Comments

  • 1
    Govind Kanshi (@govindsk) 6 years ago

    Thanks Pramod - Could we assume that you will share best practices around these diverse technologies. Monitoring/Configuration settings/Availability issues/Debugging tips.

Login with Twitter or Google to leave a comment