The Fifth Elephant 2012

Finding the elephant in the data.

What are your users doing on your website or in your store? How do you turn the piles of data your organization generates into actionable information? Where do you get complementary data to make yours more comprehensive? What tech, and what techniques?

The Fifth Elephant is a two day conference on big data.

Early Geek tickets are available from fifthelephant.doattend.com.

The proposal funnel below will enable you to submit a session and vote on proposed sessions. It is a good practice introduce yourself and share details about your work as well as the subject of your talk while proposing a session.

Each community member can vote for or against a talk. A vote from each member of the Editorial Panel is equivalent to two community votes. Both types of votes will be considered for final speaker selection.

It’s useful to keep a few guidelines in mind while submitting proposals:

  1. Describe how to use something that is available under a liberal open source license. Participants can use this without having to pay you anything.

  2. Tell a story of how you did something. If it involves commercial tools, please explain why they made sense.

  3. Buy a slot to pitch whatever commercial tool you are backing.

Speakers will get a free ticket to both days of the event. Proposers whose talks are not on the final schedule will be able to purchase tickets at the Early Geek price of Rs. 1800.

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more

Siddhartha Reddy

@sids

Build Your Own Search Engine

Submitted Jun 15, 2012

No, this is not another tutorial on using Solr/ElasticSearch/Sphinx/Lucene. Imagine that none of these existed and you need a search engine for your shiny new eCommerce startup. What would you do? Build your own search engine, of course. I’ll go over what it would take to do that.

Outline

I plan to cover:

  1. The basic idea of a Search Engine
    — 1.1 How is it different from a Database?
    — 1.2 Inverted Index

  2. Techniques for constructing an Inverted Index
    — 2.1 Distributed Indexing
    — 2.2 Dynamic Indexing
    — 2.3 Index Compression

  3. Scoring and Ranking

  4. Scaling Search

Speaker bio

Siddhartha leads the Search & Product Discovery Team at Flipkart — India’s largest catalog of online inventory. Prior to this he was at a startup called Ziva Software, working on Mobile Search and automatic Information Extraction from the Web.

Siddhartha has been working on Information Retrieval and in related areas for almost seven years. He has a deep love for all things Search — everything ranging from User Experience to Relevance Ranking to Scaling Search to Search as a Platform.

Siddhartha loves to work with large scale, highly available systems and tons of data. He takes particular interest in application of Machine Learning techniques in all kinds of applications.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

The Fifth Elephant - known as one of the best data science and Machine Learning conference in Asia - has transitioned into a year-round forum for conversations about data and ML engineering; data science in production; data security and privacy practices. more