The Fifth Elephant 2019

Gathering of 1000+ practitioners from the data ecosystem

Using Apache Nifi to manage a real time master data foundation @ Nike

Submitted by Vidyasagar Reddy (@vsreddy07) on Jun 14, 2019

Session type: Short talk of 20 mins Status: Rejected

Abstract

Nike has a wide variety of systems in the enterprise landscape. All these systems produce data in different shapes and sizes. We are building theNike data foundation so that we meet the below goals.

1.Deliver trusted, accurate, timely and consistent information and insights to the business.
2.Enable governing data as an asset and sharing data at scale.
3.Enable faster and better informed business decisions resulting in serving our customers and consumers more efficiently.

One key aspect in the enterprise data foundation is master data. It is very important that we maintain a single source of truth for master data to address issues around consistency, authenticity and governance. It is also important that updates to master data are visible to consumers as soon as possible.This talk is about Nike’s journey in building a real time master data management platform using Apache Nifi. We will talk about the various pros and cons of the technologies we considered and why we made certain decisions given the overall goals of the program.

Outline

  1. What is master data?
  2. What are the various types of master data?
  3. What is the existing situation without a unified platform for master data?
  4. What technologies were evaluated?
  5. Why we have chosen Apache Nifi?
  6. What is Nifi well suited for?
  7. How did we develop and integrate this with our CI/CD pipelines?

Speaker bio

Vidya is currently part of Nike, Enterprise Data and Analytics organisation, leading teams in the space of Enterprise master data management and data science engineering.

Links

Slides

https://drive.google.com/file/d/1RVvBb8nWLhKxuf_90RS_lOSvOVKlVa6B/view?usp=sharing

Preview video

https://vimeo.com/344240094

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('You need to be a participant to comment.') }}

{{ formTitle }}
{{ gettext('Post a comment...') }}
{{ gettext('New comment') }}

{{ errorMsg }}