Using Apache Nifi to manage a real time master data foundation @ Nike
Submitted by Vidyasagar Reddy (@vsreddy07) on Friday, 14 June 2019
Session type: Short talk of 20 mins
Nike has a wide variety of systems in the enterprise landscape. All these systems produce data in different shapes and sizes. We are building theNike data foundation so that we meet the below goals.
1.Deliver trusted, accurate, timely and consistent information and insights to the business.
2.Enable governing data as an asset and sharing data at scale.
3.Enable faster and better informed business decisions resulting in serving our customers and consumers more efficiently.
One key aspect in the enterprise data foundation is master data. It is very important that we maintain a single source of truth for master data to address issues around consistency, authenticity and governance. It is also important that updates to master data are visible to consumers as soon as possible.This talk is about Nike’s journey in building a real time master data management platform using Apache Nifi. We will talk about the various pros and cons of the technologies we considered and why we made certain decisions given the overall goals of the program.
- What is master data?
- What are the various types of master data?
- What is the existing situation without a unified platform for master data?
- What technologies were evaluated?
- Why we have chosen Apache Nifi?
- What is Nifi well suited for?
- How did we develop and integrate this with our CI/CD pipelines?
Vidya is currently part of Nike, Enterprise Data and Analytics organisation, leading teams in the space of Enterprise master data management and data science engineering.