A large scale IOT platform architecture using open source apache projects like Nifi, Kafka, Storm, Spark and Hadoop.
Submitted by Satish Duggana (@satishd) on Saturday, 30 April 2016
Gartner predicts there will be 26 billion devices on the Internet of Things by 2020. Capturing and analyzing data from connected devices provides a wealth of opportunity. In this session we will look at how open source Apache projects like Apache NiFi, Kafka, Storm, Spark and Hadoop can work in concert to analyze and provide insights in a large scale distributed IoT architecture.
- IoT Platform high level architecture
- Edge processing (Apache NiFi)
- Streaming and analytics (Kafka, Storm, Spark)
- Notifications (Storm)
- Alerts (Hadoop, Storm)
- Storage (Hadoop)
- Application development using SDK and UI
Currently, helping design and development of IoT platform at Hortonworks and contributing various features in Apache Storm. Built large scale distributed systems, application servers, ESBs and backend infrastructure platforms for last 14 years in Hortonworks, BEA Systems/Oracle and Pramati Technologies.