BigDL: Integrating Deep Learning with Apache Spark
Submitted by Mukesh G (@mkgbv) on Wednesday, 21 March 2018
BigDL (https://github.com/intel-analytics/BigDL/) is an open source distributed deep Learning library, which is natively integrated with Apache Spark and provides rich deep learning functionalities for Spark. It combines the benefits of “high performance computing” and “Big Data” architecture, so as to provide orders of magnitude speedup than existing out-of-box open source DL frameworks (e.g., Caffe/Torch/Tensorflow) on single-node Xeon, and efficient scale-out based on the Spark architecture. In this talk, we will showcase how to users can easily build deep learning powered Big Data analytics using BigDL together with other libraries on Spark.
BigDL use case
BigDL demo (if possible)
Mukesh Gangadhar works as a senior performance architect at Intel. He is focused on improving the efficiency of running software applications on Intel based platforms.