The Fifth Elephant 2015

A conference on data, machine learning, and distributed and parallel computing

The many ways of parallel computing with Julia

Submitted by Viral B. Shah (@viralbshah) on Sunday, 14 June 2015

Section: Full Talk Technical level: Beginner


Introduce Julia for those who haven’t heard about it, and focus on parallel computing with Julia. I will try to do some fun stuff with a 1000 processors in a demo.


This talk will provide an overview of parallel computing in Julia. It will start with an introduction to using built-in Julia primitives for parallel processing, such as pmap, @parallel, remotecall, spawn, fetch, etc. Based on this low-level primitives, shared arrays and distributed arrays have been built. We will try some Parallel Linear Algebra using packages such as ScaLapack along with some MPI programming. We will also look at the possibilities of data processing with data loaded from the Hadoop file system (HDFS) and/or S3. We will also preview the upcoming multi-threading capabilities in Julia.

Speaker bio


Login with Twitter or Google to leave a comment