The Fifth Elephant 2015

A conference on data, machine learning, and distributed and parallel computing

Viral B. Shah

@viralbshah

The many ways of parallel computing with Julia

Submitted Jun 14, 2015

Introduce Julia for those who haven’t heard about it, and focus on parallel computing with Julia. Do some demos with hundreds of processors. The audience will get a feel for parallel computing with Julia and is strictly advised to “Try it at home.”

Outline

Julia is a high performance dynamic language, primarily designed for technical computing, but increasingly seeing applications in a wide variety of domains.

This talk will provide an overview of parallel computing in Julia. It will start with an introduction to using built-in Julia primitives for parallel processing, such as pmap, @parallel, remotecall, spawn, fetch, etc. Based on this low-level primitives, shared arrays and distributed arrays have been built. We will try some Parallel Linear Algebra using packages such as ScaLapack along with some MPI programming. We will also look at the possibilities of data processing with data loaded from the Hadoop file system (HDFS) and/or S3. We will also preview the upcoming multi-threading capabilities in Julia.

Not only will we show how the compute can be efficiently carried out in Julia, but using tools such as Escher, we will also show how the findings can be beautifully packaged for presentation.

Speaker bio

https://in.linkedin.com/in/viralbshah

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Jump starting better data engineering and AI futures