The Fifth Elephant 2015

A conference on data, machine learning, and distributed and parallel computing

Viral B. Shah

@viralbshah

The many ways of parallel computing with Julia

Submitted Jun 14, 2015

Introduce Julia for those who haven’t heard about it, and focus on parallel computing with Julia. I will try to do some fun stuff with a 1000 processors in a demo.

Outline

This talk will provide an overview of parallel computing in Julia. It will start with an introduction to using built-in Julia primitives for parallel processing, such as pmap, @parallel, remotecall, spawn, fetch, etc. Based on this low-level primitives, shared arrays and distributed arrays have been built. We will try some Parallel Linear Algebra using packages such as ScaLapack along with some MPI programming. We will also look at the possibilities of data processing with data loaded from the Hadoop file system (HDFS) and/or S3. We will also preview the upcoming multi-threading capabilities in Julia.

Speaker bio

https://in.linkedin.com/in/viralbshah

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Jump starting better data engineering and AI futures