Oct 2015
5 Mon
6 Tue
7 Wed
8 Thu
9 Fri 09:00 AM – 06:05 PM IST
10 Sat 09:15 AM – 06:00 PM IST
11 Sun
Julia is a high-level dynamic language which was invented out of greed to do more. Unlike other high-level dynamic languages, Julia is really fast. It inherits design tenets from Lisp, builds on the good parts of C, MATLAB, R, Python and Ruby to create a language that is performant and highly productive at the same time.
We are proud to announce the first ever JuliaCon India. It will feature the creators of the language Jeff Bezanson, Stefan Karpinski, and Viral B Shah, and an enthusiastic contingent of Julia programmers in India. It’s a two-day event consisting of a day-long conference (9th Oct) and a workshop (10th Oct).
TM
Tanmay K. Mohapatra
@tanmaykm
Crunching Big Data with Julia
Submitted Sep 18, 2015
Section:
Crisp talk
Technical level:
Beginner
Introduce the big data infrastructure in Julia. It can be used to read/write HDFS files and run parallel Julia programs on a Yarn cluster.
Outline
This talk will use Elly.jl to demonstrate a big data workflow in Julia. Elly is a Hadoop HDFS and Yarn client. It is a pure Julia implementation with no dependencies on libhdfs. It provides:
- A familiar Julia ClusterManager interface, making it possible to use the familiar Julia parallel constructs on a Yarn cluster: addprocs, @parallel, spawn, pmap, etc.
- Lower level APIs to write native Yarn applications.
- A familiar Julia IO API for accessing HDFS files.
We shall use Elly and a few associated Julia packages to process a few example datasets.
Speaker bio
Tanmay K.M., Julia contributor. https://github.com/tanmaykm
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}