The Fifth Elephant 2017
On data engineering and application of ML in diverse domains
JS
Jyothsna Srinivas
@jyothsnasrinivas
Working with Apache Spark in Eta
Submitted Apr 16, 2017
Section:
Full talk for data engineering track
Technical level:
Intermediate
Eta is a high-level, purely functional programming language and also the newest member to the JVM world. It has been gaining traction as an alternative to Scala for solving Big Data problems. In this talk, I would like to discuss why Eta is ideal for writing Apache Spark jobs by considering the following aspects:
- Type-safety
- Elegant EDSLs (Embedded Domain Specific Languages)
- Interoperates with Java ecosystem
- Ideal for concurrent, parallel, and distributed systems.
Outline
The talk will mainly cover the following topics:
- Introduction to pure functional programming
- Why Eta?
- Why Eta for Spark?
- EDSL for Spark in Eta
- Demo a Apache Spark jobs written in Eta
Speaker bio
Jyothsna is the CEO and Co-founder of TypeLead. TypeLead is the company behind Eta programming language.
She is also one of the major committers to the Eta project.
{{ gettext('Login to leave a comment') }}
{{ gettext('Post a comment…') }}{{ errorMsg }}
{{ gettext('No comments posted yet') }}