Postgres-backed Job Scheduler for Clojure

Feb 2020

10 Mon

11 Tue

12 Wed

13 Thu

14 Fri 09:30 AM – 09:00 PM IST

15 Sat 08:45 AM – 06:00 PM IST

16 Sun

Make a submission

Accepting submissions till 20 Jan 2020, 11:59 PM

Novotel Pune Nagar Road, Crimson Hall, Pune

Tickets

IN/Clojure 2020 is the 4th edition of India’s annual Clojure and ClojureScript conference. Follow twitter.com/in_clojure for updates.

Backstory

We began in Pune in 2016 and after two editions in namma Bengaluru, we’re delighted to come full circle back to apla Pune (and all those delicious bakarwadis and modaks).

As India’s premiere Clojure and ClojureScript conference, we strive to facilitate the free exchange of ideas between new and experienced programmers alike.

Over the years, IN/Clojure has served as a platform to kickstart a series of Clojure workshops and meet-ups across the country. And it has helped attendees make a strong case for Clojure, and Clojurescript adoption in their companies.

We believe that this edition of the conference, like previous editions will foster the growing Clojure community in Asia.

Who should attend?

Whether you are knee-deep writing macros that write macros, or struggling to escape the beginner’s plateau, or wondering if/why/how to adopt Clojure in your organization, or are in it purely for the joy of learning, IN/Clojure is the event bringing together a great mix of Clojure/Script masters, practitioners, and newcomers from across India and beyond.

Why Attend?

We welcome you to join nearly 149 other people and...

Speak: CFP is open till 20 Jan 2020.
Learn: We run two all-day hands-on Clojure workshops. Check 'em out here.
Converse: Derive some sweet cerebral expansion from the talks, the tweetstorms, and the “hallway tracks”.
Inspire: Trade notes, ideas, tools, and techniques with new and experienced Clojure programmers alike (photostream).
Be Inspired : Start that project, that meetup, that hack night, that business, that beautiful work of art.
Sponsor: Help foster the growing Clojure and FP community in India/Asia.
Network: Meet seasoned practitioners and awesome sponsors (listed below). Hire or get hired. Acquire or get acquired ;-)
Grab: Some cool swag, and some fun swag, and some zany swag.
Party: Eat, drink, and make merry with some of the nicest people around.

Plus, this year we enjoy the company of the perennially effervescent Bozhidar Batsov; prolific Clojurist, Emacs fanatic, maintainer of CIDER, and Lisp hacker extraordinaire.

(Oh, and tickets are going, going, going... grab yours while stocks last.)

#Sponsors:

Click here to view the Sponsorship Deck.

IN/Clojure 2020 Sponsors:

#Platinum Sponsor

#Gold Sponsor

#Bronze Sponsor

#Community Sponsor

#Speaker travel support

Hosted by

IN/Clojure

IN/Clojure is India’s annual Clojure and ClojureScript conference, including talks about features, libraries, tools, usage, and more. IN/Clojure 2020, our 4th edition, is happening on 14th and 15th Feb 2020 (Fri/Sat) in Pune, Maharashtra. more

All submissions

Previous Next

Postgres-backed Job Scheduler for Clojure

Submitted Dec 27, 2019

🌓 Submission Type: Crisp (20 minutes)

This talk explores a job scheduler for Clojure (now extracted into a library), which, in addition to being capable of persisting state, is resilient to the variability of a distributed system.

In this talk, we will look at the APIs that make up a core part of this library. As we discuss the internals, we’ll reflect on the ease of interop with Java’s Executor APIs. We’ll then discuss the architecture of the scheduler, the rationale for persistence, the database schema, the modeling of jobs and tasks, and the fringe benefits of persisting contextual information for each job.

To lace it all together, we will define the inputs and dissect what it translates to: initiating the schedulers, creation of jobs, discovering pending jobs on the database, and executing jobs. Towards the end, we will explore the library’s extensibility and the scope of its utilization.

Outline

Context:

What is a general-purpose job scheduler?
What currently exists, and how does this library compare?

Architecture:

Walkthrough
Motivations
Internal APIs

Library APIs:

Defining jobs
Defining tasks, rules, and metadata for jobs
Scheduling jobs

Rationales:

Database schema
Why is it required for job schedulers to be persistent, and what purpose does persisting jobs’ and tasks’ state serve?
What purpose does metadata serve?

Lacing it all together.
Roadmap of the library.

Requirements

Minimal experience of working with Clojure and Postgres is a nice-to-have prerequisite, but not a compelling requirement.

Speaker bio

I’m a software engineer at nilenso, where I primarily work on building a platform for incentivising Gojek drivers. Prior to nilenso, I spent a large chunk of my programming career working with Kotlin and Java (among other things) to solve various problems across healthcare technology.