Running Batch Jobs in preemptible kubernetes nodes

Submitted Mar 10, 2018

Technical level: Intermediate

Preemptible nodes are perfect for running short term workloads, in this talk we go into the details of using them with the Kubernetes Scheduler. With GKE natively supporting preemtibile nodes, with a little architectural changes in the workflow it’s easy to leverage it.

Outline

Brief intro about preemptible nodes in GCE, Cost savings description, Architecture of preemptible nodes in GKE, Creating a preemptible cluster, changes needed to the Job spec, Scheduling policies, Ensuring Job Completion, Autoscaling preemtible nodes, using with workflow engines like Argo.

Speaker bio

Working as a Site Reliability Engineer at Rapyuta Robotics where we are building a PaaS for robotics on top of Kubernetes.

All submissions

Previous Next

Comments

Previous Next

Deploy your Rails application with Openshift

Ruby on Rails is not only hugely sought-after in the tech industry, it’s a language and framework that’s also very accessible to people of varying skillsets and experience. Ruby on Rails can be less off-putting than some other coding languages that demand a great deal of theoretical knowledge before you even write your first line of code. So we can come to a conclusion that Ruby on Rails is easy … more

02 Mar 2018