Running Batch Jobs in preemptible kubernetes nodes
Submitted by Gowtham Sundaar (@gowthamm) on Saturday, 10 March 2018
Preemptible nodes are perfect for running short term workloads, in this talk we go into the details of using them with the Kubernetes Scheduler. With GKE natively supporting preemtibile nodes, with a little architectural changes in the workflow it’s easy to leverage it.
Brief intro about preemptible nodes in GCE, Cost savings description, Architecture of preemptible nodes in GKE, Creating a preemptible cluster, changes needed to the Job spec, Scheduling policies, Ensuring Job Completion, Autoscaling preemtible nodes, using with workflow engines like Argo.
Working as a Site Reliability Engineer at Rapyuta Robotics where we are building a PaaS for robotics on top of Kubernetes.