How Apache YuniKorn Taught Our Kubernetes Cluster to Play Tetris

A story about Spark, scheduling, and a cloud bill that refused to make sense. Chapter 1: A Fresh Start on Kubernetes Every migration story starts with optimism, and ours was no different. We had just moved our Spark workloads from EMR to Kubernetes (EKS). On paper, it was everything we wanted: greater flexibility, advanced feature support, easier integrations with the rest of our platform, and a…

This is an excerpt. The full article continues at Slice.