Netflix Simplified Batch Compute with Kueue

Netflix's decision to replace its custom queuing and scheduling logic in CMB with Kueue was driven by the evolution of the Kubernetes ecosystem and the need for modernization. Kueue's features, such as preemption, all-or-nothing scheduling, and topology-aware scheduling, were key to this decision. By integrating Kueue with its container platform Titus, Netflix can now offer improved capacity management and fair sharing across tenants. The migration, known as Netflix Batch, involved converting internal tenants to Cohorts and leaf tenants to ClusterQueue + LocalQueue, and mapping capacity configurations to resource flavors and nominal quotas.

The adoption of Kueue reflects Netflix's strategic shift towards a more Kubernetes-native compute infrastructure, aligning with the broader trend of cloud-native adoption in the industry. This move also highlights the growing importance of open-source projects in shaping the technology landscape. Kueue's development and innovation momentum, as well as its support for multi-tenant quota management and heterogeneous hardware, made it an attractive choice for Netflix. The company's experience with Kueue demonstrates the potential for cloud-native solutions to improve efficiency and scalability in batch compute workloads.

The implications of this migration are significant, as it enables Netflix to streamline its operations, improve resource utilization, and enhance the overall user experience. However, potential risks include the complexity of managing and maintaining a cloud-native infrastructure, as well as ensuring seamless integration with existing systems. As Netflix continues to evolve its compute infrastructure, it will be essential to monitor its progress and assess the impact of Kueue on its operations. With millions of batch jobs already migrated, the company is well-positioned to leverage the benefits of cloud-native technology.