Engineering posts about Kubernetes
Curated summaries and key learnings for engineers working with Kubernetes.
We terminated a TPU mid-training and it recovered in seconds: Introduction to elastic training with MaxText
This article discusses the concept of elastic training in the context of distributed machine learning, particularly using TPU chips and the JAX framework. It highlights the fragility of traditional...
Upgrade Amazon EKS clusters with confidence using Kubernetes version rollbacks
The article discusses the newly introduced Kubernetes version rollback feature for Amazon Elastic Kubernetes Service (EKS), which allows cluster administrators to revert a Kubernetes version upgrade...
How a simple code change reduced CPU usage by 97%
The article discusses a significant reduction in CPU usage (97%) achieved during the migration of a production service at Duolingo from Python 3.9 + Alpine to Python 3.12 + Debian Bookworm. The...
DigitalOcean Dedicated Inference: A Technical Deep Dive
The article delves into DigitalOcean's Dedicated Inference service, designed to efficiently manage large language model (LLM) inference at scale. It highlights the challenges of handling high...
Finding zombies in our systems: A real-world story of CPU bottlenecks
The article narrates a real-world investigation by the Kubernetes platform team at Pinterest into CPU bottlenecks affecting their Ray-based machine learning training jobs. The team faced intermittent...
Welcome to Agents Week
The article introduces 'Agents Week' at Cloudflare, highlighting the shift in cloud infrastructure to accommodate AI agents, which operate on a one-to-one basis rather than the traditional...