Engineering posts about Caching
Curated summaries and key learnings for engineers working with Caching.
DigitalOcean Inference Router, Now Cache-Aware: Why the Cheapest Model Isn't Always the Best Deal
The article presents the advancements in DigitalOcean's Inference Router, emphasizing its new cache-aware routing capabilities that enhance model selection based on cached context. It explains how...
Introducing Cache Response Rules
The article introduces Cache Response Rules, a new feature in Cloudflare that allows developers to modify responses from an origin server before they are cached. This feature addresses common caching...
Improving Smart Tiered Cache for Public Cloud Regions
The article outlines advancements in Cloudflare's Smart Tiered Cache, specifically designed to optimize caching for public cloud origins. It addresses the challenges posed by anycast and regional...
Your Worker can now have its own cache in front of it
The article introduces Cloudflare's Workers Cache, a new feature that allows developers to implement a tiered caching system in front of their Workers. This caching mechanism is designed to enhance...
Improving performance in the layers panel
The article outlines significant performance enhancements made to the layers panel in Figma, which is crucial for managing complex design files. By rearchitecting the panel's data-gathering process...
From latency to instant: Modernizing GitHub Issues navigation performance
The article outlines the modernization of GitHub Issues navigation performance by addressing latency issues that disrupt developer workflows. It details a strategic shift from server-side rendering...
Shared Dictionaries: compression that keeps up with the agentic web
The article explores the challenges posed by increasing web page sizes and the frequency of deployments, highlighting the inefficiencies of traditional compression methods. It introduces shared...
Why we're rethinking cache for the AI era
The article explores the challenges posed by AI traffic on traditional caching mechanisms within Content Delivery Networks (CDNs). It highlights how AI crawlers exhibit unique traffic patterns that...