Engineering posts about Replication
Curated summaries and key learnings for engineers working with Replication.
Object Storage + WAL: Lakebase Postgres for the agentic era
The article explores the innovative architecture of Lakebase Postgres, which integrates object storage with a transactional database to enhance performance and scalability for agent workloads. It...
How and Why Netflix Built a Real-Time Distributed Graph: Part 3 — Querying the graph with gRPC…
In this article, Netflix engineers Nilesh Mishra and Ajit Koti detail the architecture and design choices behind their Real-Time Distributed Graph (RDG), particularly focusing on the querying layer...
Building Service Topology at Scale: Architecture, Challenges, and Lessons Learned
This article delves into the complexities of constructing a real-time service topology at Netflix scale, focusing on the architectural decisions that facilitate efficient data processing and system...
Introducing Meerkat: an experiment in global consensus
The article introduces Meerkat, a new distributed consensus service developed by Cloudflare, designed to manage control-plane state across its global data centers. It highlights the limitations of...
Sitar-agent: Building a reliable dynamic configuration sidecar at scale
The article discusses the development of Sitar-agent, a Kubernetes sidecar designed to ensure reliable dynamic configuration delivery at scale for Airbnb's services. It outlines the configuration...
Lights Out, Systems On: Validating Instant Power Loss Readiness
The article introduces the Instantaneous PowerLoss Storm, a testing paradigm developed by Meta to prepare data centers for zero-notice power loss scenarios. It outlines the strategies implemented to...
How the lakebase architecture stays resilient to cloud failures
The article discusses the challenges faced by cloud infrastructure due to increased demand for control-plane operations and the need for high availability in database management. It outlines how the...
Rearchitecting the Workflows control plane for the agentic era
The article discusses the rearchitecting of the Workflows control plane to accommodate a shift towards agent-triggered workflows, necessitated by the increasing demand for durable execution engines...