Designing Cloud Systems That Accept Temporary Confusion to Handle Massive Load
When thousands of field workers badge into active construction sites at seven in the morning, traditional cloud database designs hit a hard performanc…
Architecture
⚑ Report a ProblemLatest Architecture news from Tech News
All topics
agents
ai
api
architecture
automation
aws
backend
beginners
career
database
devchallenge
devops
javascript
llm
machinelearning
mcp
news
opensource
performance
productivity
programming
python
react
security
showdev
softwareengineering
systemdesign
tutorial
typescript
webdev
How Moving to Event-Driven Architecture Solved Peak Load but Strained User Trust
Every morning between six and seven, thousands of construction workers check into active jobsites across multiple time zones. In our legacy platform d…
Why Your LLM Calls Need a Circuit Breaker: A Lesson from Last Party 🔌
Carnival time has begun. 🎉 We are organizing a house party, and if you are in and around Bangalore, you are invited. Just one condition: Don't be late…
Durable Workflows Are Great, and the Wrong Choice for Short Pipelines
With the Microsoft Agent Framework and its Durable Task extension, durable execution is once again a major topic in the .NET world. The idea is tempti…
How to Destroy a Project in 5 Steps
The following guide is provided as a public service. If your goal is to maximize chaos, ensure total loss of accountability, and achieve legendary sta…
Why Modern Object Storage Doesn't Just Keep Three Copies
When people first learn about object storage, replication sounds like the obvious answer. Need durability? Keep three copies. Need higher availability…
A Disk Usage Alert Led Me Down the OpenStack Rabbit Hole
It Started With a Disk Usage Alert While going through our monitoring dashboards, I noticed that one of our backup object storage servers had been exp…
Treat Health-Data Revocation as a Distributed Convergence Protocol
Counterexample: a connector grant is revoked at epoch 8, but an import message created under epoch 7 is delayed. The primary store deletes its copy, t…
The World's Oldest Communication Protocol Is Music
This is going to be a very different article from what I usually write. No technical discussions, architecture deep dives, or engineering practices to…
Make an Outbox Relay Lease Expire Without Violating Delivery Invariants
Relay A claims outbox row 42 and publishes its message. Before A records completion, its lease expires. Relay B claims row 42 and publishes it again. …
Scraping millions of pages a day: what actually breaks
I ran a scraping platform that processed millions of pages a day at roughly 95% extraction success, around three seconds per page. The fetch-and-parse…
Building Reliable Event-Driven Systems: Event Schemas, Versioning, Contract Testing and Events vs Commands (5/5)
In this final article, we're going to explore Production practices 22. Events Are Delivered, Not Guaranteed A common misconception in event-driven arc…
RabbitMQ Dead Letter Queues in .NET: Why We Chose This Approach and Where It Hit Us
In a message-based system, one of the first questions you have to answer is this: What happens to a message that cannot be processed? The naive answer…
Distributed Move Protocol
The Hidden Complexity of Moving State in Distributed Systems Why a simple “move” becomes a distributed protocol when source and destination live on di…
Realtime Is a Hint, Not Your Source of Truth
A notification badge looks like a small feature. In a distributed application, it can expose a large architectural assumption. I recently investigated…
How We Distribute Video Events Across Regions With NATS JetStream
When a new video shows up in one of our regional crawlers, three things need to happen almost immediately: the SQLite FTS5 search index for that regio…
🌐 Monitoring the Remote Frontiers: How I Visualized Distributed Infrastructure Latency Using SigNoz
The Hook: The Mystery of the 200ms Drop in Remote Nodes A few days ago, I was looking at the traffic routing of a distributed microservice network. O…
Reversal Architecture in Distributed Financial Systems: Compensation, Liability, and Irreversible Side Effects
Abstract Distributed financial systems frequently treat reversal as a secondary state attached to an otherwise completed transaction. A payment succee…
Test Saga Compensation When Payment Succeeds but Inventory Times Out
An order reserves inventory, charges payment, then times out waiting for reservation confirmation. Cancellation begins. A late inventory success arriv…
Data Consistency in Real-Time Systems: Notes From a Trading Infrastructure Article
There's a category of engineering problem I find genuinely interesting: systems where the cost of getting consistency wrong is immediate, measurable, …
QUIC-Based NAT Traversal: How PUNCH_ME_NOW Frames Are Standardizing Hole Punching
TL;DR: NAT traversal has historically relied on STUN/TURN/ICE running as an external signalling layer bolted onto whatever transport protocol you choo…
HTLC Expiry and Force Close: The Most Dangerous Moments in Lightning
Most Lightning Network tutorials explain what an HTLC is. Almost none explain what happens when one expires. That gap is where real money is lost. Thi…
# Agentic Systems for Big Query Handling in Distributed Environments: The Complete Engineering Guide
A data engineering team at a global logistics company submits a query: "Identify all shipments delayed by more than 48 hours in the last quarter, cros…
The Acknowledgment Gap - How Event-Driven Systems Lose Messages Without Errors
This is a submission for DEV's Summer Bug Smash: Smash Stories powered by Sentry . If you have built event-driven systems for any length of time, you …
Exactly-Once Semantics in Kafka: Promise vs. Reality
"We're using Kafka with exactly-once semantics, so we don't have to worry about duplicates." I've heard this in architecture reviews, design docs, and…
Building Reliable Event-Driven Systems: Event Schemas, Versioning, Contract Testing and Events vs Commands (part-2)
This is part-2 of the article series on "Building Reliable Event-Driven Systems". In this article, we're going to explore Event Schemas . 5. Designing…
We hit an at-least-once delivery trap. Here is how we fixed the race conditions.
If you are running an event-driven architecture with message queues like Kafka, you already know the drill, scalability is awesome, but network partit…
Treat Per-Task Model Switching as a Concurrency Protocol
Changing the model for a running AI task is not a settings update. It is a distributed operation: read current task -> prepare credentials/config -…
Service-to-Service Communication in Microservices: What Every Developer Should Know
I still remember the first time a junior dev I was mentoring asked me, "why did the order service just... hang for 30 seconds and then crash the whole…
Failure Engineering Explained by Uncle to Nephew — Episode 1: Why Failures Are Normal
New series, same two people from the Node.js Internals series. Where that series answered "how does the system work?", this one answers "how does the …