[Перевод] Компактация лога в Apache Kafka повреждала данные. Вот как мы это исправили
Компактация лога в Kafka может привести к ситуации, когда разные реплики одного топика начинают хранить разную версию данных — и расхождение сохраня…
Testing & QA
⚑ Report a ProblemLatest Testing & QA news from Tech News
All topics
agents
ai
api
architecture
automation
backend
beginners
career
claude
cybersecurity
devchallenge
devops
discuss
javascript
llm
machinelearning
mcp
node
opensource
performance
productivity
programming
python
security
showdev
softwareengineering
testing
tutorial
typescript
webdev
Designing High-Throughput Event-Driven Microservices with Kafka and RabbitMQ
Introduction & Industry Context In the landscape of modern software architecture, event-driven microservices have transitioned from an advanced…
Integration Digest for September 2026
Articles 🔍 API Features as a First-Class Artifact with OpenAPI Overlays OpenAPI Overlay 1.1 documents model API features as separate, reviewable art…
От 6 часов до 20 минут: как мы ускорили коллаборативную модель в рекомендациях Авито
Привет, я Салават Динмухаметов, senior ML-engineer в команде рекомендаций Авито . В статье расскажу, как мы изменили систему рекомендаций на главной…
Did You Know? Kafka Stores Your Messages on Disk 🤔
Most people assume that a high-performance messaging system like Kafka must be keeping everything in memory to stay fast. But here's the truth — eve…
A question on Discord found two bugs in my RAG system. Fixing them found a third.
Every test passed. The tests had the same blind spots as the code. A developer saw Ossian's MCP server in a community showcase and asked two questio…
The compiler was never what you wanted
You have an orders topic on a Kafka cluster, its values encoded with Avro against a schema in the Schema Registry . You want the orders worth more t…
Why I Publish to Kafka Only After the Transaction Commits
The bug that doesn't show up in tests — and what to do about it There is a class of bug in event-driven systems that is almost invisible in developm…
Building Fault-Tolerant, Event-Driven Kafka Pipelines in Go: Reliable Reprocessing & Dead Letter Queues
A practical guide to building reliable event-driven systems in Go using Apache Kafka. Learn how to implement tiered retry strategies with delayed re…
The Outbox Pattern Is Not Enough
The textbook version of the transactional outbox is tight. You save the domain entity and an outbox row in one local transaction. A background sched…
2–3 тысячи сборок в день: как мы превратили Kafka из компонента в инфраструктурную платформу
Apache Kafka можно бесплатно скачать, развернуть и подключить к приложениям. При небольшом проекте этого может быть достаточно: создали несколько то…
One bad Kafka record shouldn't crash a Flink Stateful Functions job
What was broken In Apache Stateful Functions, the routable Kafka ingress had no policy for malformed records. A record with a null key (there's no f…
Kafka for Engineers Who've Only Used REST: What Actually Changes
When I first read that Kafka was a "distributed event streaming platform," I nodded, closed the tab, and went back to writing REST endpoints. It too…
Kafka record headers in Stateful Functions: closing a five-year-old gap
Apache Stateful Functions never let a function see Kafka record headers, and never let it set them. Five years, no headers. StateFun Actors 3.4.0-KZ…
Real-Time Inventory Management with Kafka: How Retailers Are Eliminating Stockouts
TL;DR Retailers process thousands of inventory transactions every second across physical stores, eCommerce platforms, warehouses, suppliers, and ful…
Core Concept: Leader Election via Consensus
It's not agreeing on a transaction that's often the most expensive consensus operation in a distributed system, it's agreeing on who gets to decide…
От 0 до 10 миллионов ИИ-проверок в месяц: как мы продуктивизировали CV в Пятёрочке за 8 месяцев
Статья про то, как CV-сервис вырос с MVP до 10 миллионов проверок фото в месяц и не развалился в проде. 🔧 Это не про «у нас классные модели» и не пр…
Шесть недель с agentic AI против фрода в adversarial-системе
Я слишком рано понёс первые результаты в наш продукт. Тогда это выглядело логично: мы прикрутили агентный ИИ к анализу логов и поведения пользовател…
Kafka Consumer в тестовой автоматизации: архитектурный разбор
Привет, Хабр! На связи Егор Лаптев — QA Fullstack Java в SENSE на проекте крупного российского банка. End-to-end тесты UI проверяют только то, что в…
Five days with eventferry — MySQL, SQL Server, MSK IAM, and a core that didn't move
Five days ago I posted I built a transactional outbox toolkit for Node.js — meet eventferry . The pitch was small and specific: Postgres + Kafka, th…
От 0 до 10 миллионов ИИ-проверок в месяц: как мы продуктивизировали CV в Пятёрочке за 8 месяцев
Статья про то, как CV-сервис вырос с MVP до 10 миллионов проверок фото в месяц и не развалился в проде. 🔧 Это не про «у нас классные модели» и не пр…
I Built a Mini Message Broker in Pure Python and Finally Understood How Kafka Moves Millions of Events
Last year I was on a team that pushed 40 million events per day through Kafka. We had consumer lag alerts, rebalancing incidents, and a whole runboo…
"Confluence Docs Lie. Tie Your Documentation to Code Instead."
Every team has that Confluence page. The one that was carefully written to explain what the service does, what the API looks like, what each DB colu…
Real-Time Notification Systems Are Harder Than Most Teams Expect
If you’ve ever thought, “It’s just a WebSocket event,” this article is for you. Notification systems look simple on the surface, but in production t…
Strimzi: Create a simple Mutual TLS (mTLS) authentication
You probably already know about Strimzi . Strimzi enables Kafka on Kubernetes , simple as that. So, in this post, I will not talk about Strimzi , bu…
Kafka for Data Engineers: Core Concepts, KRaft, and the Patterns That Actually Work
If your Kafka Docker Compose still has a ZooKeeper service in it, your setup is already legacy. As of Kafka 4.0 (released March 2025), ZooKeeper is…
62 бесплатных урока июня: Java, Docker, LLM, SRE, DWH и другие темы для роста в IT
Карьерный рост в IT редко упирается только в «выучить еще один инструмент». Чаще проблема в другом: понять, какие технологии уже стали рабочей практ…
Integration Digest for May 2026
Articles 🔍 Bucket4j + Infinispan: A Deep Dive Into Implementation A code-level walkthrough of running Bucket4j rate limiting on top of embedded Infi…
Apache Kafka End of Life: Kafka Versions EOL Every 4 Months — Are You Behind?
Apache Kafka's release cadence is fast. A new minor version ships roughly every four months. EOL dates arrive quickly — and because Kafka sits at th…
How to analyze the cost of Kafka?
Which side are you on: "This is just what Kafka costs at scale" or "We should switch to a cheaper Kafka provider"? At Conduktor , our field team wor…