The Test Wasn't Wrong. It Was Answering an Older Question.
The Test Wasn't Wrong. It Was Answering an Older Question. I shipped a change I had reviewed, simulated, and deployed. An hour later my acceptance s…
DevOps
⚑ Report a ProblemLatest DevOps news from Tech News
All topics
agents
ai
api
architecture
automation
aws
backend
beginners
cloud
database
devchallenge
devops
docker
javascript
kubernetes
llm
machinelearning
mcp
node
opensource
performance
productivity
programming
python
security
showdev
testing
tutorial
typescript
webdev
Evaluate RAG retrieval before changing your chatbot prompt
Before tuning a prompt, check if the retriever actually surfaced the evidence. A fluent answer often hides a missing document. And a retrieved docum…
Validate bounding boxes from a general vision model
A general model can take an image plus a question and return segmentation, bounding boxes, and object detection, work that used to require its own t…
Exit Criteria for a Free Model Tier
A free model tier is a lease with an unpublished end date. Signing it is not the mistake. Learning the terms during a production incident is. The us…
The Portability Audit Take-Home: Grade Environment Assumptions, Not Features
A take-home that runs on the reviewer's laptop grades features; a take-home that runs anywhere grades engineering discipline. The task below asks a…
Privacy Budgets for Test Email in Web Apps
Email is often treated as harmless test plumbing. In a web application, it is closer to a small data store: messages can contain personal-looking ad…
Cold Starts, Lost Files, and Green Dots: Five Myths About Using a Free Server as Staging
My demo broke at 9:58 PM. The same URL answered at 9:40. My code did not change in between. That gap is the whole lesson. A free server is a shared,…
Properties Without Witnesses Are Decorations: A Falsifiability Gate for Agent Patches
A property that passes on the patched tree and on the pre-patch tree carries no information. That is the first thing to measure, before you trust an…
The build went green because it stopped checking
A teammate deleted a test file on a Friday. Not on purpose. The suite still passed. The pipeline still went green. Nobody noticed for three weeks. H…
A 200 response and a broken page: what screenshot monitoring taught me
An uptime check answers one question: did the server respond? Visitors ask a different one: can I use this page? After a few years of looking after…
DevOps Email Tests Need a Handoff Contract
DevOps Email Tests Need a Handoff Contract Email tests in CI often fail at the boundary between two jobs: one job creates a disposable inbox, anothe…
40 features, 872 tests, one SQLite file - how the Uniface test suite stayed honest
The series Building a customer app in Uniface 10 ended its last round with 688 tests in 13 test services. This round added 40 features in one go - t…
How to Test If Your DDoS Protection Actually Works (Before an Attacker Shows You)
Your CDN dashboard says "attack mitigated". Your origin server says otherwise. One of them is lying, and finding out which one — before a real attac…
A Green Pipeline That Ran Three of Five Shards Is Not Green
Your merge queue trusts a color. It should trust a coverage claim. A sharded CI run where shard 3 died during setup, shard 5 collected zero tests, a…
It Had Been Working Fine
Four people apologized. None of them was lying. The Screenshot It started with a screenshot. A user was testing the product. They called an endpoint…
TypeScript Email Tests Need a Typed Event Boundary
Email tests often start with a simple promise: trigger a signup flow, wait for a message, click the link, and assert the account is active. It sound…
Building FlakyDetector 0.2.2: Why Test Reliability Needs Evidence, Not Just a Score
Building FlakyDetector 0.2.2: Why Test Reliability Needs Evidence, Not Just a Score By Artem Alimpiev — Python Backend Developer and creator of Flak…
Playwright Email Tests Need Lease Expiry
A throwaway email address is useful in an end-to-end test because it keeps test mail away from real people. But an inbox that lives forever is not a…
When to pay for a reasoning model on a request
A reasoning model spends extra tokens before it answers. Send every request there and you pay latency plus a larger bill for lookups a standard mode…
From Test Failure to Root Cause: Building an AI-Assisted Playwright Debugging Pipeline
Automated testing helps engineering teams catch bugs before they reach production, but identifying a failure is only half the job. The real challeng…
Agent Patches Can Quietly Shrink Your Test Suite: Diff the Collected Inventory
Agent Patches Can Quietly Shrink Your Test Suite: Diff the Collected Inventory A patch that turns a red suite green by deleting, skipping, or narrow…
The Bug Is in the Files: Characterize Filesystem Side Effects Before a Messy Refactor
Conclusion first: in a messy repo, the refactor usually breaks files, not stdout. Teams write golden tests for console output. Almost nobody asserts…
Testing Idempotency, Webhooks, and Race Conditions in Payment APIs
Payment bugs do not always originate from a missing patch or weak password. Some appear when two requests arrive almost simultaneously, a callback i…
Firefox for Testing and Automation: geckodriver, Playwright, and CI Pipelines
Firefox is an excellent choice for automated testing and web scraping — it has official WebDriver support (geckodriver), a stable API, and unique fe…
Evidence Expires: A Fail-Closed Readiness Checklist with TTLs for Free-Tier AI Builds
A gate that passed last month is not a gate. It is a receipt for a system that no longer exists. That is the failure mode this checklist targets. Yo…
Your Staging Box Is Too Precious to Trust
The position Keep every environment you can delete with one command. A server you are afraid to nuke is already lying to you. That is the whole argu…
Myth FAQ: What a Free Dev Box Forgets Between Sessions
Yesterday my agent ran the test suite and everything passed. Today the same free dev box failed on a missing binary. No code changed. No lockfile ch…
Kubernetes CI: Lease Test Mailboxes, Don't Retry Blindly
Email verification tests become unreliable when the mailbox is treated like an ordinary HTTP dependency. A pipeline sends a message, waits a few sec…
OAuth Test Tenants Need Email Trust Boundaries
OAuth tests often stop at the redirect. That misses an important part of the trust story: what happens when a user must prove control of an email ad…
Your AI-built app works in the demo. But did the signup event actually reach GA4?
You vibe-coded a landing page with a lead form over a weekend. The demo works: you submit, you see the success toast, you move on. Two weeks later y…