Build a 10-Case Eval Set for Your AI Agent and Run It on Every Change
Your agent worked in the demo. Then you tweaked the system prompt, swapped the model, or renamed a tool argument, and now you're not sure whether it…
Team Management
⚑ Сообщить о проблемеПоследние новости Team Management от Tech News
Все темы
Culture
agents
ai
api
architecture
automation
beginners
career
devchallenge
devops
discuss
javascript
learning
llm
machinelearning
mcp
opensource
productivity
programming
python
react
saas
security
showdev
softwareengineering
startup
testing
tutorial
typescript
webdev
The Portability Audit Take-Home: Grade Environment Assumptions, Not Features
A take-home that runs on the reviewer's laptop grades features; a take-home that runs anywhere grades engineering discipline. The task below asks a…
The Cold-Start Budget Packet: A Take-Home Where the Free Server Is Allowed to Vanish
A take-home that never simulates a host restart measures almost nothing about cost discipline. The packet below asks one question: after the machine…
Building FlakyDetector 0.2.2: Why Test Reliability Needs Evidence, Not Just a Score
Building FlakyDetector 0.2.2: Why Test Reliability Needs Evidence, Not Just a Score By Artem Alimpiev — Python Backend Developer and creator of Flak…
Your Staging Box Is Too Precious to Trust
The position Keep every environment you can delete with one command. A server you are afraid to nuke is already lying to you. That is the whole argu…
AI-Generated Tests Can Agree With the Bug
An AI coding agent implements a feature, generates tests, runs them, and opens a pull request with a green build. That looks like independent verifi…
The Illusion of 100% Test Automation: Why Synthetic Test Suites Fail at Real-World Edge Cases
Somewhere in modern software culture, an unwritten dogma took hold: If it isn't automated in your CI/CD pipeline, it doesn't count. Engineering lead…
TypeScript Email Tests Need a Signal Pipeline
Email verification tests often become slow for a reason that is easy to miss: every test knows too much about the inbox. One test starts a poll. Ano…
Cypress Email Tests Need a Clear Handoff
Email tests usually fail at the point where a browser action becomes an inbox observation. Cypress clicks Create account , the application says it s…
CI vs CD: Passing Tests Is Only Part of Shipping Software
Your code builds. The tests pass. But releasing it still involves copying files, changing settings, and hoping you remembered every step. That gap i…
Testing a Python Backend: Unit, Integration, and Service Tests
How do you test a backend that accepts both HTTP requests and AMQP messages? I tested the same application through both interfaces, using a real tes…
Separate the Spec from the Scratch Pad
You open the take-home on a Thursday night. The README is smooth. A demo script prints three green lines, and a note at the bottom says a model "han…
I tested two agent rules before shipping them. One was needed, one was not.
Most rule files for coding agents are written the same way: something goes wrong, you add a sentence telling the agent not to do it again, and the f…
AI Agents for Automated Test Generation and Execution
Spending cycles manually writing tests, or constantly updating brittle automation, can feel like a Sisyphean task. We know comprehensive testing is…
5 C# DateTime bugs that pass every test
Date and time bugs are the worst kind: the code is correct on the day you test it, in the time zone you test it in. Then the clocks change, or a use…
Sinete: a 2-player bluffing card game in Godot 4.6, and what I learned making it (looking for Android testers)
I'm Rapha, a solo dev from Brazil. Sinete is a 2-player bluffing card game made in Godot 4.6, and it's in closed testing on Google Play right now. I…
We're building automated website QA checks and reinventing the wheel — what are the established methods?
I’ll be honest: we’re building our own automated QA system for checking website pages (structure, styling, visual consistency) and I suspect we’re r…
Move the Box, Keep the Contract
You send the take-home on Friday. By Sunday the candidate has not touched the bug. They are still hunting a model key that will not 402. The packet…
Evidence-Driven Development: Give Your Coding Agent Something to Prove
An AI coding agent finishes the feature. The tests pass. The explanation sounds reasonable. Then someone asks a small question: “What happens if I r…
A Parser Contract Before Free Agent Compute Joins the Release Path
I would not keep free agent compute on a release path until a schema swap drill still passes on a fallback seat. A low invoice does not prove that y…
Put a Meter in the Take-Home
You open the submission on a Monday and the README still has a public URL in it. The health check answers. A debug header sits in the response, chee…
Running Playwright in GitHub Actions: named checks, sharding, one merged report, and a flakiness policy
A test pipeline has one job: give the team a fast signal it can trust. When a pull request goes red, the author should know what broke without openi…
Your Verifier Is a Confident Liar
The official judge said the agent succeeded 74% of the time. A better verifier said 38%. That gap — almost double the reported success rate — is not…
Shipping practices from five AI engineering episodes
A demo is cheap. Shipping it means you can say what you reviewed, what you designed, what you measured, and who owns production when the model is wr…
Trying e2e: Write End-to-End Tests with Plain English and Real Assertions
End-to-end tests are valuable and painful in equal measure. Selectors break when someone renames a class. Mobile tests need their own tooling. A flo…
Can AI Agents Actually Use Your Website? I Built a Tool to Find Out
AI agents are getting better at using websites, but there is still a basic question that is surprisingly difficult to answer: Can an AI agent actual…
The Real Challenges of Testing Android Apps Across Devices
The hardest part of shipping an Android app is not building it; it’s making sure it works on the thousands of devices your users actually own. An ap…
Making voice-agent failures reproducible with Python
A voice agent can answer correctly and still make a conversation frustrating. It can wait too long before replying, keep speaking after an interrupt…
AI code review in CI when tests pass but design fails
My coding agent can write a feature, add tests, and hand me a green build. It can also put the right behavior in the wrong place. The application wo…
I built a Chrome extension that turns bug reproductions into Playwright test drafts
A bug report often says “this button broke,” but the steps that caused it get lost. I built QA Bug → Regression Test to capture one manual bug repro…