DSCI series / Rakulang CI, part2. Cro Application
In this episode I talk about developing web application based on well known cro framework and specifically how to create CI pipeline using DSCI tool. …
Testing & QA
⚑ Report a ProblemLatest Testing & QA news from Tech News
All topics
agents
ai
api
architecture
automation
aws
backend
beginners
career
claude
cybersecurity
database
devchallenge
devops
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
security
showdev
softwareengineering
testing
tutorial
typescript
webdev
Testing Non-Deterministic LLM Pipelines in CI: A Contract-Based Approach
Most CI pipelines assume a function called with the same input twice returns the same output. That assumption breaks the moment an LLM call enters you…
The Test That Only Failed in CI, Never Locally
A test checking that a scheduled reminder appeared on the right day passed every time I ran it on my machine and failed every time it ran in CI, with …
Stop pushing to test your CI YAML
The worst CI loop is still: edit YAML → commit → push → wait → typo → repeat. Full emulators like act help, but often you only need to run the shell s…
A Flaky Test Is a Corrupted Reward Signal
Originally published at tddbuddy.com . Related reading: Agents Should Do TDD names why faithful execution of the loop matters; Your Test Suite Is Your…
TRUE Coverage: How We Achieved 90% Faster CI by Measuring What Tests Actually Do
TL;DR: Use per-test coverage data to build a reverse map (file → tests that touch it). Git diff + map lookup = run only relevant tests. 43min → 4min C…
logsnip: cut CI noise, keep the stack traces
Cut the noise. Keep the stack traces. CI logs are mostly package installs. The failure is a few dozen lines buried under thousands of Downloading… lin…
CI Health Check: a /ci Skill for Claude Code
By Hudson Atwell , GBTI Network Member. Originally published on gbti.network . Claude Code loads any markdown file at .claude/skills/<name>/SKIL…
Как я построил систему, внутри которой AI пишет код
Последние полгода я почти не пишу код руками. Вместо этого я проектирую инженерную систему, в которой AI пишет код, а Git, тесты, CI, агенты и правила…
Your AI makes CI green by cheating. I built three GitHub Actions to stop it.
All your checks are green. Before you merge, one question worth asking: is it green because the code was fixed, or because the checker was silenced? T…
Night of the Living Bugs
from https://www.kmwebdev.me/blog/night-of-the-living-bugs At 4 AM, the CI pipeline wasn’t broken. It was confused. What I thought was a simple automa…
91% pass rate. Gate green. Shipped. Worst regression we had all quarter.
The gate was a fixed 90% threshold on an intent-classification eval. The change came in at 91%, cleared the bar, went out. A fixed pass-rate gate catc…
Как забытые JVM ломали наш CI (и как мы это починили)
Привет, Хабр! Меня зовут Александр Чесноков, я разработчик команды Platform V DataGrid в СберТехе. Наш продукт – форк Apache Ignite с нашими доработка…
Green CI proves nothing failed. Here's a deterministic check that proves nothing regressed.
Your CI is green. The PR merges. Prod breaks anyway. A passing test suite proves exactly one thing: no test that exists, failed. It does not prove tha…
Testing Neovim in a Container with Finch (like Docker)
So developers like CI... for everything! We do this because we like things to be automated. Building software is tedious and risky. If we can push a c…
"Autonomous coding agents don't break in the middle, they break at the seams"
After running AI coding agents in production for a while, one thing became clear: the failures aren't in the code the model writes. They're at the sea…
Switching our LLM-as-judge from 5-class to binary in CI: the patterns we kept
A few months back our LLM-as-judge ran on a 1-to-5 helpfulness scale. The CI gate stayed green because we were averaging that score. Spot-checking aga…
Your CI Pipeline Is Lying to You — 5 Signals You're Ignoring (And How to Fix Them)
Your CI pipeline is green. Deployments go through. The team ships features on time. Everything looks fine. But look closer. That "green" pipeline is a…
What if your CI was just code? Workflows, a typed platform, and a model one function away
Originally published at plain.jxd.dev/blog/ci . Cross-posted here for the dev.to community — the canonical version (and any future updates) lives on t…
Why green CI doesn't mean your system works
A case study: how a TypeScript migration doubled my test runs — with zero failures CI was green. Tests were passing. PRs were merging. The system was …
The Agentic Bottleneck: Why We Need to Rethink CI
Cross-posted from carrick.tools . The agentic development cycle has completely upended traditional software engineering practices. Teams are looking t…
Are you really doing CI/CD?
No. There's no such thing as 'CI/CD'. CI and CD are two distinct things, and you're probably not doing them either. This is Part 1: how to actually do…
Braintrust Autoevals: CI Gates for LLM Regressions
LLM applications need a different kind of regression test. Unit tests can tell you whether a function returns a value, but they do not tell you whethe…
Fifteen lines of Proxy to keep an SDK from breaking my CI
The Friday Vercel refused my merge Friday April 10th, late afternoon. I merge to main a Stripe integration that opens a payment webhook endpoint. Verc…