Self-Hosted Databricks Alternative: Homelab Data Lakehouse (AI/ML Data Factory)
Self-Hosted Databricks Alternative: Homelab Data Lakehouse Part of the homelab build series. Trino, Apache Iceberg, Project Nessie, dbt, Spark, MLfl…
Testing & QA
⚑ Report a ProblemLatest Testing & QA news from Tech News
All topics
agents
ai
api
architecture
automation
backend
beginners
career
claude
cybersecurity
devchallenge
devops
discuss
javascript
llm
machinelearning
mcp
node
opensource
performance
productivity
programming
python
security
showdev
softwareengineering
testing
tutorial
typescript
webdev
Одно имя метрики, разные эксперименты: почему состав выборки надо хешировать
Рядом с метрикой принято хранить версию модели и версию данных, но этого мало. Правило отбора объектов в оценку расходится двумя способами: список и…
PPU Zhenwu 810E от Alibaba: как китайский AI-ускоритель справляется с LLM
Привет, я Дмитрий, MLOps-инженер в Selectel . Современный ландшафт AI-ускорителей изобилует всевозможными устройствами: GPU, TPU, NPU, LPU и п…
How Accurate Is Your Model Right Now? Estimating Accuracy Without Labels
Label-free accuracy estimation under data shift — and the monitoring sidecar that uses it. Scope note: two intent-classification datasets (Banking77…
Your AI Code Can Be Elegant Too
As the Machine Learning Engineering Manager at an AI-powered SaaS company, I get a front-row seat to the machine learning (ML) code written by data…
Зелёный пайплайн ничего не доказывает. Семь способов, которыми quality gate пропускает брак в прод
if roc_auc < 0.85: exit 1 — примерно так выглядит quality gate почти в каждом ML-пайплайне, который мне попадался. В обычном CI то же самое — кол…
My drift board learned to say "I don't know". Here is what it still cannot say.
Archival copy of record, committed before this post: https://github.com/Tania-coder/SEISMOGRAPH/blob/main/docs/reports/2026-09-22-weather-report-02.…
Ищем замену MinIO в условиях импортозамещения: опыт тестирования трех S3-совместимых хранилищ
Привет, я - Иван Засухин, DataOps Лаборатории искусственного интеллекта департамента больших данных Россельхозбанка. Мы одна из команд платформы RAI…
Moving Your Local Airflow to GCP for under $150 a month
My team runs ML training and prediction pipelines on Vertex AI. For a long time, the thing telling those pipelines when to run was Apache Airflow, i…
Owning vs. Renting Intelligence: Why Enterprises Are Building Sovereign AI
When Mythos went dark in June 2026, the reaction across the tech ecosystem wasn’t just disappointment. It was a collective chill down the spine of e…
CI said the deploy succeeded
There is a moment in every incident where someone asks "wait, is the fix even deployed?" and the room goes quiet. Somebody pulls up the CI dashboard…
Mastering LLM-as-Judge: Automated Annotation and Triage for Production AI Failures
Mastering LLM-as-Judge: Automated Annotation and Triage for Production AI Failures Every single time you push a new system prompt or swap out an und…
От 6 часов до 20 минут: как мы ускорили коллаборативную модель в рекомендациях Авито
Привет, я Салават Динмухаметов, senior ML-engineer в команде рекомендаций Авито . В статье расскажу, как мы изменили систему рекомендаций на главной…
MLOps Best Practices 2026
MLOps Best Practices 2026 {"title": "MLOps Best Practices 2026: Scaling AI from Prototype to Enterprise Production", "content": "### Introduction\n\…
Why LLM Cascades Fail for Interactive Apps — Use Router
Stop Defaulting to Cascades: Why Router-First Wins for Interactive Apps (LLM routing vs cascading) The question of "LLM routing vs cascading" is not…
Building a Production-Grade End-to-End MLOps Pipeline from Scratch
Building a Production-Grade End-to-End MLOps Pipeline from Scratch Most machine learning tutorials end at model.fit() . But in the real world, train…
18 Insights from Mass-Producing Voice Models — From Diffusion TTS Voice Design to Training Corpus Creation and Quality Gate Pitfalls
📝 Originally published (in Japanese) at forge.workstyle.tech . This is a record of designing voices from single-line captions, automatically creatin…
Migrating to Native Git in SageMaker Unified Studio
Version control in analytical data platforms has always been a second-class citizen — tolerated, not designed. SageMaker Unified Studio just changed…
LLMOps for RAG Systems — Production Checklist
Why the pipeline, not the model, is usually to blame If your LLM feature starts hallucinating or your inference bill doubles overnight, the model is…
Four bugs from building a platform where AI agents publish autonomously
I spent six weeks building a publication where AI agents write articles, an automated moderator approves or rejects them, and no human reviews anyth…
When Should You Retrain Your ML Model? A New Study Says Most Teams Are Solving the Wrong Problem
Every production ML model starts degrading the moment it ships. Customer behavior shifts, fraud patterns evolve, market conditions change — the tech…
I Reviewed 100 Reddit Threads About GPU Clouds. Price Was Only Part of the Story.
When engineers compare GPU clouds, the conversation usually starts with three familiar numbers: GPU model VRAM Hourly price Those numbers matter. Bu…
Deploying ClearML as a GCP Vertex AI Alternative on Ubuntu
Google Vertex AI is Google Cloud's managed ML platform with experiment tracking, training jobs, pipelines, a model registry, and endpoints, but it l…
Can your AI agent actually manage ML infrastructure?
I’ve spent enough time in production environments to know that 'chatting with an AI' is a useless metric if the AI can't touch the actual hardware o…
Summary — Your Next Steps as an AI Architect
What We Built in This Guide In the previous guide, we went from RAG to cloud deployment. In this guide, we systematically implemented everything nee…
Three weeks before the enterprise contract, the voice agent wasnt operator-ready.
Three weeks before the enterprise contract, the voice agent wasn't operator-ready Look. We had 99.2% uptime in staging. We had eval coverage on 1,40…
Deploying ClearML as an AWS SageMaker Alternative on Ubuntu
ClearML is an open-source MLOps platform that pairs experiment tracking, pipelines, hyperparameter optimisation, and model serving, a self-hosted al…
«Взрыв поверхности» или «вертикальный срез»: какой подход выбрать при построении MLOps-платформы?
Привет, Хабр! Меня зовут Кирилл Кулаков, я занимаюсь развитием MLOps-платформы в Uzum Fintech. Недавно у нас в команде разгорелся спор о том, как пр…
MLOps for LLM: A Case Study on Dresscode
I've recently participated in the Gemma 4 challenge here on DEV.to, but fell short compared to many amazing projects. I really liked LIKAS . I encou…
Never lose a training run again: a checkpoint-and-resume playbook for ephemeral GPUs
▶ Prefer to play with it? There's an interactive version of this article where you can break things yourself: https://resumable-ml-training.vercel.a…