Programming — Tech News

dbt Is Leaving the Warehouse. Are Your Pipelines Ready?

dbt built the modern analytics workflow. Now the transformation layer is moving upstream — and the gap between SQL models and runtime execution is b…

dbt realtime streamingdata dataengine

In this article I'll show you how a dbt incremental model that looked perfectly reasonable wiped out three months of finance data, why none of our c…

dbt snowflake dataengineering sql

I built a small warehouse, fed it a batch of orders with twelve defects planted in it, and watched the load succeed. Every row landed. Summed as loa…

dataengineering dbt dataquality python

I was building a tool that detects when data quietly changes meaning — a vendor switching units, a source dropping a field, an undocumented enum app…

dataengineering python testing dbt

I once inherited a dbt project where the same "active customer" filter existed in four different models, each written slightly differently. Two of t…

dataengineering dbt sql analytics

A few days ago I posted about zhao-cli , a breaking-change gate for dbt (link at the bottom if you missed it). This is the second tool in the same f…

dbt rust opensource dataengineering

I've spent more than a decade building data pipelines, and the part nobody warns you about isn't the pipeline logic. It's the tuning. Executor memor…

Building an OpenSky Flight Data Pipeline with dbt Core Recently, I built an OpenSky Flight Data Pipeline that ingests aircraft state vectors into Po…

data dbt sql

Hello everyone! Following up on my previous post , Day 1 of my Modern Data Stack migration was an absolute rollercoaster of refactoring and deep dat…

dataengineering python dbt architecture