My 10-Minute Airflow Pitch Approach
"Good Morning, can you check if the pipelines ran successfully?". A sentence that probably many of us know or heard a few times before. But, wouldn't …
Tech news from the best sources
"Good Morning, can you check if the pipelines ran successfully?". A sentence that probably many of us know or heard a few times before. But, wouldn't …
We recently finished upgrading a production Airflow instance from 2.8 to 3.1 running on Amazon EKS . The whole thing took about 6 weeks from planning …
When stepping into the world of data engineering, Apache Airflow is likely one of the first tools you will encounter. It is the industry standard for …
Introduction In data engineering we build data pipelines using approaches such as ETL(extract, transform, load) and ELT(extract, load, transform). The…