This talk will discuss why and how to use dbt Core and Apache Airflow, open-source tools that support the development of data pipelines.

On the one hand, dbt is an extremely valuable tool for analytics engineers to build data transformation pipelines with SQL. On the other hand, Apache Airflow is a consolidated orchestration platform that supports the development, scheduling, and monitoring of batch-oriented workflows written in Python.

This talk discusses the benefits and reasons to use these two tools and a few approaches to integrate them, including using the open-source library Cosmos: https://github.com/astronomer/astronomer-cosmos