Amitosh

← Back to all talks

Testing Data Pipelines

PyCon US 2024 📅 May 18, 2024 📍 Pittsburgh, USA

Practical approaches for testing data pipelines with Airflow as the example framework. Covers unit tests, integration tests, end-to-end testing, data snapshot testing, and data quality validation methods for both online and offline scenarios. These strategies apply across different pipeline tools, not just Airflow.

Python Testing Data Engineering Airflow
Slide
1 / 1