Tag: Airflow
-
Tools: Prometheus, Grafana, Airflow sensors
Prometheus, Grafana, and Airflow sensors form the core of modern observability and orchestration in data engineering. This post explores how these tools interact, with practical examples, integration strategies, and best practices for building reliable, metrics-driven data pipelines.
-
Empirical: Airflow vs Prefect performance comparison
This empirical benchmark compares Apache Airflow and Prefect in real-world orchestration scenarios. Through detailed performance testing, it reveals how each handles scalability, latency, and fault recovery under heavy workloads in 2025 environments.