Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE
-
Updated
Dec 19, 2022 - Python
Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE
Enterprise-grade Data Platform for NYC Taxi Analytics. Orchestrated with Airflow (Astro) & dbt, served via FastAPI & Power BI. Features Medallion Architecture, Data Quality Observability (Slack), and Star Schema modeling.
ETL Pipeline using Apache Airflow, PostgreSQL, and NASA API
Add a description, image, and links to the astro-airflow topic page so that developers can more easily learn about it.
To associate your repository with the astro-airflow topic, visit your repo's landing page and select "manage topics."