Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE
python shell docker infrastructure instagram data-science machine-learning airflow environment spark etl data-engineering travis daas elt dag etl-pipeline etl-job etl-jobs astro-airflow
-
Updated
Dec 19, 2022 - Python