In this repository, I implemented a simple ETL via Python and SQL. I got inspired by the LinkedIn Learning Course "ETL in Python and SQL". I followed these steps:
- Load data from Excel and transform it into Pandas DataFrame.
- Load Pandas DataFrame into SQL DB.
- Automate it via Airflow.
load_data.py
loads the customers
and employees
manually while Airflow dags orders_dag.py
and products_dag.py
load orders
and products
automatically.