Skip to content

Latest commit

 

History

History
24 lines (18 loc) · 587 Bytes

README.md

File metadata and controls

24 lines (18 loc) · 587 Bytes

Airflow data pipeline to automate ETL

ETL-E-verified-Employer is linked as a submodule to this automation project. 

Installation (Raspberry pi setup)

1. Setup Airflow home directory
	export AIRFLOW_HOME = /path/to/my_airflow_directory

2. Install py package 
	pip install apache-airflow

3. Initialize SQLite DB
	airflow db init
	
4. Setup admin user
	airflow users create \
	  --username admin \
	  --firstname FIRST_NAME \
	  --lastname LAST_NAME \
	  --role Admin \
	  --email [email protected]
	  
5. Execute
	airflow webserver -p 8080 & airflow scheduler