Spike/argocd demo

[maltesander]

ArgoCD demo depolying stackable operators and airflow.

What it does:

• Stack ArgoCD
  • sealed secrets controller (https://github.com/bitnami-labs/sealed-secrets)
  • deploys all operators via applicationset
  • generated tls certs for sealed secrets
• GitOps demo based using airflow, deployed via ArgoCD
  • deploy minio for airflow kubernetes executor logs
  • gitsync to fetch dags
  • automatically deploy minio connection to airflow
  • all secrets sealed
  • deploy airflow DAG via UI

Clone the demos repo and checkout the branch spike/argocd-demo and run

stackablectl demo install argo-cd-git-ops -n argo-cd -s stacks/stacks-v2.yaml -d demos/demos-v2.yaml

or for custom repo to sync changes via argo (demo fork)

stackablectl demo install argo-cd-git-ops -n argo-cd -s stacks/stacks-v2.yaml -d demos/demos-v2.yaml --parameters customGitUrl=https://github.com/maltesander/demos --parameters customGitBranch=spike/argocd-demo

I currently port forward the argocd-server and airflow webserver. In the airflow webUI you can start the pyspark job manually.

Feedback would be very welcome :)

Edit - Notes:

• Airflow does not offer https for the web ui currently. Thats the only part not properly encrypted in this demo.

[adwk67]

LGTM! Just minor things.