Project Overview

Goal:

First goal: Learn the basics of different Azure services related to data engineering and how to set them up efficiently via scripts.

Last goal: Set up deployment that allows live interaction from users. Learn about cost savings and maximize use of free tier services to minimize cost to self.

Implementation: Using Bicep(Language used to create templates for Azure deployments) create a data lake to ingest the space news csv. Create a word cloud to prove that deployment has succeeded.

Services: Data Factory

Features to add after initial infrastructure template is created: Ability to set whether it is deployed to a test or production environment.