Skip to content

parveenkrraina/WNS-B2

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
databricks
databricks
 
 
mid-training-task/poscsv
mid-training-task/poscsv
 
 
problem_statements/python
problem_statements/python
 
 
project_case_study
project_case_study
 
 
python_code
python_code
 
 
wwi-02
wwi-02
 
 
ADF Pipeline.pdf
ADF Pipeline.pdf
 
 
Data Engineering on Azure by Vlad Riscutia.pdf
Data Engineering on Azure by Vlad Riscutia.pdf
 
 
Installing Java_Scala_Spark on Windows 10_11.pdf
Installing Java_Scala_Spark on Windows 10_11.pdf
 
 
PySpark.pdf
PySpark.pdf
 
 
Python Basics A Practical Introduction to Python 3 by David Amos, Dan Bader, Joanna Jablonski, Fletcher Heisler.pdf
Python Basics A Practical Introduction to Python 3 by David Amos, Dan Bader, Joanna Jablonski, Fletcher Heisler.pdf
 
 
README.md
README.md
 
 
SQL equivalent in Python(pandas) and Spark.pdf
SQL equivalent in Python(pandas) and Spark.pdf
 
 
Think Python.pdf
Think Python.pdf
 
 
WNS DE Day-1.png
WNS DE Day-1.png
 
 
WNS DE Day-10.png
WNS DE Day-10.png
 
 
WNS DE Day-11.png
WNS DE Day-11.png
 
 
WNS DE Day-12.png
WNS DE Day-12.png
 
 
WNS DE Day-13.png
WNS DE Day-13.png
 
 
WNS DE Day-14.png
WNS DE Day-14.png
 
 
WNS DE Day-15.png
WNS DE Day-15.png
 
 
WNS DE Day-16.png
WNS DE Day-16.png
 
 
WNS DE Day-17.png
WNS DE Day-17.png
 
 
WNS DE Day-18.png
WNS DE Day-18.png
 
 
WNS DE Day-19.png
WNS DE Day-19.png
 
 
WNS DE Day-2.png
WNS DE Day-2.png
 
 
WNS DE Day-20.png
WNS DE Day-20.png
 
 
WNS DE Day-3.png
WNS DE Day-3.png
 
 
WNS DE Day-4.png
WNS DE Day-4.png
 
 
WNS DE Day-5.png
WNS DE Day-5.png
 
 
WNS DE Day-6.png
WNS DE Day-6.png
 
 
WNS DE Day-7.png
WNS DE Day-7.png
 
 
WNS DE Day-8.png
WNS DE Day-8.png
 
 
WNS DE Day-9.png
WNS DE Day-9.png
 
 
diabetes.csv
diabetes.csv
 
 
example-02.ipynb
example-02.ipynb
 
 
sales_data_2022_Q2_June.csv
sales_data_2022_Q2_June.csv
 
 

Repository files navigation

Azure Data Engineering Repository

Welcome to the Azure Data Engineering! This repository is designed to be your one-stop shop for all materials, code examples, and resources related to our journey through the world of Data Engineering. Whether you're a beginner or someone looking to brush up on your skills, this repository will provide you with everything you need to master the essentials.

Contents

1. Azure Data Engineering

  • Overview of Azure Services: Introduction to key Azure services relevant to data engineering, including Azure Data Lake, Azure Synapse, and Azure Databricks.
  • Hands-on Labs: Practical exercises and examples to help you deploy, manage, and optimize data pipelines on Azure.

2. SQL for Data Engineers

  • SQL Basics: Review of foundational SQL concepts, including SELECT statements, joins, and subqueries.
  • Advanced SQL Techniques: Dive into more complex queries, optimization strategies, and SQL in the context of big data.

3. Python for Data Engineering

  • Introduction to Python: Basics of Python programming, including data types, control structures, and functions.
  • Data Manipulation with Pandas: Learn how to use Pandas for data manipulation, cleaning, and analysis.
  • Data Pipelines: Building and automating data pipelines using Python.

4. PySpark for Big Data

  • Introduction to PySpark: Overview of PySpark and its role in big data processing.
  • Data Processing with PySpark: Learn how to use PySpark for distributed data processing, including working with RDDs and DataFrames.

5. Additional Topics

  • ETL Processes: Understanding ETL (Extract, Transform, Load) processes and best practices for implementing them.
  • Data Lakes and Warehouses: A comparative study of data lakes vs. data warehouses and their respective use cases.

6. DP-203 Labs

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

3 stars

Watchers

2 watching

Forks

13 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages