2 Real World Azure Data Engineer Project End to End

Engineering Project Building from scratch including designing, architecting, implementing solution and overall testing.
4.53 (1158 reviews)
Udemy
platform
English
language
Data Science
category
instructor
2 Real World Azure Data Engineer Project End to End
10,048
students
7 hours
content
Sep 2022
last update
$64.99
regular price

What you will learn

You will learn how to Architect, Design and build a real-world enterprise level data platform solution including multiple services.

You will learn design solution using ADF, Azure Function, Databricks, pyspark, Azure Data lake storage Gen 2 (ADLS), Azure SQL Server

You will learn how to build a real-world data pipeline in Azure Data Factory (ADF). This course has been taught using 2 real world use case scenarios.

You will learn how to transform data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

You will learn how to build production ready pipelines and good practices and naming standards

You will learn how to integrate Databricks with ADF and send the response back from Databricks to ADF

You will learn how to develop the triggered based Azure Function to validate files.

You will learn how to create Azure Key vault and use it to store secret credentials and SAS token

You will learn how to connect the Azure SQL Database and Databricks cluster using the Key Vault

You will learn how to mount he Azure Storage Account in the Databricks to access the files and preform transformation on it.

You will learn how to transform the data in the Azure Databricks using the pyspark.

Screenshots

2 Real World Azure Data Engineer Project End to End - Screenshot_012 Real World Azure Data Engineer Project End to End - Screenshot_022 Real World Azure Data Engineer Project End to End - Screenshot_032 Real World Azure Data Engineer Project End to End - Screenshot_04
4516416
udemy ID
1/26/2022
course created date
3/22/2022
course indexed date
Bot
course submited by
2 Real World Azure Data Engineer Project End to End - | Comidoc