2 Real World Azure Data Engineer Project End to End
Engineering Project Building from scratch including designing, architecting, implementing solution and overall testing.
4.53 (1158 reviews)
10,048
students
7 hours
content
Sep 2022
last update
$64.99
regular price
What you will learn
You will learn how to Architect, Design and build a real-world enterprise level data platform solution including multiple services.
You will learn design solution using ADF, Azure Function, Databricks, pyspark, Azure Data lake storage Gen 2 (ADLS), Azure SQL Server
You will learn how to build a real-world data pipeline in Azure Data Factory (ADF). This course has been taught using 2 real world use case scenarios.
You will learn how to transform data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
You will learn how to build production ready pipelines and good practices and naming standards
You will learn how to integrate Databricks with ADF and send the response back from Databricks to ADF
You will learn how to develop the triggered based Azure Function to validate files.
You will learn how to create Azure Key vault and use it to store secret credentials and SAS token
You will learn how to connect the Azure SQL Database and Databricks cluster using the Key Vault
You will learn how to mount he Azure Storage Account in the Databricks to access the files and preform transformation on it.
You will learn how to transform the data in the Azure Databricks using the pyspark.
Screenshots
Related Topics
4516416
udemy ID
1/26/2022
course created date
3/22/2022
course indexed date
Bot
course submited by