Spark Streaming - Stream Processing in Lakehouse - PySpark

Master Spark Structured Streaming using Python (PySpark) on Azure Databricks Cloud with a end-to-end Project
4.69 (1642 reviews)
Udemy
platform
English
language
Data Science
category
Spark Streaming - Stream Processing in Lakehouse - PySpark
17,111
students
22.5 hours
content
Aug 2024
last update
$74.99
regular price

What you will learn

Real-time Stream Processing Concepts

Spark Structured Streaming APIs and Architecture

Working with Streaming Sources and Sinks

Kafka for Data Engineers

Working With Kafka Source and Integrating Spark with Kafka

State-less and State-full Streaming Transformations

Windowing Aggregates using Spark Stream

Watermarking and State Cleanup

Streaming Joins and Aggregation

Handling Memory Problems with Streaming Joins

Working with Azure Databricks

Capstone Project - Streaming application in Lakehouse

Screenshots

Spark Streaming - Stream Processing in Lakehouse - PySpark - Screenshot_01Spark Streaming - Stream Processing in Lakehouse - PySpark - Screenshot_02Spark Streaming - Stream Processing in Lakehouse - PySpark - Screenshot_03Spark Streaming - Stream Processing in Lakehouse - PySpark - Screenshot_04
Related Topics
3460790
udemy ID
8/30/2020
course created date
9/26/2020
course indexed date
Bot
course submited by