Course Description
In this course, students will build upon their existing knowledge of Apache Spark, Structured Streaming, and Delta Lake to unlock the full potential of the data lakehouse by utilizing the suite of tools provided by Databricks. This course places a heavy emphasis on designs favoring incremental data processing, enabling systems optimized to continuously ingest and analyze ever-growing data. By designing workloads that leverage built-in platform optimizations, data engineers can reduce the burden of code maintenance and on-call emergencies, and quickly adapt production code to new demands with minimal refactoring or downtime.
The topics in this course should be mastered prior to attempting the Databricks Certified Data Engineer Professional exam.
Advanced Data Engineering Outline
- Spark Core and reading Spark UI
- Working on the Cloud Vendors and Version Control
- Automate Production Workflows
- Delta Lake
- Delta Live Tables
- Managing Permissions
- Labs
Course Summary
| Next Public Course Dates | |
| Duration |
|
| Prerequisites |
|
| Available Formats |
|
| Audience |
|
Course Modules
Advanced Data Engineering
- Spark Core and reading Spark UI
- Working on the Cloud Vendors and Version Control
- Automate Production Workflows
- Delta Lake
- Delta Live Tables
- Managing Permissions
- Labs
Testimonials
“ExistBI, Thank you again for the great Microsoft Power BI, PowerApps and Power Automate courses, our team was very happy”
- Kerry Urofsky, Systems Manager, Service, Avantik
“Instructor was very passionate about the subject and definitely helped me to stay engaged. Great pace, great knowledge, and instructor was amazing overall :) ”
- John Smith, Analyst, Dept. of Homeland Security
The trainers clear and obvious enthusiasm for number crunching, analytics, and teaching others is infectious. He doesn’t waste time, shows exactly what you need to know and is genuinely hilarious.
Every one of my employees had tons of positive stuff to say.
- Benjamin G, MXSG Analysis and Integration Chief, US Air Force
