Course Description
ExistBI provides this 3-day Data Engineering Integration course to assist Developers learn to accelerate Data Engineering Integration through mass ingestion, incremental loads, transformations, processing of complex files, creating dynamic mappings, and integrating data science using Python. Optimize the Data Engineering system performance through monitoring, troubleshooting, and best practices while gaining an understanding of how to reuse application logic for Data Engineering use cases.
Course Outcomes
At the end of the course, learners will be able to:
- Mass ingest data to Hive and HDFS
- Perform incremental loads in Mass Ingestion
- Perform initial and incremental loads
- Integrate with relational databases using SQOOP
- Perform transformations across various engines
- Execute a mapping using JDBC in Spark mode
- Perform stateful computing and windowing
- Process complex files
- Parse hierarchical data on Spark engine
- Run profiles and choose sampling options on Spark engine
- Execute Dynamic Mappings
- Create Audits on Mappings
- Monitor logs using REST Operations Hub
- Monitor logs using Log Aggregation and troubleshoot
- Run mappings in Databricks environment
- Create mappings to access Delta Lake tables
- Tune performances of Spark and Databricks jobs
Course Summary
| Next Public Course Dates | |
| Prerequisites | |
| Duration |
|
| Available Formats |
|
| Audience |
|
Course Modules
Informatica Data Engineering Management Overview
- Data Engineering concepts
- Data Engineering Management features
- Benefits of Data Engineering Management
- Data Engineering Management architecture
- Data Engineering Management developer tasks
- Data Engineering Integration 10.4 new features
Testimonials
“We just finished the course and I’d like to say that Basem was an excellent teacher. I will definitely recommend your company and him in the future”
- Renee Dansereau, Senior Analyst, AXA XL
“Your private Tableau Desktop Bootcamp I for Beginners training was excellent, our 15 staff members thoroughly enjoyed it!”
- David Sonntag, US Airforce
“Mahesh was an EXCELLENT trainer. Very gifted instructor. Able to clearly communicate and teach objectives. Very engaging made you want to keep learning, and was so patient and kind to all students. Would love to be taught by him anytime.
- Jackie Calvo, Quality Improvement Manager, Horizon Health Center
