- Quick Note:
- By purchasing courses through links on our site, we may receive an affiliate commission.
Course Information
Registration period*
Year-round Recruitment
Course Level
Study Mode
Duration
1 Hour(s) 54 Minute(s)
Language
English
Taught by
Darren Cox
Rating
*Note: The schedule above is for reference only. Please refer to the course provider's website for the schedule.
Course Overview
Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.
The purpose of this class is to demonstrate a proof of concept using a series of lab exercise's (in the AWS Console using AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK, with C# code using the AWS SDK) of building a Data Lake in the AWS ecosystem.
In this class, we will be sending data from a local SQL Server database to AWS RDS securely, and automatically.
I am utilizing the .NET SDK for AWS, however, this could easily be migrated to your language of choice once you understand the concepts that I am teaching.
I will be providing the full working source code of this proof of concept.
I will also provide a working example of creating Parquet files and sending to S3 (without using Firehose).
Course Content
- 7 section(s)
- 16 lecture(s)
- Section 1 Introduction
- Section 2 Overview of AWS Web Services in a Data Lake
- Section 3 AWS RDS and S3
- Section 4 AWS Kinesis Firehose, C# and the AWS SDK
- Section 5 AWS Glue, Athena, ETL jobs, Triggers, and using Hangfire
- Section 6 AWS Lake Formation, Cognito and Parquet .NET
- Section 7 Final thoughts and advice
What You’ll Learn
- How to build a Data Lake using Firehose API for .NET, S3, AWS Glue and Athena
Reviews
-
AAnuja Kimbahune
It is very helpful course and provides some knowledge which is helpful for real time scenarios.
-
CCaitlin Hope
Good for overview of Data Lakes and services needed.
-
AAbhishek Munnoli
good
-
MMarta Varela
Información muy escasa
