Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
1 Hour(s) 54 Minute(s)
Language
English
Taught by
Darren Cox
Rating
2 views
Course Overview
Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.
The purpose of this class is to demonstrate a proof of concept using a series of lab exercise's (in the AWS Console using AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK, with C# code using the AWS SDK) of building a Data Lake in the AWS ecosystem.
In this class, we will be sending data from a local SQL Server database to AWS RDS securely, and automatically.
I am utilizing the .NET SDK for AWS, however, this could easily be migrated to your language of choice once you understand the concepts that I am teaching.
I will be providing the full working source code of this proof of concept.
I will also provide a working example of creating Parquet files and sending to S3 (without using Firehose).
Course Content
- 7 section(s)
- 16 lecture(s)
- Section 1 Introduction
- Section 2 Overview of AWS Web Services in a Data Lake
- Section 3 AWS RDS and S3
- Section 4 AWS Kinesis Firehose, C# and the AWS SDK
- Section 5 AWS Glue, Athena, ETL jobs, Triggers, and using Hangfire
- Section 6 AWS Lake Formation, Cognito and Parquet .NET
- Section 7 Final thoughts and advice
What You’ll Learn
- How to build a Data Lake using Firehose API for .NET, S3, AWS Glue and Athena
Reviews
-
AAnuja Kimbahune
It is very helpful course and provides some knowledge which is helpful for real time scenarios.
-
CCaitlin Hope
Good for overview of Data Lakes and services needed.
-
AAbhishek Munnoli
good
-
MMarta Varela
Información muy escasa
