Serverless Data Engineering - AWS Glue, Kinesis, Lambda

Batch & Stream Processing using AWS Serverless Technologies

Data Engineering! It is a big word in today's tech world. Every organization is running behind data engineers and as per analysis one of the jobs that would be untouched by AI wave. It is also one of the highest paying jobs in tech world. There are multiple technologies, frameworks, tools that facilitate Data Engineering stack. Spark, Kafka, Lakehouse, Data Warehouse etc. are some of those.

All Cloud Service Providers have complete Data Stack up their sleeve. AWS, Azure, GCP provide multiple platforms to work on data stack. One interesting stack is Serverless, a term coined by AWS with the launch of AWS Lambda.

This course focuses specifically on Serverless Data Processing, which has gained a lot of momentum over the years. AWS is the top contender in the serverless world that includes batch & stream processing. This course entails the following topics:

1. Serverless Batch Processing Part 1 - AWS Glue

2. Streaming Ingestion - Kinesis Data Streams, Kinesis Firehose

3. Serverless Stream Processing Part 1 - AWS Glue & Kinesis

4. Serverless Batch Processing Part 2 - AWS Lambda

5. Serverless Stream Processing Part 2 - Lambda & Kinesis

Make sure to complete the practice exercises as they will give you hands-on experience. Also, request candidates to follow along with all the hands-on labs.