Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
10 Hour(s) 0 Minute(s)
Language
English
Taught by
Prashant Kumar Pandey, Learning Journal
Rating
Course Overview
Master Apache Spark Programming in Python (PySpark) Using Databricks Free Edition - Recreated for 2026
This course does not require any prior knowledge of Apache Spark or Hadoop. We have taken sufficient care to explain the fundamental concepts of Spark, helping you come up to speed and grasp the content of this course.
About the Course
I am creating the PySpark - Apache Spark Programming for Beginners course to help you understand Spark programming and apply that knowledge to build data engineering solutions. This course is example-driven and follows a working session-like approach. We will take a live coding approach and explain all the necessary concepts along the way.
Who should take this Course?
I designed this course for software engineers willing to develop a Data Engineering pipeline and application using Apache Spark. I am also creating this course for data architects and data engineers who are responsible for designing and building the organisation’s data-centric infrastructure. Another group of people is the managers and architects who do not directly work with Spark implementation. Still, they work with the people who implement Apache Spark at the ground level.
Spark Version used in the Course
This Course is using Apache Spark 4.1. I have tested all the source code and examples used in this Course on Apache Spark 4.1 in the Databricks environment.
Course Content
- 10 section(s)
- 104 lecture(s)
- Section 1 Understanding Big Data and Distributed Data Processing
- Section 2 Introduction to Apache Spark
- Section 3 Getting Started with Spark Programming
- Section 4 Spark Data Types and Schema
- Section 5 Dataframe Transformations
- Section 6 Working with different data types
- Section 7 Joins in Spark Dataframe
- Section 8 Aggregations in Spark Dataframe
- Section 9 UDF and Unit Testing
- Section 10 Spark On Your Laptop IDE
What You’ll Learn
- Apache Spark Programming in Python (PySpark)
- Spark Programing in Databricks Free Account
- Working with Data Frames Transformations and Actions
- Handling Schema and working with different data types
- Working with Complex Data Types, Aggregation, Joins and UDF
- Working with Data Sources and Sinks
- Unit Testing and Data Engineering Techniques
Reviews
-
BBharat Singh
This is a very detailed course for beginners. I have been trying to learn Spark for the last two to three years, but due to its complexity and lack of clear direction, I was not able to complete it. However, I can now say that this course is a complete and well-structured package. I am now comfortable working with Spark. I have studied all the new and archived chapters. One request: please add more project-based content, such as capstone projects.
-
SSrivatsan Mohan
very well explained and good examples
-
MMaraka Niranjan Reddy
Being a beginner to this course. The course was good enough to cover all the basic fundamentals about spark and its functionality
-
TThendral R
This course is an excellent fit for me. I’m thoroughly enjoying the learning experience, and the lectures are both engaging and insightful.
