Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
1 Hour(s) 55 Minute(s)
Language
English
Taught by
Data Science Guide
Rating
Course Overview
Learn Big Data Analysis in PySpark using the Apache Spark's Powerful Features and Easy Commands of Python and SQL
Apache Spark is one of the most powerful tools used in big data analysis because:
It’s Run programs up to 100x faster than Hadoop MapReduce in memory, or 10x faster on disk.
· It can run real and semi-real time data analysis.
· It can handle large scale of data.
· It can be run using simple code in Python programming language.
You can use the easy commands in Python and SQL languages, to run data analysis on big data that cannot or difficult to import inside relational database engines. This combination of Spark, Python and SQL create a powerful work environment to analyze big data easier and faster.
In this course, you will learn: What is Spark, how does it run, and how data are stored in Spark work environment. You will learn how to configure Python programming environment to run Spark code. Also, you will learn performing data analysis using real big data. In addition, you will learn to import big data files inside Python. You will learn to clean and transform data for analysis purpose. You will learn conducting business analysis using several Spark functions. You will learn to create SQL queries inside PySpark to run data analysis. After that you will learn how to interpret the results from business perspective.
Course Content
- 4 section(s)
- 38 lecture(s)
- Section 1 Introduction
- Section 2 Introduction to Python Development Environment
- Section 3 Cleaning and Transforming Data in PySpark
- Section 4 Performing Data Analysis in PySpark
What You’ll Learn
- Learn Most Important PySpark Features, Understand Resilient Distributed Dataset, Learn Most Important Python Commands and Libraries used for Data Analysis, Import Big Data Files in PySpark Work Environment and Clean them, Perform Data Analysis in PySpark using SQL Queries
Skills covered in this course
Reviews
-
GGurpreet Kaur
This is exactly what I was looking for in a course. I decent introduction of how to use pyspark for data analysis. Everything explained in this course is very helpful.
-
SShashikanth S Anchan
Explanation was plain and simple, so it's easy to follow.
-
PPatrick Wheeler
This course was great especially if you have some Pandas experience. It is very similar but does open up some doors that I didn't know existed. Great course!
-
LLakshmi Roopavathy Thatiparthi
Wonderful brush up course! especially sections 3 and 4 are easy to understand and very well explained.
