Udemy

Spark and Python for Big Data with PySpark

Enroll Now
  • 147,305 Students
  • Updated 5/2020
4.5
(26,069 Ratings)
CTgoodjobs selects quality courses to enhance professionals' competitiveness. By purchasing courses through links on our site, we may receive an affiliate commission.

Course Information

Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
10 Hour(s) 35 Minute(s)
Language
English
Taught by
Jose Portilla, Pierian Training
Rating
4.5
(26,069 Ratings)

Course Overview

Spark and Python for Big Data with PySpark

Learn how to use Spark with Python, including Spark Streaming, Machine Learning, Spark 2.0 DataFrames and more!

Learn the latest Big Data Technology - Spark! And learn to use it with one of the most popular programming languages, Python!

One of the most valuable technology skills is the ability to analyze huge data sets, and this course is specifically designed to bring you up to speed on one of the best technologies for this task, Apache Spark! The top technology companies like Google, Facebook, Netflix, Airbnb, Amazon, NASA, and more are all using Spark to solve their big data problems!

Spark can perform up to 100x faster than Hadoop MapReduce, which has caused an explosion in demand for this skill! Because the Spark 2.0 DataFrame framework is so new, you now have the ability to quickly become one of the most knowledgeable people in the job market!

This course will teach the basics with a crash course in Python, continuing on to learning how to use Spark DataFrames with the latest Spark 2.0 syntax! Once we've done that we'll go through how to use the MLlib Machine Library with the DataFrame syntax and Spark. All along the way you'll have exercises and Mock Consulting Projects that put you right into a real world situation where you need to use your new skills to solve a real problem!

We also cover the latest Spark Technologies, like Spark SQL, Spark Streaming, and advanced models like Gradient Boosted Trees! After you complete this course you will feel comfortable putting Spark and PySpark on your resume! This course also has a full 30 day money back guarantee and comes with a LinkedIn Certificate of Completion!

If you're ready to jump into the world of Python, Spark, and Big Data, this is the course for you!

Course Content

  • 10 section(s)
  • 67 lecture(s)
  • Section 1 Introduction to Course
  • Section 2 Setting up Python with Spark
  • Section 3 Databricks Setup
  • Section 4 Local VirtualBox Set-up
  • Section 5 AWS EC2 PySpark Set-up
  • Section 6 AWS EMR Cluster Setup
  • Section 7 Python Crash Course
  • Section 8 Spark DataFrame Basics
  • Section 9 Spark DataFrame Project Exercise
  • Section 10 Introduction to Machine Learning with MLlib

What You’ll Learn

  • Use Python and Spark together to analyze Big Data
  • Learn how to use the new Spark 2.0 DataFrame Syntax
  • Work on Consulting Projects that mimic real world situations!
  • Classify Customer Churn with Logisitic Regression
  • Use Spark with Random Forests for Classification
  • Learn how to use Spark's Gradient Boosted Trees
  • Use Spark's MLlib to create Powerful Machine Learning Models
  • Learn about the DataBricks Platform!
  • Get set up on Amazon Web Services EC2 for Big Data Analysis
  • Learn how to use AWS Elastic MapReduce Service!
  • Learn how to leverage the power of Linux with a Spark Environment!
  • Create a Spam filter using Spark and Natural Language Processing!
  • Use Spark Streaming to Analyze Tweets in Real Time!


Reviews

  • A
    Aisah
    5.0

    Great lecture, thank you!

  • N
    Nick Collard
    5.0

    Good presentation so far. Clearly articulated course and easy to understand.

  • A
    Aleksei Makarenko
    4.0

    Very good introduction and explanation to PySpark!

  • S
    Sultan Mukhtarov
    3.0

    Course out of date. Spark 3 and 4 already out and there is not enough Spark for DE

Start FollowingSee all

We use cookies to enhance your experience on our website. Please read and confirm your agreement to our Privacy Policy and Terms and Conditions before continue to browse our website.

Read and Agreed