Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
10 Hour(s) 47 Minute(s)
Language
English
Taught by
Frank Andrade
Certificate
- Available
- *The delivery and distribution of the certificate are subject to the policies and arrangements of the course provider.
Rating
2 views
Course Overview
4 projects with Beautiful Soup, Selenium and Scrapy | ChatGPT for web scraping
Have you ever thought about how important is data in our everyday life?
It doesn't matter if you're a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.
Welcome to Web Scraping in Python with BeautiuflSoup, Selenium, and Scrapy!
The most complete and project-oriented course. In this course, we're going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:
Amazon Audible
Twitter
Google
Football Stats
Worldometers
Movie pages
This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
Why I built the course this way?
Beautiful Soup has a lot of limitations, but it's still useful for a gentle introduction to web scraping. In contrast, if you learn Selenium you will be able to scrape any website. and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.
What makes this course different from the others, and why you should enroll?
This is the most updated and complete web scraping course in Python. You will be using Python 3.7, Scrapy 2.4, Selenium 3.141.0 and BS4
This is the most project-based course you will find. We will scrape many of the most well-known websites
You will have an in-depth step by step guide on how to become a professional web scraper.
You will learn how to use Selenium, Scrapy, and Splash to scrape JavaScript-driven websites. You won't find any tutorials out there that teach how to use these web scraping tools the way I do in this course.
You will learn how to use ChatGPT for web scraping
30 days money back guarantee by Udemy
At the end of the course, you'll know how to build your own web scraper to obtain new data, learn the best techniques for web scraping and more.
Join me now and let's start scraping the web together!
Course Content
- 17 section(s)
- 95 lecture(s)
- Section 1 Introduction
- Section 2 Introduction to Beautiful Soup
- Section 3 Project #1: Scraping Multiple Pages with Beautiful Soup
- Section 4 XPath
- Section 5 Introduction to Selenium
- Section 6 Project #1: Dealing with Multiple Pages using Selenium (Amazon Audible Bot)
- Section 7 Introduction to Scrapy
- Section 8 Dealing with Multiple Pages using Scrapy
- Section 9 Project #3: Building Crawlers with Scrapy
- Section 10 Exporting Data to a Database: MongoDB and SQLite
- Section 11 Scraping APIs & Login to website with Scrapy
- Section 12 Splash Basics
- Section 13 Project #4: Scraping JavaScript websites using Scrapy/Splash
- Section 14 How to Make Money Using Web Scraping
- Section 15 Prize: ChatGPT for Web Scraping
- Section 16 Appendix: Infinite Scrolling & Login (Twitter Bot)
- Section 17 Bonus: Python for Data Science Bootcamp 2022: From Zero to Hero
What You’ll Learn
- Learn to scrape website from scratch with Beautiful Soup
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- How to use ChatGPT for web scraping
- 4 web scraping projects (from beginner to advanced projects)
- Handle pagination with any scraping tool
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Store the extracted Data in MongoDb & SQLite3
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
Reviews
-
AArpan Kumar Das
I’m enjoying your course, but many parts of the Selenium section use older methods like find_element_by_xpath, which no longer work in the latest Selenium versions. Modern Selenium (2025–2026) uses the By class instead, such as driver.find_element(By.XPATH, ...). It would be very helpful if you could update the Selenium lessons with the new syntax, the current WebDriver setup, and the latest best practices. This will make the course more accurate and valuable for learners in 2025 and 2026. Thank you for your hard work, and I hope the updated content can be added soon!
-
MMaddy Stuiver
De getoonde oefeningen werken niet meer op de website uit de video.
-
TTheofilos P. Theodoridis
The course is very good, but as mentioned by other students an updated version is somewhat needed at this point. Still the content here is very thorough and reproducible with a few tweaks here and there.
-
AAhmed Mosaad Gelwan
I’m grateful for this valuable experience. This is by far the best web scraping course I’ve taken
