Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
10 Hour(s) 26 Minute(s)
Language
English
Taught by
Mitchell Edwards
Rating
2 views
Course Overview
Power up your big data projects with cutting-edge web scraping technology built with Python
The web is full of incredibly powerful data stored away in billions of different websites, databases and APIs. Financial data like stock prices and cryptocurrency trends, weather data in thousands of different cities in dozens of countries offered down to the hour, and fun biographical information about your favorite actor or actress: all of this information is at your fingertips, but it's impossible to truly harness it all without a bit of help and automation!
Scrapers and spiders are incredibly powerful programs that allow developers, big data analysts and researchers to harness all of this amazing data and use it for a vast array of different applications, from the creation of data feeds to the collection of data to feed machine learning and artificial intelligence algorithms. This course offers a hands-on approach to building real, usable spiders in realistic situations for financial analysis, link graph construction and social media research, to name a few. By the end of this course, the student will be able to develop spiders and scrapers from scratch using Python and will only be limited by their own imagination. Put the vast power of the internet within your grasp by learning how to develop automated scrapers today!
This class is built with beginners in mind, and while previous experience in Python programming helps, you can start this course without ever having written a line of code.
Course Content
- 6 section(s)
- 28 lecture(s)
- Section 1 Introduction
- Section 2 Theory and Ethics of Web Scraping
- Section 3 Building Our First Scraper
- Section 4 Building Spiders to Crawl the Web
- Section 5 Building Next Level Scrapers
- Section 6 Call to Action
What You’ll Learn
- How to theorize and develop web scrapers and spiders for data analysis and research
- What are scrapers and spiders?
- What is the difference between a scraper and a spider?
- How are scrapers and spiders used in research?
- How to use the Requests and BeautifulSoup libraries to build scrapers
- How to build multi-threaded, complex scrapers
Reviews
-
RROMULO WILLIAN SIDOOSKI
Shi** course! A lot of cutting in the videos. Worst course ever on udemy.
-
EEvan Beyeler
Waste of money because it's free on YouTube. Instructor has abandoned the course and has not updated it. There are several editing cuts that disrupt the flow of the video and he has been made aware of them, he has even said he would fix them and reupload. That was two years ago. He's also difficult to follow going through an exercise. He will write out a bunch of code explaining none of it and then once it's all written down, you get to sit there and watch him debug his own code. The audio levels are not balanced. His speech is very quiet while the intro to each video will make you go deaf. Just go watch it on YouTube if you're curious.
-
TTiaan Stander
I got from the course what I needed. I appreciated the whiteboard sessions - that's where most of the learning happens. The sense of humour was on point! Well chosen examples, being constantly improved on over time - perfect approach for beginners. What could be improved on is the way the learner is encouraged to implement something themselves - which is the best way to learn. I followed along, typing as the teacher typed - which is ok, it's better than just starting with a wall of code and going through that. My biggest gripe was when the teacher realized there's big mistakes - then goes away and fixes it - and comes back with "nothing to see here - was a typo". The code however changed significantly. I did not properly complete that section of the course since the "follow along" approach broke down there. Getting the approach right is probably the most difficult thing in teaching technical content - I don't have specific improvements in mind to offer unfortunately. Any course you finish have something going for it though - so kudus to the teacher!
-
MMichael Lynch
I started with very little knowledge and wrong perceptions about scraping and spiders. The course explains a lot about what goes into doing this as a job and not just the code. If the tutor was to make changes... rethink the database. For me, the course was great.
