Udemy

Advanced Reinforcement Learning in Python: cutting-edge DQNs

Enroll Now
  • 1,752 Students
  • Updated 5/2025
4.6
(110 Ratings)
CTgoodjobs selects quality courses to enhance professionals' competitiveness. By purchasing courses through links on our site, we may receive an affiliate commission.

Course Information

Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
8 Hour(s) 26 Minute(s)
Language
English
Taught by
Escape Velocity Labs
Rating
4.6
(110 Ratings)
3 views

Course Overview

Advanced Reinforcement Learning in Python: cutting-edge DQNs

Build Artificial Intelligence (AI) agents using Deep Reinforcement Learning and PyTorch: From basic DQN to Rainbow DQN

This is the most complete Advanced Reinforcement Learning course on Udemy. In it, you will learn to implement some of the most powerful Deep Reinforcement Learning algorithms in Python using PyTorch and PyTorch lightning. You will implement from scratch adaptive algorithms that solve control tasks based on experience. You will learn to combine these techniques with Neural Networks and Deep Learning methods to create adaptive Artificial Intelligence agents capable of solving decision-making tasks.

This course will introduce you to the state of the art in Reinforcement Learning techniques. It will also prepare you for the next courses in this series, where we will explore other advanced methods that excel in other types of task.

The course is focused on developing practical skills. Therefore, after learning the most important concepts of each family of methods, we will implement one or more of their algorithms in jupyter notebooks, from scratch.


Leveling modules: 


- Refresher: The Markov decision process (MDP).

- Refresher: Q-Learning.

- Refresher: Brief introduction to Neural Networks.

- Refresher: Deep Q-Learning.



Advanced Reinforcement Learning:


- PyTorch Lightning.

- Hyperparameter tuning with Optuna.

- Reinforcement Learning with image inputs

- Double Deep Q-Learning

- Dueling Deep Q-Networks

- Prioritized Experience Replay (PER)

- Distributional Deep Q-Networks

- Noisy Deep Q-Networks

- N-step Deep Q-Learning

- Rainbow Deep Q-Learning

Course Content

  • 10 section(s)
  • 104 lecture(s)
  • Section 1 Introduction
  • Section 2 Refresher: The Markov Decision Process (MDP)
  • Section 3 Refresher: Q-Learning
  • Section 4 Refresher: Brief introduction to Neural Networks
  • Section 5 Refresher: Deep Q-Learning
  • Section 6 PyTorch Lightning
  • Section 7 Hyperparameter tuning with Optuna
  • Section 8 Double Deep Q-Learning
  • Section 9 Dueling Deep Q-Networks
  • Section 10 Prioritized Experience Replay

What You’ll Learn

  • Master some of the most advanced Reinforcement Learning algorithms.
  • Learn how to create AIs that can act in a complex environment to achieve their goals.
  • Create from scratch advanced Reinforcement Learning agents using Python's most popular tools (PyTorch Lightning, OpenAI gym, Optuna)
  • Learn how to perform hyperparameter tuning (Choosing the best experimental conditions for our AI to learn)
  • Fundamentally understand the learning process for each algorithm.
  • Debug and extend the algorithms presented.
  • Understand and implement new algorithms from research papers.

Reviews

  • T
    T O
    3.5

    If you look for more in-depth knowledge on this category of algorithms, this it's a very good starting point. However, it's extremely condensed, the author's pace is quick and the theory is reduced to a bare minimum to get an idea for what's going on and there aren't any external references to help with the study, which is a major lack in my opinion. You'll have to roll up your sleeves and do some more research on your own, as I had to do!

  • C
    Carsten Weber
    4.0

    theory and concept is superb, but some problems with environment compatibility on actual colab

  • H
    Henry Taylor
    2.0

    Some great theoretical explanations and seemingly good code. The real problem with this course is none of the notebooks and library's work as is - running the complete code on collab, as instructed, rarely works. I spent most my time on this course debugging and getting Python library's to work. In the end i got 3 out of around 7 environments to run and had to reuse these rather than the full 7.

  • M
    Mohammad Haadi Akhter
    5.0

    Awesome course, takes you from zero to advanced in a very efficient way. But the explanation of the last algorithm could be improved

Start FollowingSee all

We use cookies to enhance your experience on our website. Please read and confirm your agreement to our Privacy Policy and Terms and Conditions before continue to browse our website.

Read and Agreed