Course Information
Course Overview
Build Artificial Intelligence (AI) agents using Deep Reinforcement Learning and PyTorch: From basic DQN to Rainbow DQN
This is the most complete Advanced Reinforcement Learning course on Udemy. In it, you will learn to implement some of the most powerful Deep Reinforcement Learning algorithms in Python using PyTorch and PyTorch lightning. You will implement from scratch adaptive algorithms that solve control tasks based on experience. You will learn to combine these techniques with Neural Networks and Deep Learning methods to create adaptive Artificial Intelligence agents capable of solving decision-making tasks.
This course will introduce you to the state of the art in Reinforcement Learning techniques. It will also prepare you for the next courses in this series, where we will explore other advanced methods that excel in other types of task.
The course is focused on developing practical skills. Therefore, after learning the most important concepts of each family of methods, we will implement one or more of their algorithms in jupyter notebooks, from scratch.
Leveling modules:
- Refresher: The Markov decision process (MDP).
- Refresher: Q-Learning.
- Refresher: Brief introduction to Neural Networks.
- Refresher: Deep Q-Learning.
Advanced Reinforcement Learning:
- PyTorch Lightning.
- Hyperparameter tuning with Optuna.
- Reinforcement Learning with image inputs
- Double Deep Q-Learning
- Dueling Deep Q-Networks
- Prioritized Experience Replay (PER)
- Distributional Deep Q-Networks
- Noisy Deep Q-Networks
- N-step Deep Q-Learning
- Rainbow Deep Q-Learning
Course Content
- 10 section(s)
- 104 lecture(s)
- Section 1 Introduction
- Section 2 Refresher: The Markov Decision Process (MDP)
- Section 3 Refresher: Q-Learning
- Section 4 Refresher: Brief introduction to Neural Networks
- Section 5 Refresher: Deep Q-Learning
- Section 6 PyTorch Lightning
- Section 7 Hyperparameter tuning with Optuna
- Section 8 Double Deep Q-Learning
- Section 9 Dueling Deep Q-Networks
- Section 10 Prioritized Experience Replay
What You’ll Learn
- Master some of the most advanced Reinforcement Learning algorithms.
- Learn how to create AIs that can act in a complex environment to achieve their goals.
- Create from scratch advanced Reinforcement Learning agents using Python's most popular tools (PyTorch Lightning, OpenAI gym, Optuna)
- Learn how to perform hyperparameter tuning (Choosing the best experimental conditions for our AI to learn)
- Fundamentally understand the learning process for each algorithm.
- Debug and extend the algorithms presented.
- Understand and implement new algorithms from research papers.
Reviews
-
TT O
If you look for more in-depth knowledge on this category of algorithms, this it's a very good starting point. However, it's extremely condensed, the author's pace is quick and the theory is reduced to a bare minimum to get an idea for what's going on and there aren't any external references to help with the study, which is a major lack in my opinion. You'll have to roll up your sleeves and do some more research on your own, as I had to do!
-
CCarsten Weber
theory and concept is superb, but some problems with environment compatibility on actual colab
-
HHenry Taylor
Some great theoretical explanations and seemingly good code. The real problem with this course is none of the notebooks and library's work as is - running the complete code on collab, as instructed, rarely works. I spent most my time on this course debugging and getting Python library's to work. In the end i got 3 out of around 7 environments to run and had to reuse these rather than the full 7.
-
MMohammad Haadi Akhter
Awesome course, takes you from zero to advanced in a very efficient way. But the explanation of the last algorithm could be improved