| Algorithms | OpenAI Gym | Unity ML-Agents | Google Dopamine |
| A2C | Yes |
|
|
| ACER | Yes |
|
|
| ACKTR | Yes |
|
|
| DDPG | Yes |
|
|
| DQN | Yes |
| Yes |
| GAIL | Yes | Yes |
|
| PPO | Yes | Yes |
|
| HER | Yes |
|
|
| SAC | Yes | Yes | Yes |
| C51 | Yes |
| Yes |
| Rainbow | Yes |
| Yes |
| IQN | Yes |
| Yes |