Policy Gradient Methods

Deep Deterministic Policy Gradient

Introduced by Lillicrap et al. in Continuous control with deep reinforcement learning

DDPG, or Deep Deterministic Policy Gradient, is an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. It combines the actor-critic approach with insights from DQNs: in particular, the insights that 1) the network is trained off-policy with samples from a replay buffer to minimize correlations between samples, and 2) the network is trained with a target Q network to give consistent targets during temporal difference backups. DDPG makes use of the same ideas along with batch normalization.

Source: Continuous control with deep reinforcement learning


Paper Code Results Date Stars


Task Papers Share
Continuous Control 23 31.51%
OpenAI Gym 10 13.70%
Decision Making 5 6.85%
Autonomous Driving 5 6.85%
Meta-Learning 3 4.11%
Motion Planning 3 4.11%
Efficient Exploration 3 4.11%
Imitation Learning 3 4.11%
Unity 2 2.74%