In the field of artificial intelligence, a combination of scale in data and model capacity enabled by unsupervised learning has led to major advances in representation learning and statistical generation.
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale.
The stability of such algorithms is often improved with a warmup schedule for the learning rate.
Ranked #6 on Machine Translation on WMT2016 English-German
The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy.