Search Results for author:
Found 6 papers, 5 papers with code
Recent Developments in AI and USPTO Open Data
The USPTO disseminates one of the largest publicly accessible repositories of scientific, technical, and commercial data worldwide.
Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
In the field of artificial intelligence, a combination of scale in data and model capacity enabled by unsupervised learning has led to major advances in representation learning and statistical generation.
Energy-based models for atomic-resolution protein conformations
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale.
On the adequacy of untuned warmup for adaptive optimization
The stability of such algorithms is often improved with a warmup schedule for the learning rate.
Ranked #6 on
Machine Translation
on WMT2016 English-German
ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero
The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy.
Quasi-hyperbolic momentum and Adam for deep learning
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning.
