no code implementations • 12 Jul 2022 • Scott Beliveau, Jerry Ma
The USPTO disseminates one of the largest publicly accessible repositories of scientific, technical, and commercial data worldwide.
1 code implementation • Proceedings of the National Academy of Sciences 2020 • Alexander Rives, Joshua Meier, Tom Sercu, Siddharth Goyal, Zeming Lin, Demi Guo, Myle Ott, C. Lawrence Zitnick, Jerry Ma, Rob Fergus
In the field of artificial intelligence, a combination of scale in data and model capacity enabled by unsupervised learning has led to major advances in representation learning and statistical generation.
1 code implementation • ICLR 2020 • Yilun Du, Joshua Meier, Jerry Ma, Rob Fergus, Alexander Rives
We propose an energy-based model (EBM) of protein conformations that operates at atomic scale.
1 code implementation • 9 Oct 2019 • Jerry Ma, Denis Yarats
The stability of such algorithms is often improved with a warmup schedule for the learning rate.
Ranked #6 on
Machine Translation
on WMT2016 English-German
1 code implementation • 12 Feb 2019 • Yuandong Tian, Jerry Ma, Qucheng Gong, Shubho Sengupta, Zhuoyuan Chen, James Pinkerton, C. Lawrence Zitnick
The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy.
2 code implementations • ICLR 2019 • Jerry Ma, Denis Yarats
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning.