1 code implementation • 16 Jan 2023 • Ahmed Elnaggar, Hazem Essam, Wafaa Salah-Eldin, Walid Moustafa, Mohamed Elkerdawy, Charlotte Rochereau, Burkhard Rost
As opposed to scaling-up protein language models (PLMs), we seek improving performance via protein-specific optimization.
no code implementations • 30 Nov 2019 • Charlotte Rochereau, Benoît Sagot, Emmanuel Dupoux
Neural language models trained with a predictive or masked objective have proven successful at capturing short and long distance syntactic dependencies.