1 code implementation • 22 Nov 2022 • Alberto Cattaneo, Daniel Justus, Harry Mellor, Douglas Orr, Jerome Maloberti, Zhenying Liu, Thorin Farnsworth, Andrew Fitzgibbon, Blazej Banaszewski, Carlo Luschi
We present the award-winning submission to the WikiKG90Mv2 track of OGB-LSC@NeurIPS 2022.
no code implementations • 6 Jun 2022 • Badreddine Noune, Philip Jones, Daniel Justus, Dominic Masters, Carlo Luschi
Given the current trend of increasing size and complexity of machine learning architectures, it has become of critical importance to identify new approaches to improve the computational efficiency of model training.
no code implementations • 13 Aug 2021 • Anastasia Dietrich, Frithjof Gressmann, Douglas Orr, Ivan Chelombiev, Daniel Justus, Carlo Luschi
Identifying algorithms for computational efficient unsupervised training of large language models is an important and active area of research.
no code implementations • 10 Jun 2021 • Ivan Chelombiev, Daniel Justus, Douglas Orr, Anastasia Dietrich, Frithjof Gressmann, Alexandros Koliousis, Carlo Luschi
Attention based language models have become a critical component in state-of-the-art natural language processing systems.
1 code implementation • 28 Nov 2018 • Daniel Justus, John Brennan, Stephen Bonner, Andrew Stephen McGough
But, also, it has the ability to predict execution times for scenarios unseen in the training data.