Search Results for author:
Found 6 papers, 5 papers with code
HyperBERT: Mixing Hypergraph-Aware Layers with Language Models for Node Classification on Text-Attributed Hypergraphs
In this paper, we propose a new architecture, HyperBERT, a mixed text-hypergraph model which simultaneously models hypergraph relational structure while maintaining the high-quality text encoding capabilities of a pre-trained BERT.
Language Model Knowledge Distillation for Efficient Question Answering in Spanish
Recent advances in the development of pre-trained Spanish language models has led to significant progress in many Natural Language Processing (NLP) tasks, such as question answering.
SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation
However, some of its key hurdles include domain generalisation, which is the ability to adapt to previously unseen databases, and alignment of natural language questions with the corresponding SQL queries.
Unsupervised Pretraining for Fact Verification by Language Model Distillation
Fact verification aims to verify a claim using evidence from a trustworthy knowledge base.
Learning from learning machines: a new generation of AI technology to meet the needs of science
We outline emerging opportunities and challenges to enhance the utility of AI for scientific discovery.
Translating synthetic natural language to database queries: a polyglot deep learning framework
In this work we describe a machine learning framework, Polyglotter, that in a general way supports the mapping of natural language searches to database queries.
