Search Results for author:
Found 14 papers, 2 papers with code
Adapting Decoder-Based Language Models for Diverse Encoder Downstream Tasks
Decoder-based transformers, while revolutionizing language modeling and scaling to immense sizes, have not completely overtaken encoder-heavy architectures in natural language processing.
SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives
Dual encoders have been used for retrieval tasks and representation learning with good results.
SKILL: Structured Knowledge Infusion for Large Language Models
The models pre-trained on factual triples compare competitively with the ones on natural language sentences that contain the same knowledge.
Exploring Dual Encoder Architectures for Question Answering
We further explore and explain why parameter sharing in projection layer significantly improves the efficacy of the dual encoders, by directly probing the embedding spaces of the two encoder towers with t-SNE algorithm.
Prosody Modifications for Question-Answering in Voice-Only Settings
Many popular form factors of digital assistants---such as Amazon Echo, Apple Homepod, or Google Home---enable the user to hold a conversation with these systems based only on the speech modality.
Learning to Attend, Copy, and Generate for Session-Based Query Suggestion
e results suggest that our model outperforms the baselines both in terms of the generating queries and scoring candidate queries for the task of query suggestion.
Fast k-best Sentence Compression
A popular approach to sentence compression is to formulate the task as a constrained optimization problem and solve it with integer linear programming (ILP) tools.
