Search Results for author:
Found 22 papers, 4 papers with code
Retrieval-Enhanced Machine Learning
Although information access systems have long supported people in accomplishing a wide range of tasks, we propose broadening the scope of users of information access systems to include task-driven machines, such as machine learning models.
Out-of-Domain Semantics to the Rescue! Zero-Shot Hybrid Retrieval Models
In this work, we carefully select five datasets, including two in-domain datasets and three out-of-domain datasets with different levels of domain shift, and study the generalization of a deep model in a zero-shot setting.
Rank4Class: A Ranking Formulation for Multiclass Classification
We further demonstrate that the dominant neural MCC architecture can be formulated as a neural ranking framework with a specific set of design choices.
Improving Neural Ranking via Lossless Knowledge Distillation
We explore a novel perspective of knowledge distillation (KD) for learning to rank (LTR), and introduce Self-Distilled neural Rankers (SDR), where student rankers are parameterized identically to their teachers.
Rank4Class: Examining Multiclass Classification through the Lens of Learning to Rank
We further demonstrate that the most popular MCC architecture in deep learning can be mathematically formulated as a LTR pipeline equivalently, with a specific set of choices in terms of ranking model architecture and loss function.
Dynamic Language Models for Continuously Evolving Content
To this end, we both explore two different vocabulary composition methods, as well as propose three sampling methods which help in efficient incremental training for BERT-like models.
LAMPRET: Layout-Aware Multimodal PreTraining for Document Understanding
text, table, image) and propose a novel layout-aware multimodal hierarchical framework, LAMPreT, to model the blocks and the whole document.
Natural Language Understanding with Privacy-Preserving BERT
We investigate the privacy and utility implications of applying dx-privacy, a variant of Local Differential Privacy, to BERT fine-tuning in NLU applications.
WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learning
First, WIT is the largest multimodal dataset by the number of image-text examples by 3x (at the time of writing).
Ranked #1 on
Text-Image Retrieval
on WIT
Neural Rankers are hitherto Outperformed by Gradient Boosted Decision Trees
We first validate this concern by showing that most recent neural LTR models are, by a large margin, inferior to the best publicly available Gradient Boosted Decision Trees (GBDT) in terms of their reported ranking accuracy on benchmark datasets.
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling
Pre-trained models like BERT (Devlin et al., 2018) have dominated NLP / IR applications such as single sentence classification, text pair classification, and question answering.
Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach
A hybrid approach, which leverages both semantic (deep neural network-based) and lexical (keyword matching-based) retrieval models, is proposed.
RRF102: Meeting the TREC-COVID Challenge with a 100+ Runs Ensemble
In this paper, we report the results of our participation in the TREC-COVID challenge.
Interpretable Learning-to-Rank with Generalized Additive Models
Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area.
Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document Matching
In order to better capture sentence level semantic relations within a document, we pre-train the model with a novel masked sentence block language modeling task in addition to the masked word language modeling task used by BERT.
Self-Attentive Document Interaction Networks for Permutation Equivariant Ranking
It thus motivates us to study how to leverage cross-document interactions for learning-to-rank in the deep learning framework.
Domain Adaptation for Enterprise Email Search
To address this data challenge, in this paper we propose a domain adaptation approach that fine-tunes the global model to each individual enterprise.
TF-Ranking: Scalable TensorFlow Library for Learning-to-Rank
We propose TensorFlow Ranking, the first open source library for solving large-scale ranking problems in a deep learning framework.
Learning Groupwise Multivariate Scoring Functions Using Deep Neural Networks
To overcome this limitation, we propose a new framework for multivariate scoring functions, in which the relevance score of a document is determined jointly by multiple documents in the list.
Multi-Task Learning for Email Search Ranking with Auxiliary Query Clustering
In this paper, we study how to obtain query type in an unsupervised fashion and how to incorporate this information into query-dependent ranking models.
Semantic Video Trailers
Our approach effectively captures the multimodal semantics of queries and videos using state-of-the-art deep neural networks and creates a summary that is both semantically coherent and visually attractive.
