Search Results for author:
Found 7 papers, 0 papers with code
SKILL: Structured Knowledge Infusion for Large Language Models
The models pre-trained on factual triples compare competitively with the ones on natural language sentences that contain the same knowledge.
Exploring Dual Encoder Architectures for Question Answering
Dual encoders have been used for question-answering (QA) and information retrieval (IR) tasks with good results.
Coupled Gradient Estimators for Discrete Latent Variables
Training models with discrete latent variables is challenging due to the high variance of unbiased gradient estimators.
DisARM: An Antithetic Gradient Estimator for Binary Latent Variables
Applying antithetic sampling over the augmenting variables yields a relatively low-variance and unbiased estimator applicable to any model with binary latent variables.
On Predictive Information in RNNs
Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future.
Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systems
We propose an efficient inference method for switching nonlinear dynamical systems.
On Predictive Information Sub-optimality of RNNs
Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future.
