Search Results for author:
Found 10 papers, 6 papers with code
Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids’ Representations
Most of the recent works on probing representations have focused on BERT, with the presumption that the findings might be similar to the other models.
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory
While current large language models (LLMs) demonstrate some capabilities in knowledge-intensive tasks, they are limited by relying on their parameters as an implicit storage mechanism.
DecompX: Explaining Transformers Decisions by Propagating Token Decomposition
An emerging solution for explaining Transformer-based models is to use vector-based analysis on how the representations are formed.
RET-LLM: Towards a General Read-Write Memory for Large Language Models
Large language models (LLMs) have significantly advanced the field of natural language processing (NLP) through their extensive parameters and comprehensive data utilization.
Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similarities
A popular workaround is to train a robust model by re-weighting training examples based on a secondary biased model.
BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning
In this work, we employ these two metrics for the first time in NLP.
GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers
There has been a growing interest in interpreting the underlying dynamics of Transformers.
AdapLeR: Speeding up Inference by Adaptive Length Reduction
To determine the importance of each token representation, we train a Contribution Predictor for each layer using a gradient-based saliency method.
Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations
Most of the recent works on probing representations have focused on BERT, with the presumption that the findings might be similar to the other models.
Exploring the Role of BERT Token Representations to Explain Sentence Probing Results
Several studies have been carried out on revealing linguistic features captured by BERT.
