Search Results for author:
Found 6 papers, 5 papers with code
Are self-explanations from Large Language Models faithful?
For example, if an LLM says a set of words is important for making a prediction, then it should not be able to make its prediction without these words.
Faithfulness Measurable Masked Language Models
This is achieved by using a novel fine-tuning method that incorporates masking, such that masking tokens become in-distribution by design.
Evaluating the Faithfulness of Importance Measures in NLP by Recursively Masking Allegedly Important Tokens and Retraining
The principle is that this should result in worse model performance compared to masking random tokens.
Post-hoc Interpretability for Neural NLP: A Survey
Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use.
Neural Arithmetic Units
We present two new neural network components: the Neural Addition Unit (NAU), which can learn exact addition and subtraction; and the Neural Multiplication Unit (NMU) that can multiply subsets of a vector.
Measuring Arithmetic Extrapolation Performance
The goal of NALU is to learn perfect extrapolation, which requires learning the exact underlying logic of an unknown arithmetic problem.
