no code implementations • 21 Dec 2022 • Najoung Kim, Jatin Khilnani, Alex Warstadt, Abed Qaddoumi
We propose reconstruction probing, a new analysis method for contextualized representations based on reconstruction probabilities in masked language models (MLMs).