Rethinking the Construction of Effective Metrics for Understanding the Mechanisms of Pretrained Language Models

1 code implementation • 19 Oct 2023 • You Li, Jinhui Yin, Yuming Lin

We have specifically designed a family of metrics along this line of investigation, and the model used to compute these metrics is referred to as the tree topological probe.