1 code implementation • 27 May 2024 • Xinting Huang, Madhur Panwar, Navin Goyal, Michael Hahn
The inner workings of neural networks can be better understood if we can fully decipher the information encoded in neural activations.
1 code implementation • 25 Apr 2024 • Kabir Ahuja, Vidhisha Balachandran, Madhur Panwar, Tianxing He, Noah A. Smith, Navin Goyal, Yulia Tsvetkov
Transformers trained on natural language data have been shown to learn its hierarchical structure and generalize to sentences with unseen syntactic structures without explicitly encoding any structural bias.
1 code implementation • 8 Jun 2023 • Madhur Panwar, Kabir Ahuja, Navin Goyal
One of the main discoveries in this line of research has been that for several function classes, such as linear regression, transformers successfully generalize to new functions in the class.
no code implementations • ACL 2021 • Madhur Panwar, Shashank Shailabh, Milan Aggarwal, Balaji Krishnamurthy
Topic models have been widely used to learn text representations and gain insight into document corpora.