1 code implementation • Findings (EMNLP) 2021 • Hanyu Duan, Yi Yang, Kar Yan Tam
Numeracy plays a key role in natural language understanding.
no code implementations • 15 Feb 2024 • Hanyu Duan, Yi Yang, Kar Yan Tam
More specifically, we check whether and how an LLM reacts differently in its hidden states when it answers a question right versus when it hallucinates.
no code implementations • 17 Nov 2023 • Yi Yang, Hanyu Duan, Ahmed Abbasi, John P. Lalor, Kar Yan Tam
Although a burgeoning literature has emerged on stereotypical bias mitigation in PLMs, such as work on debiasing gender and racial stereotyping, how such biases manifest and behave internally within PLMs remains largely unknown.
no code implementations • 17 Nov 2023 • Hanyu Duan, Yixuan Tang, Yi Yang, Ahmed Abbasi, Kar Yan Tam
In this work, we explore the relationship between ICL and IT by examining how the hidden states of LLMs change in these two paradigms.