Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP

no code implementations • 20 Dec 2021 • Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky, Colin Raffel, Manan Dey, Matthias Gallé, Arun Raja, Chenglei Si, Wilson Y. Lee, Benoît Sagot, Samson Tan

What are the units of text that we want to model?

Multitask Prompted Training Enables Zero-Shot Task Generalization

3 code implementations • ICLR 2022 • Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Tali Bers, Stella Biderman, Leo Gao, Thomas Wolf, Alexander M. Rush

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020).

Language Modelling

Diverse and Consistent Multi-view Networks for Semi-supervised Regression

no code implementations • 29 Sep 2021 • Cuong Manh Nguyen, Le Zhang, Arun Raja, Xun Xu, Balagopal Unnikrishnan, Kangkang Lu, Chuan-Sheng Foo

Label collection is costly in many applications, which poses the need for label-efficient learning.

MULTI-VIEW LEARNING

A*HAR: A New Benchmark towards Semi-supervised learning for Class-imbalanced Human Activity Recognition

1 code implementation • 13 Jan 2021 • Govind Narasimman, Kangkang Lu, Arun Raja, Chuan Sheng Foo, Mohamed Sabry Aly, Jie Lin, Vijay Chandrasekhar

Despite the vast literature on Human Activity Recognition (HAR) with wearable inertial sensor data, it is perhaps surprising that there are few studies investigating semisupervised learning for HAR, particularly in a challenging scenario with class imbalance problem.

Activity Recognition