Search Results for author: Yilin Shen

Found 30 papers, 6 papers with code

A Closer Look at Knowledge Distillation with Features, Logits, and Gradients

no code implementations18 Mar 2022 Yen-Chang Hsu, James Smith, Yilin Shen, Zsolt Kira, Hongxia Jin

Knowledge distillation (KD) is a substantial strategy for transferring learned knowledge from one neural network model to another.

Incremental Learning Knowledge Distillation +2

MGA-VQA: Multi-Granularity Alignment for Visual Question Answering

no code implementations25 Jan 2022 Peixi Xiong, Yilin Shen, Hongxia Jin

In contrast to previous works, our model splits alignment into different levels to achieve learning better correlations without needing additional data and annotations.

Question Answering Visual Question Answering +1

Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding

1 code implementation NAACL 2021 Ting Hua, Yilin Shen, Changsheng Zhao, Yen-Chang Hsu, Hongxia Jin

Most existing continual learning approaches suffer from low accuracy and performance fluctuation, especially when the distributions of old and new data are significantly different.

Continual Learning Natural Language Understanding

Automatic Mixed-Precision Quantization Search of BERT

no code implementations30 Dec 2021 Changsheng Zhao, Ting Hua, Yilin Shen, Qian Lou, Hongxia Jin

Knowledge distillation, Weight pruning, and Quantization are known to be the main directions in model compression.

Knowledge Distillation Model Compression +2

Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data

no code implementations28 Oct 2021 Junjiao Tian, Yen-Change Hsu, Yilin Shen, Hongxia Jin, Zsolt Kira

We are the first to propose a method that works well across both OOD detection and calibration and under different types of shifts.

OOD Detection

Exploring Covariate and Concept Shift for Detection and Confidence Calibration of Out-of-Distribution Data

no code implementations29 Sep 2021 Junjiao Tian, Yen-Chang Hsu, Yilin Shen, Hongxia Jin, Zsolt Kira

To this end, we theoretically derive two score functions for OOD detection, the covariate shift score and concept shift score, based on the decomposition of KL-divergence for both scores, and propose a geometrically-inspired method (Geometric ODIN) to improve OOD detection under both shifts with only in-distribution data.

OOD Detection

DictFormer: Tiny Transformer with Shared Dictionary

no code implementations ICLR 2022 Qian Lou, Ting Hua, Yen-Chang Hsu, Yilin Shen, Hongxia Jin

DictFormer significantly reduces the redundancy in the transformer's parameters by replacing the prior transformer's parameters with compact, shared dictionary, a few unshared coefficients, and indices.

Abstractive Text Summarization Language Modelling +2

An Adversarial Learning based Multi-Step Spoken Language Understanding System through Human-Computer Interaction

no code implementations6 Jun 2021 Yu Wang, Yilin Shen, Hongxia Jin

In this paper, we introduce a novel multi-step spoken language understanding system based on adversarial learning that can leverage the multiround user's feedback to update slot values.

Dialogue State Tracking Frame +2

SAFENet: A Secure, Accurate and Fast Neural Network Inference

no code implementations ICLR 2021 Qian Lou, Yilin Shen, Hongxia Jin, Lei Jiang

A cryptographic neural network inference service is an efficient way to allow two parties to execute neural network inference without revealing either party’s data or model.

Modeling Token-level Uncertainty to Learn Unknown Concepts in SLU via Calibrated Dirichlet Prior RNN

no code implementations16 Oct 2020 Yilin Shen, Wenhu Chen, Hongxia Jin

We design a Dirichlet Prior RNN to model high-order uncertainty by degenerating as softmax layer for RNN model training.

Slot Filling Spoken Language Understanding

Generating Dialogue Responses from a Semantic Latent Space

no code implementations EMNLP 2020 Wei-Jen Ko, Avik Ray, Yilin Shen, Hongxia Jin

Existing open-domain dialogue generation models are usually trained to mimic the gold response in the training set using cross-entropy loss on the vocabulary.

Dialogue Generation

Reward Constrained Interactive Recommendation with Natural Language Feedback

no code implementations4 May 2020 Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin, Changyou Chen, Lawrence Carin

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems.

Recommendation Systems reinforcement-learning +1

PGLP: Customizable and Rigorous Location Privacy through Policy Graph

3 code implementations4 May 2020 Yang Cao, Yonghui Xiao, Shun Takagi, Li Xiong, Masatoshi Yoshikawa, Yilin Shen, Jinfei Liu, Hongxia Jin, Xiaofeng Xu

Third, we design a private location trace release framework that pipelines the detection of location exposure, policy graph repair, and private trajectory release with customizable and rigorous location privacy.

Cryptography and Security Computers and Society

Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Data

2 code implementations CVPR 2020 Yen-Chang Hsu, Yilin Shen, Hongxia Jin, Zsolt Kira

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise.

OOD Detection Out-of-Distribution Detection

Text-Based Interactive Recommendation via Constraint-Augmented Reinforcement Learning

no code implementations NeurIPS 2019 Ruiyi Zhang, Tong Yu, Yilin Shen, Hongxia Jin, Changyou Chen

Text-based interactive recommendation provides richer user preferences and has demonstrated advantages over traditional interactive recommender systems.

Recommendation Systems reinforcement-learning +1

A Progressive Model to Enable Continual Learning for Semantic Slot Filling

no code implementations IJCNLP 2019 Yilin Shen, Xiangyu Zeng, Hongxia Jin

ProgModel consists of a novel context gate that transfers previously learned knowledge to a small size expanded component; and meanwhile enables this new component to be fast trained to learn from new data.

Continual Learning Slot Filling +1

Fast Domain Adaptation of Semantic Parsers via Paraphrase Attention

no code implementations WS 2019 Avik Ray, Yilin Shen, Hongxia Jin

However, state-of-the art attention based neural parsers are slow to retrain which inhibits real time domain adaptation.

Domain Adaptation

Iterative Delexicalization for Improved Spoken Language Understanding

no code implementations15 Oct 2019 Avik Ray, Yilin Shen, Hongxia Jin

Recurrent neural network (RNN) based joint intent classification and slot tagging models have achieved tremendous success in recent years for building spoken language understanding and dialog systems.

Intent Classification Spoken Language Understanding

SkillBot: Towards Automatic Skill Development via User Demonstration

no code implementations NAACL 2019 Yilin Shen, Avik Ray, Hongxia Jin, S Nama, eep

We present SkillBot that takes the first step to enable end users to teach new skills in personal assistants (PA).

Natural Language Understanding

Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

no code implementations ICCV 2019 Ramprasaath R. Selvaraju, Stefan Lee, Yilin Shen, Hongxia Jin, Shalini Ghosh, Larry Heck, Dhruv Batra, Devi Parikh

Many vision and language models suffer from poor visual grounding - often falling back on easy-to-learn language priors rather than basing their decisions on visual concepts in the image.

Image Captioning Question Answering +3

A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling

1 code implementation NAACL 2018 Yu Wang, Yilin Shen, Hongxia Jin

The most effective algorithms are based on the structures of sequence to sequence models (or "encoder-decoder" models), and generate the intents and semantic tags either using separate models or a joint model.

Frame Intent Detection +3

A Variational Dirichlet Framework for Out-of-Distribution Detection

no code implementations ICLR 2019 Wenhu Chen, Yilin Shen, Hongxia Jin, William Wang

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications.

Out-of-Distribution Detection Variational Inference

User Information Augmented Semantic Frame Parsing using Coarse-to-Fine Neural Networks

no code implementations18 Sep 2018 Yilin Shen, Xiangyu Zeng, Yu Wang, Hongxia Jin

The results show that our approach leverages such simple user information to outperform state-of-the-art approaches by 0. 25% for intent detection and 0. 31% for slot filling using standard training data.

Frame Intent Detection +3

Robust Spoken Language Understanding via Paraphrasing

no code implementations17 Sep 2018 Avik Ray, Yilin Shen, Hongxia Jin

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems.

Spoken Language Understanding

CRUISE: Cold-Start New Skill Development via Iterative Utterance Generation

no code implementations ACL 2018 Yilin Shen, Avik Ray, Abhishek Patel, Hongxia Jin

We present a system, CRUISE, that guides ordinary software developers to build a high quality natural language understanding (NLU) engine from scratch.

Natural Language Understanding

Human-Interactive Subgoal Supervision for Efficient Inverse Reinforcement Learning

no code implementations22 Jun 2018 Xinlei Pan, Eshed Ohn-Bar, Nicholas Rhinehart, Yan Xu, Yilin Shen, Kris M. Kitani

The learning process is interactive, with a human expert first providing input in the form of full demonstrations along with some subgoal states.

reinforcement-learning

Cannot find the paper you are looking for? You can Submit a new open access paper.