Search Results for author:
Found 54 papers, 30 papers with code
TransPrompt: Towards an Automatic Transferable Prompting Framework for Few-shot Text Classification
Based on continuous prompt embeddings, we propose TransPrompt, a transferable prompting framework for few-shot learning across similar tasks.
UnClE: Explicitly Leveraging Semantic Similarity to Reduce the Parameters of Word Embeddings
Inspired by the fact that words with similar semantic can share a part of weights, we divide the embeddings of words into two parts: unique embedding and class embedding.
Wasserstein Selective Transfer Learning for Cross-domain Text Mining
However, the source and target domains usually have different data distributions, which may lead to negative transfer.
Meta Distant Transfer Learning for Pre-trained Language Models
For tasks related to distant domains with different class label sets, PLMs may memorize non-transferable knowledge for the target domain and suffer from negative transfer.
Meta-Learning Siamese Network for Few-Shot Text Classification
Few-shot learning has been used to tackle the problem of label scarcity in text classification, of which meta-learning based methods have shown to be effective, such as the prototypical networks (PROTO).
SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to identify named entities with very little annotated data.
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding
In this paper, to address these problems, we introduce a seminal knowledge prompting paradigm and further propose a knowledge-prompting-based PLM framework KP-PLM.
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts.
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
Extractive Question Answering (EQA) is one of the most important tasks in Machine Reading Comprehension (MRC), which can be solved by fine-tuning the span selecting heads of Pre-trained Language Models (PLMs).
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
The success of Pre-Trained Models (PTMs) has reshaped the development of Natural Language Processing (NLP).
Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System
Different from traditional contrastive learning methods which generate two graph views by uniform data augmentation schemes such as corruption or dropping, we comprehensively consider three different graph views for KG-aware recommendation, including global-level structural view, local-level collaborative and semantic views.
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Pre-trained Language Models (PLMs) have achieved remarkable performance for various language understanding tasks in IR systems, which require the fine-tuning process based on labeled training data.
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding
Knowledge-Enhanced Pre-trained Language Models (KEPLMs) are pre-trained models with relation triples injecting from knowledge graphs to improve language understanding abilities.
HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression
In this paper, we target to compress PLMs with knowledge distillation, and propose a hierarchical relational knowledge distillation (HRKD) method to capture both hierarchical and domain relational information.
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining
Recently, the performance of Pre-trained Language Models (PLMs) has been significantly improved by injecting knowledge facts to enhance their abilities of language understanding.
Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification
Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance.
Global Context Enhanced Graph Neural Networks for Session-based Recommendation
In GCE-GNN, we propose a novel global-level item representation learning layer, which employs a session-aware attention mechanism to recursively incorporate the neighbors' embeddings of each node on the global graph.
Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
We present a new vision-language (VL) pre-training model dubbed Kaleido-BERT, which introduces a novel kaleido strategy for fashion cross-modality representations from transformers.
Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation
Despite pre-trained language models such as BERT have achieved appealing performance in a wide range of natural language processing tasks, they are computationally expensive to be deployed in real-time applications.
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
However, the large model sizes, together with the long inference time, limit the deployment of such models in real-time applications.
Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations
More specifically, we propose a reinforced selector to extract useful PRF terms to enhance response candidates and a BERT-based response ranker to rank the PRF-enhanced responses.
Exploring Global Information for Session-based Recommendation
Based on BGNN, we propose a novel approach, called Session-based Recommendation with Global Information (SRGI), which infers the user preferences via fully exploring global item-transitions over all sessions from two different perspectives: (i) Fusion-based Model (SRGI-FM), which recursively incorporates the neighbor embeddings of each node on global graph into the learning process of session level item representation; and (ii) Constrained-based Model (SRGI-CM), which treats the global-level item-transition information as a constraint to ensure the learned item embeddings are consistent with the global item-transition.
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP) applications, yet it is not easy to build an easy-to-use and scalable TL toolkit for this purpose.
One-shot Text Field Labeling using Attention and Belief Propagation for Structure Information Extraction
Existing learning based methods for text labeling task usually require a large amount of labeled examples to train a specific model for each type of document.
A Comprehensive Analysis of Information Leakage in Deep Transfer Learning
To the best of our knowledge, our study is the first to provide a thorough analysis of the information leakage issues in deep transfer learning methods and provide potential solutions to the issue.
Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources
In this paper, we introduce a multi-target MRC task for the medical domain, whose goal is to predict answers to medical questions and the corresponding support sentences from medical information sources simultaneously, in order to ensure the high reliability of medical knowledge serving.
Open-Retrieval Conversational Question Answering
We build an end-to-end system for ORConvQA, featuring a retriever, a reranker, and a reader that are all based on Transformers.
FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval
In this paper, we address the text and image matching in cross-modal retrieval of the fashion industry.
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling
Canonical automatic summary evaluation metrics, such as ROUGE, focus on lexical similarity which cannot well capture semantics nor linguistic quality and require a reference summary which is costly to obtain.
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining
In this paper, we propose an effective learning procedure named Meta Fine-Tuning (MFT), served as a meta-learner to solve a group of similar NLP tasks for neural language models.
KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
We further combine a meta-learning process over the auxiliary task distribution and supervised learning to train the neural lexical relation classifier.
IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
We also perform case studies and analysis of learned user intent and its impact on response ranking in information-seeking conversations to provide interpretation of results.
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search
Motivated by the necessity and benefits of task-oriented BERT compression, we propose a novel compression method, AdaBERT, that leverages differentiable Neural Architecture Search to automatically compress BERT into task-adaptive small models for specific tasks.
Attentive History Selection for Conversational Question Answering
First, we propose a positional history answer embedding method to encode conversation history with position information using BERT in a natural way.
A Minimax Game for Instance based Selective Transfer Learning
To the best of our knowledge, this is the first to build a minimax game based model for selective transfer learning.
BERT with History Answer Embedding for Conversational Question Answering
One of the major challenges to multi-turn conversational search is to model the conversation history to answer the current question.
A Hybrid Retrieval-Generation Neural Conversation Model
In this paper, we propose a hybrid neural conversation model that combines the merits of both response retrieval and generation methods.
Artificial Intelligence for Prosthetics - challenge solutions
In the NeurIPS 2018 Artificial Intelligence for Prosthetics challenge, participants were tasked with building a controller for a musculoskeletal model with a goal of matching a given time-varying velocity vector.
User Intent Prediction in Information-seeking Conversations
Due to the limited communication bandwidth in conversational search, it is important for conversational assistants to accurately detect and predict user intent in information-seeking conversations.
Learning to Selectively Transfer: Reinforced Transfer Learning for Deep Text Matching
Specifically, the data selector "acts" on the source domain data to find a subset for optimization of the TL model, and the performance of the TL model can provide "rewards" in turn to update the selector.
Review Helpfulness Prediction with Embedding-Gated CNN
Product reviews, in the form of texts dominantly, significantly help consumers finalize their purchasing decisions.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce
Building multi-turn information-seeking conversation systems is an important and challenging research topic.
IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detection
To solve this problem, we propose a novel end-to-end scene text detector IncepText from an instance-aware segmentation perspective.
Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems
Our models and research findings provide new insights on how to utilize external knowledge with deep neural models for response selection and have implications for the design of the next generation of information-seeking conversation systems.
Analyzing and Characterizing User Intent in Information-seeking Conversations
Understanding and characterizing how people interact in information-seeking conversations is crucial in developing conversational search systems.
AliMe Assist: An Intelligent Assistant for Creating an Innovative E-commerce Experience
We present AliMe Assist, an intelligent assistant designed for creating an innovative online shopping experience in E-commerce.
Modelling Domain Relationships for Transfer Learning on Retrieval-based Question Answering Systems in E-commerce
In this paper, we study transfer learning for the PI and NLI problems, aiming to propose a general framework, which can effectively and efficiently adapt the shared knowledge learned from a resource-rich source domain to a resource- poor target domain.
AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine
We propose AliMe Chat, an open-domain chatbot engine that integrates the joint results of Information Retrieval (IR) and Sequence to Sequence (Seq2Seq) based generation models.
Aspect Extraction from Product Reviews Using Category Hierarchy Information
Recent work on aspect extraction is leveraging the hierarchical relationship between products and their categories.
