Search Results for author:
Found 38 papers, 18 papers with code
TransPrompt: Towards an Automatic Transferable Prompting Framework for Few-shot Text Classification
Based on continuous prompt embeddings, we propose TransPrompt, a transferable prompting framework for few-shot learning across similar tasks.
UnClE: Explicitly Leveraging Semantic Similarity to Reduce the Parameters of Word Embeddings
Inspired by the fact that words with similar semantic can share a part of weights, we divide the embeddings of words into two parts: unique embedding and class embedding.
Meta Distant Transfer Learning for Pre-trained Language Models
For tasks related to distant domains with different class label sets, PLMs may memorize non-transferable knowledge for the target domain and suffer from negative transfer.
Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning
To craft robust data, Refiner promotes the gradients of critical parameters associated with robust data to close ground-truth ones while leaving the gradients of trivial parameters to safeguard privacy.
TW-BAG: Tensor-wise Brain-aware Gate Network for Inpainting Disrupted Diffusion Tensor Imaging
Diffusion Weighted Imaging (DWI) is an advanced imaging technique commonly used in neuroscience and neurological clinical research through a Diffusion Tensor Imaging (DTI) model.
SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to identify named entities with very little annotated data.
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training
Recently, knowledge-enhanced pre-trained language models (KEPLMs) improve context-aware representations via learning from structured relations in knowledge graphs, and/or linguistic knowledge from syntactic or dependency analysis.
Understanding Long Programming Languages with Structure-Aware Sparse Attention
With top-$k$ sparse attention, the most crucial attention relation can be obtained with a lower computational cost.
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts.
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
Extractive Question Answering (EQA) is one of the most important tasks in Machine Reading Comprehension (MRC), which can be solved by fine-tuning the span selecting heads of Pre-trained Language Models (PLMs).
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
The success of Pre-Trained Models (PTMs) has reshaped the development of Natural Language Processing (NLP).
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Pre-trained Language Models (PLMs) have achieved remarkable performance for various language understanding tasks in IR systems, which require the fine-tuning process based on labeled training data.
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction
In this paper, we propose a hierarchical contrastive learning Framework for Distantly Supervised relation extraction (HiCLRE) to reduce noisy sentences, which integrate the global structural information and local fine-grained interaction.
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression
Unified in contrastive learning, CAP enables the pruned model to learn from the pre-trained model for task-agnostic knowledge, and fine-tuned model for task-specific knowledge.
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding
Knowledge-Enhanced Pre-trained Language Models (KEPLMs) are pre-trained models with relation triples injecting from knowledge graphs to improve language understanding abilities.
INTERN: A New Learning Paradigm Towards General Vision
Enormous waves of technological innovations over the past several years, marked by the advances in AI technologies, are profoundly reshaping the industry and the society.
Snapshot Ptychography on Array cameras
We use convolutional neural networks to recover images optically down-sampled by $6. 7\times$ using coherent aperture synthesis over a 16 camera array.
Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings
The multi-relational Knowledge Base Question Answering (KBQA) system performs multi-hop reasoning over the knowledge graph (KG) to achieve the answer.
Knowledge Base Question Answering
Knowledge Graph Embedding
+1
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining
Recently, the performance of Pre-trained Language Models (PLMs) has been significantly improved by injecting knowledge facts to enhance their abilities of language understanding.
Multiscale Phase Retrieval
Phase-sensitive sensor planes using such devices could eliminate the need both for lenses and reference signals, creating a path to large aperture diffraction limited laser imaging.
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
However, the large model sizes, together with the long inference time, limit the deployment of such models in real-time applications.
Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations
More specifically, we propose a reinforced selector to extract useful PRF terms to enhance response candidates and a BERT-based response ranker to rank the PRF-enhanced responses.
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP) applications, yet it is not easy to build an easy-to-use and scalable TL toolkit for this purpose.
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
The intensive computation of Automatic Speech Recognition (ASR) models obstructs them from being deployed on mobile devices.
EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition
We present EasyASR, a distributed machine learning platform for training and serving large-scale Automatic Speech Recognition (ASR) models, as well as collecting and processing audio data at scale.
Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources
In this paper, we introduce a multi-target MRC task for the medical domain, whose goal is to predict answers to medical questions and the corresponding support sentences from medical information sources simultaneously, in order to ensure the high reliability of medical knowledge serving.
Weakly Supervised Construction of ASR Systems with Massive Video Data
Building Automatic Speech Recognition (ASR) systems from scratch is significantly challenging, mostly due to the time-consuming and financially-expensive process of annotating a large amount of audio data with transcripts.
Automatic Speech Recognition
Optical Character Recognition
+2
BiRRE: Learning Bidirectional Residual Relation Embeddings for Supervised Hypernymy Detection
The hypernymy detection task has been addressed under various frameworks.
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining
In this paper, we propose an effective learning procedure named Meta Fine-Tuning (MFT), served as a meta-learner to solve a group of similar NLP tasks for neural language models.
KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
We further combine a meta-learning process over the auxiliary task distribution and supervised learning to train the neural lexical relation classifier.
Population pharmacokinetics and dosing regimen optimization of tacrolimus in Chinese lung transplant recipients
Given the nonlinear kinetics of tacrolimus and large variability, population pharmacokinetic model should be combined with therapeutic drug monitoring to optimize individualized therapy.
SphereRE: Distinguishing Lexical Relations with Hyperspherical Relation Embeddings
Lexical relations describe how meanings of terms relate to each other.
Video Generation from Single Semantic Label Map
This paper proposes the novel task of video generation conditioned on a SINGLE semantic label map, which provides a good balance between flexibility and quality in the generation process.
Exploratory Neural Relation Classification for Domain Knowledge Acquisition
The goal is to learn a classifier on pre-defined relations and discover new relations expressed in texts.
Learning Fine-grained Relations from Chinese User Generated Categories
User generated categories (UGCs) are short texts that reflect how people describe and organize entities, expressing rich semantic relations implicitly.
A Short Survey on Taxonomy Learning from Text Corpora: Issues, Resources and Recent Advances
A taxonomy is a semantic hierarchy, consisting of concepts linked by is-a relations.
Transductive Non-linear Learning for Chinese Hypernym Prediction
Finding the correct hypernyms for entities is essential for taxonomy learning, fine-grained entity categorization, query understanding, etc.
Chinese Hypernym-Hyponym Extraction from User Generated Categories
Hypernym-hyponym ({``}is-a{''}) relations are key components in taxonomies, object hierarchies and knowledge graphs.
