Search Results for author:
Found 46 papers, 16 papers with code
RGL: A Simple yet Effective Relation Graph Augmented Prompt-based Tuning Approach for Few-Shot Learning
In this work, we show that Relation Graph augmented Learning (RGL) can improve the performance of few-shot natural language understanding tasks.
Knowledge-Guided Paraphrase Identification
We propose to mine outline knowledge of concepts related to given sentences from Wikipedia via BM25 model.
Accurate and interpretable drug-drug interaction prediction enabled by knowledge subgraph learning
Thus, the lack of DDIs is implicitly compensated by the enriched drug representations and propagated drug similarities.
Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling
Intrusive PEFT techniques directly change a model's internal architecture.
Automated Evaluation of Personalized Text Generation using Large Language Models
Personalized text generation presents a specialized mechanism for delivering content that is specific to a user's personal context.
Hierarchical Pretraining on Multimodal Electronic Health Records
Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks.
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
Inspired by this finding, we introduce a novel LLM pruning methodology that incorporates a tailored set of non-uniform layerwise sparsity ratios specifically designed for LLM pruning, termed as Outlier Weighed Layerwise sparsity (OWL).
MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation
Health risk prediction is one of the fundamental tasks under predictive modeling in the medical domain, which aims to forecast the potential health risks that patients may face in the future using their historical Electronic Health Records (EHR).
Hierarchical Adaptation with Hypernetworks for Few-shot Molecular Property Prediction
To address above problems, we propose a novel hierarchical adaptation mechanism for few-shot MPP (HiMPP).
DeeDiff: Dynamic Uncertainty-Aware Early Exiting for Accelerating Diffusion Model Generation
In this work, we propose DeeDiff, an early exiting framework that adaptively allocates computation resources in each sampling step to improve the generation efficiency of diffusion models.
Teach LLMs to Personalize -- An Approach inspired by Writing Education
Inspired by the practice of writing education, we develop a multistage and multitask framework to teach LLMs for personalized generation.
Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filtering
Automated Machine Learning (AutoML) techniques have recently been introduced to design Collaborative Filtering (CF) models in a data-specific manner.
ColdNAS: Search to Modulate for User Cold-Start Recommendation
Instead of using a fixed modulation function and deciding modulation position by expertise, we propose a modulation framework called ColdNAS for user cold-start problem, where we look for proper modulation structure, including function and position, via neural architecture search.
Knowledge-Enhanced Semi-Supervised Federated Learning for Aggregating Heterogeneous Lightweight Clients in IoT
This is a new yet practical scenario in federated learning, i. e., labels-at-server semi-supervised federated learning (SemiFL).
SimFair: A Unified Framework for Fairness-Aware Multi-Label Classification
This new framework utilizes data that have similar labels when estimating fairness on a particular label group for better stability, and can unify DP and EOp.
Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement
In this work, we propose to address the time series forecasting problem with generative modeling and propose a bidirectional variational auto-encoder (BVAE) equipped with diffusion, denoise, and disentanglement, namely D3VAE.
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model
To handle this challenge, we propose a novel early exiting strategy for unified visual language models, which allows dynamically skip the layers in encoder and decoder simultaneously in term of input layer-wise similarities with multiple times of early exiting, namely \textbf{MuE}.
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost for storing, sharing and serving the models.
Distilling Ensemble of Explanations for Weakly-Supervised Pre-Training of Image Segmentation Models
Though image classification datasets could provide the backbone networks with rich visual features and discriminative ability, they are incapable of fully pre-training the target model (i. e., backbone+segmentation modules) in an end-to-end manner.
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost for storing, sharing and serving the models.
Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization
While the optimization problem is nonconvex and nonsmooth, we show that its critical points still have good statistical performance on the tensor completion problem.
Hierarchical Heterogeneous Graph Representation Learning for Short Text Classification
Short text classification is a fundamental task in natural language processing.
LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learners
The first is the use of self-training to leverage large amounts of unlabeled data for prompt-based FN in few-shot settings.
Exploring the Common Principal Subspace of Deep Features in Neural Networks
Specifically, we design a new metric $\mathcal{P}$-vector to represent the principal subspace of deep features learned in a DNN, and propose to measure angles between the principal subspaces using $\mathcal{P}$-vectors.
FedTriNet: A Pseudo Labeling Method with Three Players for Federated Semi-supervised Learning
In particular, we propose to use three networks and a dynamic quality control mechanism to generate high-quality pseudo labels for unlabeled data, which are added to the training set.
Learning from Language Description: Low-shot Named Entity Recognition via Decomposed Framework
In this work, we study the problem of named entity recognition (NER) in a low resource scenario, focusing on few-shot and zero-shot settings.
FedCon: A Contrastive Framework for Federated Semi-Supervised Learning
Most existing FedSSL methods focus on the classical scenario, i. e, the labeled and unlabeled data are stored at the client side.
Property-Aware Relation Networks for Few-Shot Molecular Property Prediction
the target property, such that the limited labels can be effectively propagated among similar molecules.
Multimodal Emergent Fake News Detection via Meta Neural Process Networks
The experimental results show our proposed MetaFEND model can detect fake news on never-seen events effectively and outperform the state-of-the-art methods.
Adaptive Self-training for Neural Sequence Labeling with Few Labels
Neural sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing.
Empirical Studies on the Convergence of Feature Spaces in Deep Learning
While deep learning is effective to learn features/representations from data, the distributions of samples in feature spaces learned by various architectures for different training tasks (e. g., latent layers of AEs and feature vectors in CNN classifiers) have not been well-studied or compared.
FedSiam: Towards Adaptive Federated Semi-Supervised Learning
In this paper, we focus on designing a general framework FedSiam to tackle different scenarios of federated semi-supervised learning, including four settings in the labels-at-client scenario and two setting in the labels-at-server scenario.
Benchmarking Automated Clinical Language Simplification: Dataset, Algorithm, and Evaluation
To fairly evaluate the performance, we also propose three specific evaluation metrics.
Adaptive Self-training for Few-shot Neural Sequence Labeling
While self-training serves as an effective mechanism to learn from large amounts of unlabeled data -- meta-learning helps in adaptive sample re-weighting to mitigate error propagation from noisy pseudo-labels.
Efficient Knowledge Graph Validation via Cross-Graph Representation Learning
To tackle this challenging task, we propose a cross-graph representation learning framework, i. e., CrossVal, which can leverage an external KG to validate the facts in the target KG efficiently.
A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Completion
Extensive low-rank matrix completion experiments on a number of synthetic and real-world data sets show that the proposed method obtains state-of-the-art recovery performance while being the fastest in comparison to existing low-rank matrix learning methods.
AutoKnow: Self-Driving Knowledge Collection for Products of Thousands of Types
Can one build a knowledge graph (KG) for all products in the world?
Automatic Validation of Textual Attribute Values in E-commerce Catalog by Learning with Limited Labeled Data
(1) We formalize the problem of validating the textual attribute values of products from a variety of categories as a natural language inference task in the few-shot learning setting, and propose a meta-learning latent variable model to jointly process the signals obtained from product profiles and textual attribute values.
Decomposed Adversarial Learned Inference
Effective inference for a generative adversarial model remains an important and challenging problem.
Weak Supervision for Fake News Detection via Reinforcement Learning
In order to tackle this challenge, we propose a reinforced weakly-supervised fake news detection framework, i. e., WeFEND, which can leverage users' reports as weak supervision to enlarge the amount of training data for fake news detection.
Generalizing from a Few Examples: A Survey on Few-Shot Learning
Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small.
General Convolutional Sparse Coding with Unknown Noise
However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic.
AIM: Adversarial Inference by Matching Priors and Conditionals
We propose a novel approach, Adversarial Inference by Matching priors and conditionals (AIM), which explicitly matches prior and conditional distributions in both data and code spaces, and puts a direct constraint on the dependency structure of the generative model.
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
One of the unique challenges for fake news detection on social media is how to identify fake news on newly emerged events.
Online Convolutional Sparse Coding with Sample-Dependent Dictionary
Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing.
Scalable Online Convolutional Sparse Coding
Convolutional sparse coding (CSC) improves sparse coding by learning a shift-invariant dictionary from the data.
