Search Results for author:
Found 113 papers, 52 papers with code
T3D: Towards 3D Medical Image Understanding through Vision-Language Pre-training
This underlines T3D's potential in representation learning for 3D medical image analysis.
SynFundus: Generating a synthetic fundus images dataset with millions of samples and multi-disease annotations
In the field of medical imaging, the scarcity of large-scale datasets due to privacy restrictions stands as a significant barrier to develop large models for medical.
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers
Existing information retrieval (IR) models often assume a homogeneous format, limiting their applicability to diverse user needs, such as searching for images with text descriptions, searching for a news article with a headline image, or finding a similar photo with a query image.
DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release
Motivated by this, this paper proposes DPSUR, a Differentially Private training framework based on Selective Updates and Release, where the gradient from each iteration is evaluated based on a validation test, and only those updates leading to convergence are applied to the model.
Massive Editing for Large Language Models via Meta Learning
While large language models (LLMs) have enabled learning knowledge from the pre-training corpora, the acquired knowledge may be fundamentally incorrect or outdated over time, which necessitates rectifying the knowledge of the language model (LM) after the training.
DP-DCAN: Differentially Private Deep Contrastive Autoencoder Network for Single-cell Clustering
Recently, deep learning has facilitated the analysis of high-dimensional single-cell data.
AI Alignment: A Comprehensive Survey
AI alignment aims to make AI systems behave in line with human intentions and values.
Covert Planning against Imperfect Observers
This paper studies how covert planning can leverage the coupling of stochastic dynamics and the observer's imperfect observation to achieve optimal task performance without being detected.
Prototype-based HyperAdapter for Sample-Efficient Multi-task Tuning
Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters.
Emergent Mixture-of-Experts: Can Dense Pre-trained Transformers Benefit from Emergent Modular Structures?
Existing modular neural networks are generally $\textit{explicit}$ because their modular architectures are pre-defined, and individual modules are expected to implement distinct functions.
Heterogenous Memory Augmented Neural Networks
It has been shown that semi-parametric methods, which combine standard neural networks with non-parametric components such as external memory modules and data retrieval, are particularly helpful in data scarcity and out-of-distribution (OOD) scenarios.
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models
To this end, we introduce Multi-Modal Low-Rank Adaptation learning (MMLoRA).
ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks
Recent years have witnessed remarkable progress in the development of large vision-language models (LVLMs).
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models
The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters.
AutoAgents: A Framework for Automatic Agent Generation
Therefore, we introduce AutoAgents, an innovative framework that adaptively generates and coordinates multiple specialized agents to build an AI team according to different tasks.
Mixup-Augmented Meta-Learning for Sample-Efficient Fine-Tuning of Protein Simulators
Molecular dynamics simulations have emerged as a fundamental instrument for studying biomolecules.
ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations
By theoretically analyzing the convergence, we can find the optimal number of differentially private local iterations for clients between any two sequential global updates.
ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
Text evaluation has historically posed significant challenges, often demanding substantial labor and time cost.
On the Effectiveness of Speech Self-supervised Learning for Music
Our findings suggest that training with music data can generally improve performance on MIR tasks, even when models are trained using paradigms designed for speech.
Multimodal Imbalance-Aware Gradient Modulation for Weakly-supervised Audio-Visual Video Parsing
In this paper, to balance the feature learning processes of different modalities, a dynamic gradient modulation (DGM) mechanism is explored, where a novel and effective metric function is designed to measure the imbalanced feature learning between audio and visual modalities.
LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPT
We introduce LyricWhiz, a robust, multilingual, and zero-shot automatic lyrics transcription method achieving state-of-the-art performance on various lyrics transcription datasets, even in challenging genres such as rock and metal.
NIPD: A Federated Learning Person Detection Benchmark Based on Real-World Non-IID Data
Therefore, we open source a non-IID IoT person detection (NIPD) data set, which is collected from five different cameras.
Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
The task of empowering large language models (LLMs) to accurately express their confidence, referred to as confidence elicitation, is essential in ensuring reliable and trustworthy decision-making processes.
Deep Reinforcement Learning with Multitask Episodic Memory Based on Task-Conditioned Hypernetwork
Deep reinforcement learning algorithms are usually impeded by sampling inefficiency, heavily depending on multiple interactions with the environment to acquire accurate decision-making capabilities.
MARBLE: Music Audio Representation Benchmark for Universal Evaluation
This is evident in the limited work on deep music representations, the scarcity of large-scale datasets, and the absence of a universal and community-driven benchmark.
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory
Large language models (LLMs) with memory are computationally universal.
MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
To address this research gap, we propose an acoustic Music undERstanding model with large-scale self-supervised Training (MERT), which incorporates teacher models to provide pseudo labels in the masked language modelling (MLM) style acoustic pre-training.
TPDM: Selectively Removing Positional Information for Zero-shot Translation via Token-Level Position Disentangle Module
Due to Multilingual Neural Machine Translation's (MNMT) capability of zero-shot translation, many works have been carried out to fully exploit the potential of MNMT in zero-shot translation.
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning
We pretrain GIMLET on the molecule tasks along with instructions, enabling the model to transfer effectively to a broad range of tasks.
HUB: Guiding Learned Optimizers with Continuous Prompt Tuning
By incorporating hand-designed optimizers as the second component in our hybrid approach, we are able to retain the benefits of learned optimizers while stabilizing the training process and, more importantly, improving testing performance.
Think Before You Act: Decision Transformers with Internal Working Memory
We argue that this inefficiency stems from the forgetting phenomenon, in which a model memorizes its behaviors in parameters throughout training.
Interactive Natural Language Processing
Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within the field of NLP, aimed at addressing limitations in existing frameworks while aligning with the ultimate goals of artificial intelligence.
Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility
With most of the related literature in the era of LLM uncharted, we propose an automated workflow that copes with an upscaled number of queries/responses.
Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models
Our method does not require external triggers and ensures correct labeling of poisoned samples, improving the stealthy nature of the backdoor attack.
Huatuo-26M, a Large-scale Chinese Medical QA Dataset
Moreover, we also experimentally show the benefit of the proposed dataset in many aspects: (i) trained models for other QA datasets in a zero-shot fashion; and (ii) as external knowledge for retrieval-augmented generation (RAG); and (iii) improving existing pre-trained language models by using the QA pairs as a pre-training corpus in continued training manner.
MUDiff: Unified Diffusion for Complete Molecule Generation
Our model is a promising approach for designing stable and diverse molecules and can be applied to a wide range of tasks in molecular modeling.
When Do Graph Neural Networks Help with Node Classification? Investigating the Impact of Homophily Principle on Node Distinguishability
Homophily principle, i. e., nodes with the same labels are more likely to be connected, has been believed to be the main reason for the performance superiority of Graph Neural Networks (GNNs) over Neural Networks on node classification tasks.
Probabilistic Planning with Prioritized Preferences over Temporal Logic Objectives
We demonstrate the efficacy and applicability of the logic and the algorithm on several case studies with detailed analyses for each.
Chinese Open Instruction Generalist: A Preliminary Release
Instruction tuning is widely recognized as a key technique for building generalist language models, which has attracted the attention of researchers and the public with the release of InstructGPT~\citep{ouyang2022training} and ChatGPT\footnote{\url{https://chat. openai. com/}}.
Chain of Thought Prompt Tuning in Vision Language Models
Chain of Thought is a simple and effective approximation to human reasoning process and has been proven useful for natural language processing (NLP) tasks.
Synthesis of Opacity-Enforcing Winning Strategies Against Colluded Opponent
Furthermore, if such a strategy does not exist, winning for P1 must entail the price of revealing his secret to the observer.
Modular Retrieval for Generalization and Interpretation
Built upon the paradigm, we propose a retrieval model with modular prompt tuning named REMOP.
A Pathway Towards Responsible AI Generated Content
AI Generated Content (AIGC) has received tremendous attention within the past few years, with content ranging from image, text, to audio, video, etc.
Quantitative Planning with Action Deception in Concurrent Stochastic Games
In this setup, we investigate P1's strategic planning of action deception that decides when to deviate from the Nash equilibrium in P2's game model and employ a hidden action, so that P1 can maximize the value of action deception, which is the additional payoff compared to P1's payoff in the game where P2 has complete information.
CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation
As natural language processing (NLP) for gender bias becomes a significant interdisciplinary topic, the prevalent data-driven techniques such as large-scale language models suffer from data inadequacy and biased corpus, especially for languages with insufficient resources such as Chinese.
A Close Look at Spatial Modeling: From Attention to Convolution
Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism.
MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learning
The deep learning community has witnessed an exponentially growing interest in self-supervised learning (SSL).
Adap DP-FL: Differentially Private Federated Learning with Adaptive Noise
The heterogeneity and convergence of training parameters were simply not considered.
SA-DPSGD: Differentially Private Stochastic Gradient Descent based on Simulated Annealing
Differentially private stochastic gradient descent (DPSGD) is the most popular training method with differential privacy in image recognition.
Reconciliation of Pre-trained Models and Prototypical Neural Networks in Few-shot Named Entity Recognition
Incorporating large-scale pre-trained models with the prototypical neural networks is a de-facto paradigm in few-shot named entity recognition.
HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Models
In addition to verifying the existence of regional bias in LMs, we find that the biases on regional groups can be strongly influenced by the geographical clustering of the groups.
1Cademy @ Causal News Corpus 2022: Leveraging Self-Training in Causality Classification of Socio-Political Event Data
This paper details our participation in the Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE) workshop @ EMNLP 2022, where we take part in Subtask 1 of Shared Task 3.
1Cademy @ Causal News Corpus 2022: Enhance Causal Span Detection via Beam-Search-based Position Selector
In this paper, we present our approach and empirical observations for Cause-Effect Signal Span Detection -- Subtask 2 of Shared task 3~\cite{tan-etal-2022-event} at CASE 2022.
Text Editing as Imitation Game
Text editing, such as grammatical error correction, arises naturally from imperfect textual data.
Opportunistic Qualitative Planning in Stochastic Systems with Incomplete Preferences over Reachability Objectives
We construct a model called an improvement MDP, in which the synthesis of SPI and SASI strategies that guarantee at least one improvement reduces to computing positive and almost-sure winning strategies in an MDP.
Probabilistic Planning with Partially Ordered Preferences over Temporal Goals
We prove that a weak-stochastic nondominated policy given the preference specification is Pareto-optimal in the constructed multi-objective MDP, and vice versa.
On Almost-Sure Intention Deception Planning that Exploits Imperfect Observers
The synthesized attack strategy not only ensures the attack objective is satisfied almost surely but also deceives the defender into believing that the observed behavior is generated by a normal/legitimate user and thus failing to detect the presence of an attack.
Pathway to Future Symbiotic Creativity
This report presents a comprehensive view of our vision on the development path of the human-machine symbiotic art creation.
Graph Neural Networks Intersect Probabilistic Graphical Models: A Survey
Graph Neural Networks (GNNs) are new inference methods developed in recent years and are attracting growing attention due to their effectiveness and flexibility in solving inference and learning problems over graph-structured data.
Biological Sequence Design with GFlowNets
In this work, we propose an active learning algorithm leveraging epistemic uncertainty estimation and the recently proposed GFlowNets as a generator of diverse candidate solutions, with the objective to obtain a diverse batch of useful (as defined by some utility function, for example, the predicted anti-microbial activity of a peptide) and informative candidates after each round.
MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare
Mental health is a critical issue in modern society, and mental disorders could sometimes turn to suicidal ideation without adequate treatment.
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
In this paper, we summarize the recent progress of pre-trained language models in the biomedical domain and their applications in biomedical downstream tasks.
Learning Multi-Objective Curricula for Robotic Policy Learning
Various automatic curriculum learning (ACL) methods have been proposed to improve the sample efficiency and final performance of deep reinforcement learning (DRL).
Unifying Likelihood-free Inference with Black-box Optimization and Beyond
Black-box optimization formulations for biological sequence design have drawn recent attention due to their promising potential impact on the pharmaceutical industry.
Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning
In contrast, biological neural networks (BNNs) can adapt to various new tasks by continually updating the neural connections based on the inputs, which is aligned with the paradigm of learning effective learning rules in addition to static parameters, e. g., meta-learning.
On Orthogonality Constraints for Transformers
Orthogonality constraints encourage matrices to be orthogonal for numerical stability.
Pruning Ternary Quantization
To simultaneously optimize bit-width, model size, and accuracy, we propose pruning ternary quantization (PTQ): a simple, effective, symmetric ternary quantization method.
Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learning
In recent years, the fast rise in number of studies on graph neural network (GNN) has put it from the theories research to reality application stage.
Few-Shot Domain Adaptation with Polymorphic Transformers
Thus, the chance of overfitting the annotations is greatly reduced, and the model can perform robustly on the target domain after being trained on a few annotated images.
Probabilistic Planning with Preferences over Temporal Goals
We present a formal language for specifying qualitative preferences over temporal goals and a preference-based planning method in stochastic systems.
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters
Recent works have demonstrated reasonable success of representation learning in hypercomplex space.
FloW: A Dataset and Benchmark for Floating Waste Detection in Inland Waters
To promote the practical application for autonomous floating wastes cleaning, we present FloW, the first dataset for floating waste detection in inland water areas.
Parameterization of Hypercomplex Multiplications
Recent works have demonstrated reasonable success of representation learning in hypercomplex space.
Attention-Based Planning with Active Perception
By switching between different attention modes, the robot actively perceives task-relevant information to reduce the cost of information acquisition and processing, while achieving near-optimal task performance.
GLGE: A New General Language Generation Evaluation Benchmark
Multi-task benchmarks such as GLUE and SuperGLUE have driven great progress of pretraining and transfer learning in Natural Language Processing (NLP).
Semantic SLAM with Autonomous Object-Level Data Association
It is often desirable to capture and map semantic information of an environment during simultaneous localization and mapping (SLAM).
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space
In this paper, we propose a novel data augmentation method, referred to as Controllable Rewriting based Question Data Augmentation (CRQDA), for machine reading comprehension (MRC), question generation, and question-answering natural language inference tasks.
A Theory of Hypergames on Graphs for Synthesizing Dynamic Cyber Defense with Deception
Given qualitative security specifications in formal logic, we show that the solution concepts from hypergames and reactive synthesis in formal methods can be extended to synthesize effective dynamic defense strategy using cyber deception.
Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences
Understanding human preferences, along with cultural and social nuances, lives at the heart of natural language understanding.
CoCon: A Self-Supervised Approach for Controlled Text Generation
While there are studies that seek to control high-level attributes (such as sentiment and topic) of generated text, there is still a lack of more precise control over its content at the word- and phrase-level.
RikiNet: Reading Wikipedia Pages for Natural Question Answering
The representations are then fed into the predictor to obtain the span of the short answer, the paragraph of the long answer, and the answer type in a cascaded manner.
Role-Wise Data Augmentation for Knowledge Distillation
To our knowledge, existing methods overlook the fact that although the student absorbs extra knowledge from the teacher, both models share the same input data -- and this data is the only medium by which the teacher's knowledge can be demonstrated.
Feature Lenses: Plug-and-play Neural Modules for Transformation-Invariant Visual Representations
To make CNNs more invariant to transformations, we propose "Feature Lenses", a set of ad-hoc modules that can be easily plugged into a trained model (referred to as the "host model").
Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation
Furthermore, we propose a simple and effective method to mine the keyphrases of interest in the news article and build a first large-scale keyphrase-aware news headline corpus, which contains over 180K aligned triples of $<$news article, headline, keyphrase$>$.
A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles
The truncated Q-function utilizes the shared information from neighboring CAVs such that the joint state and action spaces of the Q-function do not grow in our algorithm for a large-scale CAV system.
Learning to Locomote with Deep Neural-Network and CPG-based Control in a Soft Snake Robot
Inspired by biological snakes, our control architecture is composed of two key modules: A deep reinforcement learning (RL) module for achieving adaptive goal-tracking behaviors with changing goals, and a central pattern generator (CPG) system with Matsuoka oscillators for generating stable and diverse locomotion patterns.
Jacobian Adversarially Regularized Networks for Robustness
Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks.
Learning Sparse Mixture of Experts for Visual Question Answering
We aim to tackle this issue for the specific task of Visual Question Answering (VQA).
Deep Learning-based Radiomic Features for Improving Neoadjuvant Chemoradiation Response Prediction in Locally Advanced Rectal Cancer
The model built with handcrafted features achieved the mean area under the ROC curve (AUC) of 0. 64, while the one built with DL-based features yielded the mean AUC of 0. 73.
Exploring Domain Shift in Extractive Text Summarization
Although domain shift has been well explored in many NLP applications, it still has received little attention in the domain of extractive text summarization.
Interactive Language Learning by Question Answering
In QAit, an agent must interact with a partially observable text-based environment to gather information required to answer questions.
Interactive Machine Comprehension with Information Seeking Agents
Existing machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA).
Conditional Computation for Continual Learning
In this study, we analyze parameter sharing under the conditional computation framework where the parameters of a neural network are conditioned on each input example.
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
Many state-of-the-art neural models for NLP are heavily parameterized and thus memory inefficient.
Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learning
We propose a new framework that utilizes the gradients to revise the sentence in a continuous space during inference to achieve text style transfer.
Structure Learning for Neural Module Networks
In current formulations of such networks only the parameters of the neural modules and/or the order of their execution is learned.
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives
This paper tackles the problem of reading comprehension over long narratives where documents easily span over thousands of tokens.
TIGS: An Inference Algorithm for Text Infilling with Gradient Search
Text infilling is defined as a task for filling in the missing part of a sentence or paragraph, which is suitable for many real-world natural language generation scenarios.
Language Modeling with Graph Temporal Convolutional Networks
Recently, there have been some attempts to use non-recurrent neural models for language modeling.
Graph Neural Networks with Generated Parameters for Relation Extraction
Recently, progress has been made towards improving relational reasoning in machine learning field.
Dataflow-based Joint Quantization of Weights and Activations for Deep Neural Networks
This paper addresses a challenging problem - how to reduce energy consumption without incurring performance drop when deploying deep neural networks (DNNs) at the inference stage.
Multi-task Learning over Graph Structures
We present two architectures for multi-task learning with neural sequence models.
Compositional planning in Markov decision processes: Temporal abstraction meets generalized logic composition
Thus, a synthesis algorithm is developed to compute optimal policies efficiently by planning with primitive actions, policies for sub-tasks, and the compositions of sub-policies, for maximizing the probability of satisfying temporal logic specifications.
BFGAN: Backward and Forward Generative Adversarial Networks for Lexically Constrained Sentence Generation
Incorporating prior knowledge like lexical constraints into the model's output to generate meaningful and coherent sentences has many applications in dialogue system, machine translation, image captioning, etc.
Human-in-the-Loop Synthesis for Partially Observable Markov Decision Processes
The efficient verification of this MC gives quantitative insights into the quality of the inferred human strategy by proving or disproving given system specifications.
Inverse Reinforce Learning with Nonparametric Behavior Clustering
In this paper, we introduce the Non-parametric Behavior Clustering IRL algorithm to simultaneously cluster demonstrations and learn multiple reward functions from demonstrations that may be generated from more than one behaviors.
Environment-Independent Task Specifications via GLTL
We propose a new task-specification language for Markov decision processes that is designed to be an improvement over reward functions by being environment independent.
Adaptive Bidirectional Backpropagation: Towards Biologically Plausible Error Signal Transmission in Neural Networks
However, it has been argued that this is not biologically plausible because back-propagating error signals with the exact incoming weights are not considered possible in biological neural systems.
Importance sampling-based approximate optimal planning and control
In this paper, we propose a sampling-based planning and optimal control method of nonlinear systems under non-differentiable constraints.
Systems and Control Robotics 70E60
Deep Q-Networks for Accelerating the Training of Deep Neural Networks
With our approach, a deep RL agent (synonym for optimizer in this work) is used to automatically learn policies about how to schedule learning rates during the optimization of a DNN.
DrMAD: Distilling Reverse-Mode Automatic Differentiation for Optimizing Hyperparameters of Deep Neural Networks
The performance of deep neural networks is well-known to be sensitive to the setting of their hyperparameters.
Integrating active sensing into reactive synthesis with temporal logic constraints under partial observations
We show that by alternating between the observation-based strategy and the active sensing strategy, under a mild technical assumption of the set of sensors in the system, the given temporal logic specification can be satisfied with probability 1.
Probably Approximately Correct MDP Learning and Control With Temporal Logic Constraints
We model the interaction between the system and its environment as a Markov decision process (MDP) with initially unknown transition probabilities.
