Search Results for author:
Found 101 papers, 38 papers with code
Dual-Space Analysis of the Sparse Linear Model
In contrast, for analyses of update rules and sparsity properties of local and global solutions, as well as extensions to more general likelihood models, we can leverage coefficient-space techniques developed for Type I and apply them to Type II.
Online Object Tracking: A Benchmark
Object tracking is one of the most important components in numerous applications of computer vision.
Robust Visual Tracking via Convolutional Networks
In this paper we present that, even without offline training with a large amount of auxiliary data, simple two-layer convolutional networks can be powerful enough to develop a robust representation for visual tracking.
Tractability and Decompositions of Global Cost Functions
A global cost function is called tractable projection-safe when applying an EPT to it is tractable and does not break the tractability property.
Adaptive Compressive Tracking via Online Vector Boosting Feature Selection
Recently, the compressive tracking (CT) method has attracted much attention due to its high efficiency, but it cannot well deal with the large scale target appearance variations due to its data-independent random projection matrix that results in less discriminative features.
Value Iteration Networks
We introduce the value iteration network (VIN): a fully differentiable neural network with a `planning module' embedded within.
Towards Practical Bayesian Parameter and State Estimation
Joint state and parameter estimation is a core problem for dynamic Bayesian networks.
Improving the Annotation of Sentence Specificity
We found that the lack of specificity distributes evenly among immediate prior context, long distance prior context and no prior context.
Swift: Compiled Inference for Probabilistic Programming Languages
A probabilistic program defines a probability measure over its semantic structures.
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
We explore deep reinforcement learning methods for multi-agent domains.
Ranked #1 on
SMAC+
on Def_Infantry_sequential
CoupleNet: Coupling Global Structure with Local Parts for Object Detection
To fully explore the local and global properties, in this paper, we propose a novel fully convolutional network, named as CoupleNet, to couple the global structure with local parts for object detection.
Ranked #5 on
Object Detection
on PASCAL VOC 2007
Meta-Learning MCMC Proposals
The learned neural proposals generalize to occurrences of common structural motifs across different models, allowing for the construction of a library of learned inference primitives that can accelerate inference on unseen models with no model-specific training required.
Adversarial Training for Relation Extraction
Adversarial training is a mean of regularizing classification algorithms by generating adversarial noise to the training data.
Egocentric Gesture Recognition Using Recurrent 3D Convolutional Neural Networks With Spatiotemporal Transformer Modules
Gesture is a natural interface in interacting with wearable devices such as VR/AR helmet and glasses.
Building Generalizable Agents with a Realistic and Rich 3D Environment
To generalize to unseen environments, an agent needs to be robust to low-level variations (e. g. color, texture, object changes), and also high-level variations (e. g. layout changes of the environment).
Near-Linear Time Local Polynomial Nonparametric Estimation with Box Kernels
Local polynomial regression (Fan and Gijbels 1996) is an important class of methods for nonparametric density estimation and regression problems.
Discrete-Continuous Mixtures in Probabilistic Programming: Generalized Semantics and Inference Algorithms
Despite the recent successes of probabilistic programming languages (PPLs) in AI applications, PPLs offer only limited support for random variables whose distributions combine discrete and continuous elements.
Robust Fuzzy-Learning For Partially Overlapping Channels Allocation In UAV Communication Networks
This allows the system to achieve a smoother and more robust performance by optimizing in an alternate space.
Learning and Planning with a Semantic Model
Building deep reinforcement learning agents that can generalize and adapt to unseen environments remains a fundamental challenge for AI.
Deep Reinforcement Learning for Green Security Games with Real-Time Information
Green Security Games (GSGs) have been proposed and applied to optimize patrols conducted by law enforcement agencies in green security domains such as combating poaching, illegal logging and overfishing.
Fairness in Recommendation Ranking through Pairwise Comparisons
Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information.
Bayesian Relational Memory for Semantic Visual Navigation
We introduce a new memory architecture, Bayesian Relational Memory (BRM), to improve the generalization ability for semantic visual navigation agents in unseen environments, where an agent is given a semantic target to navigate towards.
Emergent Tool Use From Multi-Agent Autocurricula
Through multi-agent competition, the simple objective of hide-and-seek, and standard reinforcement learning algorithms at scale, we find that agents create a self-supervised autocurriculum inducing multiple distinct rounds of emergent strategy, many of which require sophisticated tool use and coordination.
PPGAN: Privacy-preserving Generative Adversarial Network
To address this issue, we propose a Privacy-preserving Generative Adversarial Network (PPGAN) model, in which we achieve differential privacy in GANs by adding well-designed noise to the gradient during the model learning procedure.
Influence-Based Multi-Agent Exploration
We present two exploration methods: exploration via information-theoretic influence (EITI) and exploration via decision-theoretic influence (EDTI), by exploiting the role of interaction in coordinated behaviors of agents.
SQLFlow: A Bridge between SQL and Machine Learning
Previous database systems extended their SQL dialect to support ML.
Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement Learning
In multi-agent games, the complexity of the environment can grow exponentially as the number of agents increases, so it is particularly challenging to learn good policies when the agent population is large.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
SaccadeNet: A Fast and Accurate Object Detector
Object detection is an essential step towards holistic scene understanding.
Ranked #194 on
Object Detection
on COCO test-dev
Multi-Task Reinforcement Learning with Soft Modularization
While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains unclear what parameters in the network should be reused across tasks, and how the gradients from different tasks may interfere with each other.
Ranked #1 on
Meta-Learning
on MT50
Unsupervised Deformable Medical Image Registration via Pyramidal Residual Deformation Fields Estimation
In fact, due to the limitation of the receptive field, the 3 x 3 kernel has difficulty in covering the corresponding features at high/original resolution.
Hybrid-Attention Guided Network with Multiple Resolution Features for Person Re-Identification
Finally, we reconstruct the feature extractor to ensure that our model can obtain more richer and robust features.
Streaming Graph Neural Networks via Continual Learning
In this paper, we propose a streaming GNN model based on continual learning so that the model is trained incrementally and up-to-date node representations can be obtained at each time step.
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers
We also find in experiments that our model is less dependent on sentence positions.
Multi-Agent Collaboration via Reward Attribution Decomposition
In this work, we propose Collaborative Q-learning (CollaQ) that achieves state-of-the-art performance in the StarCraft multi-agent challenge and supports ad hoc team play.
Charge density wave and weak Kondo effect in a Dirac semimetal CeSbTe
Using angle-resolved photoemission spectroscopy (ARPES) and low-energy electron diffraction (LEED), together with density-functional theory (DFT) calculation, we report the formation of charge density wave (CDW) and its interplay with the Kondo effect and topological states in CeSbTe.
Strongly Correlated Electrons Materials Science
BeBold: Exploration Beyond the Boundary of Explored Regions
In this paper, we analyze the pros and cons of each method and propose the regulated difference of inverse visitation counts as a simple but effective criterion for IR.
Deep Q-Learning with Low Switching Cost
We initiate the study on deep reinforcement learning problems that require low switching cost, i. e., small number of policy switches during training.
Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms
We benchmark commonly used multi-agent deep reinforcement learning (MARL) algorithms on a variety of cooperative multi-agent games.
Growth, Electronic Structure and Superconductivity of Ultrathin Epitaxial CoSi2 Films
We report growth, electronic structure and superconductivity of ultrathin epitaxial CoSi2 films on Si(111).
Mesoscale and Nanoscale Physics
The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Games
This is often due to the belief that PPO is significantly less sample efficient than off-policy methods in multi-agent systems.
Multi-agent Reinforcement Learning
reinforcement-learning
+3
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization
We propose a simple, general and effective technique, Reward Randomization for discovering diverse strategic policies in complex multi-agent games.
Solving Compositional Reinforcement Learning Problems via Task Reduction
We propose a novel learning paradigm, Self-Imitation via Reduction (SIR), for solving compositional reinforcement learning problems.
Reference-Aided Part-Aligned Feature Disentangling for Video Person Re-Identification
Due to the inaccurate person detections and pose changes, pedestrian misalignment significantly increases the difficulty of feature extraction and matching.
Theoretically Improving Graph Neural Networks via Anonymous Walk Graph Kernels
However, the inability of GNNs to model substructures in graphs remains a significant drawback.
Classifying herbal medicine origins by temporal and spectral data mining of electronic nose
In this study, we classified different origins of three categories of herbal medicines with different feature extraction methods: manual feature extraction, mathematical transformation, deep learning algorithms.
FedDPGAN: Federated Differentially Private Generative Adversarial Networks Framework for the Detection of COVID-19 Pneumonia
Under the FL framework and Differentially Private thinking, we propose a FederatedDifferentially Private Generative Adversarial Network (FedDPGAN) to detectCOVID-19 pneumonia for sustainable smart cities.
DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation
We address the problem of safely solving complex bimanual robot manipulation tasks with sparse rewards.
BLCUFIGHT at SemEval-2021 Task 10: Novel Unsupervised Frameworks For Source-Free Domain Adaptation
Domain adaptation assumes that samples from source and target domains are freely accessible during a training phase.
Learning to Design and Construct Bridge without Blueprint
In this task, the robot needs to first design a feasible bridge architecture for arbitrarily wide cliffs and then manipulate the blocks reliably to construct a stable bridge according to the proposed design.
Temporal Induced Self-Play for Stochastic Bayesian Games
One practical requirement in solving dynamic games is to ensure that the players play well from any decision point onward.
Sequence Level Contrastive Learning for Text Summarization
In this paper, we propose a contrastive learning model for supervised abstractive text summarization, where we view a document, its gold summary and its model generated summaries as different views of the same mean representation and maximize the similarities between them during training.
SDWNet: A Straight Dilated Network with Wavelet Transformation for Image Deblurring
On this basis, we reduce the number of up-sampling and down-sampling and design a simple network structure.
Ranked #1 on
Image Deblurring
on RealBlur-R(trained on GoPro)
Learning Efficient Multi-Agent Cooperative Visual Exploration
In this paper, we extend the state-of-the-art single-agent visual navigation method, Active Neural SLAM (ANS), to the multi-agent setting by introducing a novel RL-based planning module, Multi-agent Spatial Planner (MSP). MSP leverages a transformer-based architecture, Spatial-TeamFormer, which effectively captures spatial relations and intra-agent interactions via hierarchical spatial self-attentions.
Semi-Supervised Federated Learning with non-IID Data: Algorithm and System Design
In this paper, we present a robust semi-supervised FL system design, where the system aims to solve the problem of data availability and non-IID in FL.
PhyloTransformer: A Discriminative Model for Mutation Prediction Based on a Multi-head Self-attention Mechanism
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has caused an ongoing pandemic infecting 219 million people as of 10/19/21, with a 3. 6% mortality rate.
Variational Automatic Curriculum Learning for Sparse-Reward Cooperative Multi-Agent Problems
We motivate our paradigm through a variational perspective, where the learning objective can be decomposed into two terms: task learning on the current task distribution, and curriculum update to a new task distribution.
Nonlinear Intensity Sonar Image Matching based on Deep Convolution Features
In the field of deep-sea exploration, sonar is presently the only efficient long-distance sensing device.
NovelD: A Simple yet Effective Exploration Criterion
We analyze NovelD thoroughly in MiniGrid and found that empirically it helps the agent explore the environment more uniformly with a focus on exploring beyond the boundary.
Multi-Agent Vulnerability Discovery for Autonomous Driving with Hazard Arbitration Reward
These scenarios indeed correspond to the vulnerabilities of the under-test driving policies, thus are meaningful for their further improvements.
Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehension
We present Native Chinese Reader (NCR), a new machine reading comprehension (MRC) dataset with particularly long articles in both modern and classical Chinese.
A Benchmark for Low-Switching-Cost Reinforcement Learning
A ubiquitous requirement in many practical reinforcement learning (RL) applications, including medical treatment, recommendation system, education and robotics, is that the deployed policy that actually interacts with the environment cannot change frequently.
Maximum Entropy Population-Based Training for Zero-Shot Human-AI Coordination
We study the problem of training a Reinforcement Learning (RL) agent that is collaborative with humans without using any human data.
Robust Semi-supervised Federated Learning for Images Automatic Recognition in Internet of Drones
This emerging technology relies on sharing ground truth labeled data between Unmanned Aerial Vehicle (UAV) swarms to train a high-quality automatic image recognition model.
Understanding Curriculum Learning in Policy Optimization for Online Combinatorial Optimization
Furthermore, our theory explains the benefit of curriculum learning: it can find a strong sampling policy and reduce the distribution shift, a critical quantity that governs the convergence rate in our theorem.
Continuously Discovering Novel Strategies via Reward-Switching Policy Optimization
We present Reward-Switching Policy Optimization (RSPO), a paradigm to discover diverse strategies in complex RL environments by iteratively finding novel policies that are both locally optimal and sufficiently different from existing ones.
E^2TAD: An Energy-Efficient Tracking-based Action Detector
Video action detection (spatio-temporal action localization) is usually the starting point for human-centric intelligent analysis of videos nowadays.
Learning Design and Construction with Varying-Sized Materials via Prioritized Memory Resets
Can a robot autonomously learn to design and construct a bridge from varying-sized blocks without a blueprint?
Self-Calibrated Efficient Transformer for Lightweight Super-Resolution
Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance.
Efficient Federated Learning with Spike Neural Networks for Traffic Sign Recognition
However, for machine learning-based traffic sign recognition on the Internet of Vehicles (IoV), a large amount of traffic sign data from distributed vehicles is needed to be gathered in a centralized server for model training, which brings serious privacy leakage risk because of traffic sign data containing lots of location privacy information.
Revisiting Some Common Practices in Cooperative Multi-Agent Reinforcement Learning
Despite all the advantages, we revisit these two principles and show that in certain scenarios, e. g., environments with a highly multi-modal reward landscape, value decomposition, and parameter sharing can be problematic and lead to undesired outcomes.
Multi-agent Reinforcement Learning
reinforcement-learning
+2
Phasic Self-Imitative Reduction for Sparse-Reward Goal-Conditioned Reinforcement Learning
It has been a recent trend to leverage the power of supervised learning (SL) towards more effective reinforcement learning (RL) methods.
Hand-Assisted Expression Recognition Method from Synthetic Images at the Fourth ABAW Challenge
Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images.
Facial Expression Recognition
Facial Expression Recognition (FER)
Multi-Task Learning for Emotion Descriptors Estimation at the fourth ABAW Challenge
The 4th competition on affective behavior analysis in the wild (ABAW) provided images with valence/arousal, expression and action unit labels.
FedBA: Non-IID Federated Learning Framework in UAV Networks
This is because most drones still use centralized cloud-based data processing, which may lead to leakage of data collected by drones.
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation
In this paper, we focus on two key questions in knowledge distillation for ranking models: 1) how to ensemble knowledge from multi-teacher; 2) how to utilize the label information of data in the distillation process.
AlphaSnake: Policy Iteration on a Nondeterministic NP-hard Markov Decision Process
Reinforcement learning has recently been used to approach well-known NP-hard combinatorial problems in graph theory.
Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning
Hence, we propose Pre-trained Image Encoder for Generalizable visual reinforcement learning (PIE-G), a simple yet effective framework that can generalize to the unseen visual scenarios in a zero-shot manner.
SOAR: Scene-debiasing Open-set Action Recognition
Deep models have the risk of utilizing spurious clues to make predictions, e. g., recognizing actions via classifying the background scene.
Asynchronous Multi-Agent Reinforcement Learning for Efficient Real-Time Multi-Robot Cooperative Exploration
Simply waiting for every robot being ready for the next action can be particularly time-inefficient.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
Learning Zero-Shot Cooperation with Humans, Assuming Humans Are Biased
A crucial limitation of this framework is that every policy in the pool is optimized w. r. t.
Differentiable Arbitrating in Zero-sum Markov Games
We initiate the study of how to perturb the reward in a zero-sum Markov game with two players to induce a desirable Nash equilibrium, namely arbitrating.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
Emotional Reaction Intensity Estimation Based on Multimodal Data
In this paper, 1. better features are extracted with the SOTA pretrained models.
Facial Affective Behavior Analysis Method for 5th ABAW Competition
Facial affective behavior analysis is important for human-computer interaction.
Efficient bimanual handover and rearrangement via symmetry-aware actor-critic learning
We develop a symmetry-aware actor-critic framework that leverages the interchangeable roles of the two manipulators in the bimanual control setting to reduce the policy search space.
How Effective Are Neural Networks for Fixing Security Vulnerabilities
The results call for innovations to enhance automated Java vulnerability repair such as creating larger vulnerability repair training data, tuning LLMs with such data, and applying code simplification transformation to facilitate vulnerability repair.
Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarios
However, existing backdoor attack methods make unrealistic assumptions, assuming that all training data comes from a single source and that attackers have full access to the training data.
Automatic Truss Design with Reinforcement Learning
Directly applying end-to-end reinforcement learning (RL) methods to truss layout design is infeasible either, since only a tiny portion of the entire layout space is valid under the physical constraints, leading to particularly sparse rewards for RL training.
SRL: Scaling Distributed Reinforcement Learning to Over Ten Thousand Cores
In a large-scale cluster, the novel architecture of SRL leads to up to 3. 7x speedup compared to the design choices adopted by the existing libraries.
BrickPal: Augmented Reality-based Assembly Instructions for Brick Models
The assembly instruction is a mandatory component of Lego-like brick sets. The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets. Moreover, the traditional paper-based instructions lack expressiveness and interactivity. To tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display.
Quarl: A Learning-Based Quantum Circuit Optimizer
Applying reinforcement learning (RL) to quantum circuit optimization raises two main challenges: the large and varying action space and the non-uniform state representation.
DeRisk: An Effective Deep Learning Framework for Credit Risk Prediction over Real-World Financial Data
Despite the tremendous advances achieved over the past years by deep learning techniques, the latest risk prediction models for industrial applications still rely on highly handtuned stage-wised statistical learning tools, such as gradient boosting and random forest methods.
OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Control
In this work, we introduce OmniDrones, an efficient and flexible platform tailored for reinforcement learning in drone control, built on Nvidia's Omniverse Isaac Sim.
Fictitious Cross-Play: Learning Global Nash Equilibrium in Mixed Cooperative-Competitive Games
Alternatively, Policy-Space Response Oracles (PSRO) is an iterative framework for learning NE, where the best responses w. r. t.
Accelerate Multi-Agent Reinforcement Learning in Zero-Sum Games with Subgame Curriculum Learning
In this work, we present a novel subgame curriculum learning framework for zero-sum games.
BitNet: Scaling 1-bit Transformers for Large Language Models
The increasing size of large language models has posed challenges for deployment and raised concerns about environmental impact due to high energy consumption.
Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game
To mitigate the intrinsic bias in language actions, our agents use an LLM to perform deductive reasoning and generate a diverse set of action candidates.
Evolving Domain Adaptation of Pretrained Language Models for Text Classification
Adapting pre-trained language models (PLMs) for time-series text classification amidst evolving domain shifts (EDS) is critical for maintaining accuracy in applications like stance detection.
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing
In this paper, we introduce a system that leverages visual and tactile sensory inputs to enable dexterous in-hand manipulation.
LLM-Powered Hierarchical Language Agent for Real-time Human-AI Coordination
AI agents powered by Large Language Models (LLMs) have made significant advances, enabling them to assist humans in diverse complex tasks and leading to a revolution in human-AI coordination.
Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigm
Drawing on recent advancements in diffusion models for text-to-image generation, identity-preserved personalization has made significant progress in accurately capturing specific identities with just a single reference image.
Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study
However, in academic benchmarks, state-of-the-art results are often achieved via reward-free methods, such as Direct Preference Optimization (DPO).
