Search Results for author:
Found 215 papers, 119 papers with code
Simultaneous Sparse Dictionary Learning and Pruning
Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks.
Local Region Sparse Learning for Image-on-Scalar Regression
Identification of regions of interest (ROI) associated with certain disease has a great impact on public health.
Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization
In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that noisy information about the gradients of the objective function is available via a stochastic first-order oracle (SFO).
Font Size: Community Preserving Network Embedding
While previous network embedding methods primarily preserve the microscopic structure, such as the first- and second-order proximities of nodes, the mesoscopic community structure, which is one of the most prominent feature of networks, is largely ignored.
On the Statistical Efficiency of Compositional Nonparametric Prediction
In this paper, we propose a compositional nonparametric method in which a model is expressed as a labeled binary tree of $2k+1$ nodes, where each node is either a summation, a multiplication, or the application of one of the $q$ basis functions to one of the $p$ covariates.
Detecting Drivable Area for Self-driving Cars: An Unsupervised Approach
Experiments show that our unsupervised approach is efficient and robust for detecting drivable area for self-driving cars.
Deep Co-Space: Sample Mining Across Feature Transformation for Semi-Supervised Learning
Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS).
A Survey on Network Embedding
Network embedding assigns nodes in a network to low-dimensional representations and effectively preserves the network structure.
Social and Information Networks
TIMERS: Error-Bounded SVD Restart on Dynamic Networks
By setting a maximum tolerated error as a threshold, we can trigger SVD restart automatically when the margin exceeds this threshold. We prove that the time complexity of our method is linear with respect to the number of local dynamic changes, and our method is general across different types of dynamic networks.
Social and Information Networks
Structural Deep Embedding for Hyper-Networks
These hyper-networks pose great challenges to existing network embedding methods when the hyperedges are indecomposable, that is to say, any subset of nodes in a hyperedge cannot form another hyperedge.
Social and Information Networks
Structured Illumination in Spatial-Orientational Hyperspace
The dipole nature of chromophore is important for both super-resolution microscopy and imaging molecular structure, which is nevertheless neglected in most microscopies, even including structured illumination microscopy (SIM) with polarized excitations.
Optics
Semi-Supervised Convolutional Neural Networks for Human Activity Recognition
Labeled data used for training activity recognition classifiers are usually limited in terms of size and diversity.
Tracking Multiple Moving Objects Using Unscented Kalman Filtering Techniques
Considering the ambiguity caused by the occlusion among multiple moving objects, we apply an unscented Kalman filtering (UKF) technique for reliable object detection and tracking.
Billion-scale Network Embedding with Iterative Random Projection
Network embedding, which learns low-dimensional vector representation for nodes in the network, has attracted considerable research attention recently.
SINT++: Robust Visual Tracking via Adversarial Positive Instance Generation
Based on the generated hard positive samples, we train a Siamese network for visual tracking and our experiments validate the effectiveness of the introduced algorithm.
Defensive Dropout for Hardening Deep Neural Networks under Adversarial Attacks
Based on the observations of the effect of test dropout rate on test accuracy and attack success rate, we propose a defensive dropout algorithm to determine an optimal test dropout rate given the neural network model and the attacker's strategy for generating adversarial examples. We also investigate the mechanism behind the outstanding defense effects achieved by the proposed defensive dropout.
Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units
This paper presents a general framework for norm-based capacity control for $L_{p, q}$ weight normalized deep neural networks.
Most Probable Evolution Trajectories in a Genetic Regulatory System Excited by Stable Lévy Noise
We especially examine those most probable trajectories from low concentration state to high concentration state (i. e., the likely transcription regime) for certain parameters, in order to gain insights into the transcription processes and the tipping time for the transcription likely to occur.
Describe and Attend to Track: Learning Natural Language guided Structural Representation and Visual Attention for Object Tracking
To refine the states of the target and re-track the target when it is back to view from heavy occlusion and out of view, we elaborately design a novel subnetwork to learn the target-driven visual attentions from the guidance of both visual and natural language cues.
Quality-Aware Multimodal Saliency Detection via Deep Reinforcement Learning
In this paper, we propose an efficient quality-aware deep neural network to model the weight of data from each domain using deep reinforcement learning (DRL).
Pedestrian Attribute Recognition: A Survey
We also review some popular network architectures which have been widely applied in the deep learning community.
Heterogeneous Graph Attention Network
With the learned importance from both node-level and semantic-level attention, the importance of node and meta-path can be fully considered.
Ranked #1 on
Heterogeneous Node Classification
on DBLP (PACT) 14k
Social and Information Networks
Improved Hard Example Mining by Discovering Attribute-based Hard Person Identity
In this paper, we propose Hard Person Identity Mining (HPIM) that attempts to refine the hard example mining to improve the exploration efficacy in person re-identification.
Learning Generalized Transformation Equivariant Representations via Autoencoding Transformations
Transformation Equivariant Representations (TERs) aim to capture the intrinsic visual structures that equivary to various transformations by expanding the notion of {\em translation} equivariance underlying the success of Convolutional Neural Networks (CNNs).
Dense Feature Aggregation and Pruning for RGBT Tracking
In different modalities, we propose to prune the densely aggregated features of all modalities in a collaborative way.
Deep Learning Models to Predict Pediatric Asthma Emergency Department Visits
Pediatric asthma is the most prevalent chronic childhood illness, afflicting about 6. 2 million children in the United States.
Learning Target-oriented Dual Attention for Robust RGB-T Tracking
RGB-Thermal object tracking attempt to locate target object using complementary visual and thermal infrared data.
Protecting Neural Networks with Hierarchical Random Switching: Towards Better Robustness-Accuracy Trade-off for Stochastic Defenses
However, one critical drawback of current defenses is that the robustness enhancement is at the cost of noticeable performance degradation on legitimate data, e. g., large drop in test accuracy.
Temporal Network Embedding with Micro- and Macro-dynamics
The micro-dynamics describe the formation process of network structures in a detailed manner, while the macro-dynamics refer to the evolution pattern of the network scale.
Deep Collaborative Filtering with Multi-Aspect Information in Heterogeneous Networks
However, the characteristics of users and the properties of items may stem from different aspects, e. g., the brand-aspect and category-aspect of items.
iWGAN: an Autoencoder WGAN for Inference
We further provide a rigorous probabilistic interpretation of our model under the framework of maximum likelihood estimation.
Sensible adversarial learning
The trade-off between robustness and standard accuracy has been consistently reported in the machine learning literature.
A Uniform Generalization Error Bound for Generative Adversarial Networks
To better understand the unsupervised model, GANs, we establish the generalization bound, which uniformly holds with respect to the choice of generators.
DG-GAN: the GAN with the duality gap
Generative Adversarial Networks (GANs) are powerful, but difficult to understand and train because GANs is a min-max problem.
ISTHMUS: Secure, Scalable, Real-time and Robust Machine Learning Platform for Healthcare
There are multiple reasons why integrating ML models into healthcare has not been widely successful, but from a technical perspective, general-purpose commercial machine learning platforms are not a good fit for healthcare due to complexities in handling data quality issues, mandates to demonstrate clinical relevance, and a lack of ability to monitor performance in a highly regulated environment with stringent security and privacy needs.
Eavesdrop the Composition Proportion of Training Labels in Federated Learning
Federated learning (FL) has recently emerged as a new form of collaborative machine learning, where a common model can be learned while keeping all the training data on local devices.
EnAET: A Self-Trained framework for Semi-Supervised and Supervised Learning with Ensemble Transformations
In this study, we propose a new EnAET framework to further improve existing semi-supervised methods with self-supervised information.
Ranked #1 on
Semi-Supervised Image Classification
on STL-10
Multi-Component Graph Convolutional Collaborative Filtering
The interactions of users and items in recommender system could be naturally modeled as a user-item bipartite graph.
Independence Promoted Graph Disentangled Networks
In this paper, we propose a novel Independence Promoted Graph Disentangled Networks (IPGDN) to learn disentangled node representation while enhancing the independence among node representations.
Nanoconfined, dynamic electrolyte gating and memory effects in multilayered graphene-based membranes
Multilayered graphene-based nanoporous membranes with electrolyte incorporated between individual sheets is a unique nano-heterostructure system in which nanoconfined electrons in graphene and ions confined in between sheets are intimately coupled throughout the entire membrane.
Mesoscale and Nanoscale Physics Materials Science Soft Condensed Matter Applied Physics Chemical Physics
Hyperbolic Graph Attention Network
Graph neural network (GNN) has shown superior performance in dealing with graphs, which has attracted considerable research attention recently.
Depth-Width Trade-offs for ReLU Networks via Sharkovsky's Theorem
Motivated by our observation that the triangle waves used in Telgarsky's work contain points of period 3 - a period that is special in that it implies chaotic behavior based on the celebrated result by Li-Yorke - we proceed to give general lower bounds for the width needed to represent periodic functions as a function of the depth.
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data
We present a large and realistic natural language question answering dataset that is constructed according to this method, and we use it to analyze the compositional generalization ability of three machine learning architectures.
Ranked #5 on
Semantic Parsing
on CFQ
\emph{cm}SalGAN: RGB-D Salient Object Detection with Cross-View Generative Adversarial Networks
Fusing complementary information of RGB and depth has been demonstrated to be effective for image salient object detection which is known as RGB-D salient object detection problem.
Physics-Based Iterative Reconstruction for Dual Source and Flying Focal Spot Computed Tomography
Our algorithm uses precise physics models to reconstruct from the native cone-beam geometry and interleaved dual source helical trajectory of a DS-FFS CT. To do so, we construct a noise physics model to represent data acquisition noise and a prior image model to represent image noise and texture.
Structural Deep Clustering Network
The strength of deep clustering methods is to extract the useful representations from the data itself, rather than the structure of data, which receives scarce attention in representation learning.
Stochastic Approximate Gradient Descent via the Langevin Algorithm
We introduce a novel and efficient algorithm called the stochastic approximate gradient descent (SAGD), as an alternative to the stochastic gradient descent for cases where unbiased stochastic gradients cannot be trivially obtained.
Last iterate convergence in no-regret learning: constrained min-max optimization for convex-concave landscapes
In a recent series of papers it has been established that variants of Gradient Descent/Ascent and Mirror Descent exhibit last iterate convergence in convex-concave zero-sum games.
Block Switching: A Stochastic Approach for Deep Learning Security
Recent study of adversarial attacks has revealed the vulnerability of modern deep learning models.
AdvMS: A Multi-source Multi-cost Defense Against Adversarial Attacks
Designing effective defense against adversarial attacks is a crucial topic as deep neural networks have been proliferated rapidly in many security-critical domains such as malware detection and self-driving cars.
Convergence to Second-Order Stationarity for Non-negative Matrix Factorization: Provably and Concurrently
Non-negative matrix factorization (NMF) is a fundamental non-convex optimization problem with numerous applications in Machine Learning (music analysis, document clustering, speech-source separation etc).
FMT:Fusing Multi-task Convolutional Neural Network for Person Search
Person search is to detect all persons and identify the query persons from detected persons in the image without proposals and bounding boxes, which is different from person re-identification.
Unbiased Contrastive Divergence Algorithm for Training Energy-Based Latent Variable Models
The contrastive divergence algorithm is a popular approach to training energy-based latent variable models, which has been widely used in many machine learning models such as the restricted Boltzmann machines and deep belief nets.
Decorrelated Clustering with Data Selection Bias
Most of existing clustering algorithms are proposed without considering the selection bias in data.
Falsification-Based Robust Adversarial Reinforcement Learning
Robust adversarial RL (RARL) was previously proposed to train an adversarial network that applies disturbances to a system, which improves the robustness in test scenarios.
AM-GCN: Adaptive Multi-channel Graph Convolutional Networks
We tackle the challenge and propose an adaptive multi-channel graph convolutional networks for semi-supervised classification (AM-GCN).
STADB: A Self-Thresholding Attention Guided ADB Network for Person Re-identification
Specifically, STADB first obtains an attention map by channel-wise pooling and returns a drop mask by thresholding the attention map.
Deep Reinforced Query Reformulation for Information Retrieval
Query reformulations have long been a key mechanism to alleviate the vocabulary-mismatch problem in information retrieval, for example by expanding the queries with related query terms or by generating paraphrases of the queries.
Addressing Class Imbalance in Federated Learning
Our experiments demonstrate the importance of acknowledging class imbalance and taking measures as early as possible in FL training, and the effectiveness of our method in mitigating the impact.
Heterogeneous Graph Neural Network for Recommendation
The prosperous development of e-commerce has spawned diverse recommendation systems.
Dynamic Fusion based Federated Learning for COVID-19 Detection
To improve communication efficiency and model performance, in this paper, we propose a novel dynamic fusion-based federated learning approach for medical diagnostic image analysis to detect COVID-19 infections.
Fast Convergence of Langevin Dynamics on Manifold: Geodesics meet Log-Sobolev
Sampling is a fundamental and arguably very important task with numerous applications in Machine Learning.
Cross-Lingual Document Retrieval with Smooth Learning
Cross-lingual document search is an information retrieval task in which the queries' language differs from the documents' language.
AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries
Contrastive learning relies on constructing a collection of negative examples that are sufficiently hard to discriminate against positive queries when their representations are self-trained.
A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sources
Heterogeneous graphs (HGs) also known as heterogeneous information networks have become ubiquitous in real-world scenarios; therefore, HG embedding, which aims to learn representations in a lower-dimension space while preserving the heterogeneous structures and semantics for downstream tasks (e. g., node/graph classification, node clustering, link prediction), has drawn considerable attentions in recent years.
Deep Q Learning from Dynamic Demonstration with Behavioral Cloning
This study proposes a novel approach integrating deep Q learning from dynamic demonstrations with a behavioral cloning model (DQfDD-BC), which includes a supervised learning technique of instructing a DRL model to enhance its performance.
NeuSpike-Net: High Speed Video Reconstruction via Bio-Inspired Neuromorphic Cameras
In this paper, we propose a NeuSpike-Net to learn both the high dynamic range and high motion sensitivity of DVS and the full texture sampling of spike camera to achieve high-speed and high dynamic image reconstruction.
Beyond Low-frequency Information in Graph Convolutional Networks
For a deeper understanding, we theoretically analyze the roles of low-frequency signals and high-frequency signals on learning node representations, which further explains why FAGCN can perform well on different types of networks.
Interpreting and Unifying Graph Neural Networks with An Optimization Framework
Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks.
CaPC Learning: Confidential and Private Collaborative Learning
There is currently no method that enables machine learning in such a setting, where both confidentiality and privacy need to be preserved, to prevent both explicit and implicit sharing of data.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing
To guarantee user acceptability, all the text transformations are linguistically based, and we provide a human evaluation for each one.
Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking
In this paper, we propose to introduce more dynamics by devising a dynamic attention-guided multi-trajectory tracking strategy.
Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark
We believe this benchmark will greatly boost related researches on natural language guided tracking.
Ranked #3 on
Visual Object Tracking
on TNL2K
(precision metric)
Contrastive Learning with Stronger Augmentations
Thus, we propose a general framework called Contrastive Learning with Stronger Augmentations~(CLSA) to complement current contrastive learning approaches.
Lorentzian Graph Convolutional Networks
We also find that the performance of some hyperbolic GCNs can be improved by simply replacing the graph operations with those we defined in this paper.
High-Robustness, Low-Transferability Fingerprinting of Neural Networks
This paper proposes Characteristic Examples for effectively fingerprinting deep neural networks, featuring high-robustness to the base model against model pruning as well as low-transferability to unassociated models.
Substitutional Neural Image Compression
The key idea is to replace the image to be compressed with a substitutional one that outperforms the original one in a desired way.
Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning
Then the cross-view contrastive learning, as well as a view mask mechanism, is proposed, which is able to extract the positive and negative embeddings from two views.
Guidance and Teaching Network for Video Salient Object Detection
Owing to the difficulties of mining spatial-temporal cues, the existing approaches for video salient object detection (VSOD) are limited in understanding complex and noisy scenarios, and often fail in inferring prominent objects.
Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmark
We also verified that models pre-trained on LaST can generalize well on existing datasets with short-term and cloth-changing scenarios.
Tracking by Joint Local and Global Search: A Target-aware Attention based Approach
In this paper, we propose a novel and general target-aware attention mechanism (termed TANet) and integrate it with tracking-by-detection framework to conduct joint local and global search for robust tracking.
Non-Transferable Learning: A New Approach for Model Ownership Verification and Applicability Authorization
Our NTL-based authorization approach instead provides data-centric protection, which we call applicability authorization, by significantly degrading the performance of the model on unauthorized data.
Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
In particular, based on the pseudo-relevant set of documents identified using a first-pass dense retrieval, we extract representative feedback embeddings (using KMeans clustering) -- while ensuring that these embeddings discriminate among passages (based on IDF) -- which are then added to the query representation.
Ranked #1 on
TREC 2019 Passage Ranking
on MSMARCO
Gaze Estimation with an Ensemble of Four Architectures
This paper presents a method for gaze estimation according to face images.
MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking
The visible and thermal filters will be used to conduct a dynamic convolutional operation on their corresponding input feature maps respectively.
Ranked #21 on
Rgb-T Tracking
on RGBT234
Semantic-guided Pixel Sampling for Cloth-Changing Person Re-identification
The key to this task is to exploit cloth-irrelevant cues.
Learn to Match: Automatic Matching Network Design for Visual Tracking
Siamese tracking has achieved groundbreaking performance in recent years, where the essence is the efficient matching operator cross-correlation and its variants.
VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flows
Different from visible cameras which record intensity images frame by frame, the biologically inspired event camera produces a stream of asynchronous and sparse events with much lower latency.
Ranked #1 on
Object Tracking
on VisEvent
Constants of Motion: The Antidote to Chaos in Optimization and Game Dynamics
Several recent works in online optimization and game dynamics have established strong negative complexity results including the formal emergence of instability and chaos even in small such settings, e. g., $2\times 2$ games.
Inferential Wasserstein Generative Adversarial Networks
The Wasserstein GAN (WGAN) leverages the Wasserstein distance to avoid the caveats in the minmax two-player training of GANs but has other defects such as mode collapse and lack of metric to detect the convergence.
Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration
Specifically, we first verify that the confidence distribution in a graph has homophily property, and this finding inspires us to design a calibration GNN model (CaGCN) to learn the calibration function.
CoSeg: Cognitively Inspired Unsupervised Generic Event Segmentation
Unlike the mainstream clustering-based methods, our framework exploits a transformer-based feature reconstruction scheme to detect event boundary by reconstruction errors.
LiT: Zero-Shot Transfer with Locked-image text Tuning
This paper presents contrastive-tuning, a simple method employing contrastive training to align image and text models while still taking advantage of their pre-training.
Generalizing Graph Neural Networks on Out-Of-Distribution Graphs
Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings.
Universal Graph Convolutional Networks
So can we reasonably utilize these segmentation rules to design a universal propagation mechanism independent of the network structural assumption?
MutualFormer: Multi-Modality Representation Learning via Cross-Diffusion Attention
In this work, we re-think Transformer and extend it to MutualFormer for multi-modality data representation.
Compact Graph Structure Learning via Mutual Information Compression
Furthermore, we maintain the performance of estimated views and the final view and reduce the mutual information of every two views.
Debiased Graph Neural Networks with Agnostic Label Selection Bias
Then to remove the bias in GNN estimation, we propose a novel Debiased Graph Neural Networks (DGNN) with a differentiated decorrelation regularizer.
Event-based Video Reconstruction via Potential-assisted Spiking Neural Network
We propose a novel Event-based Video reconstruction framework based on a fully Spiking Neural Network (EVSNN), which utilizes Leaky-Integrate-and-Fire (LIF) neuron and Membrane Potential (MP) neuron.
Computational Efficiency
Event-Based Video Reconstruction
+2
Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shift
To this end, in this paper, we propose a novel Distribution Recovered Graph Self-Training framework (DR-GST), which could recover the distribution of the original labeled dataset.
Tiny Object Tracking: A Large-scale Dataset and A Baseline
Tiny objects, frequently appearing in practical applications, have weak appearance and features, and receive increasing interests in meany vision tasks, such as object detection and segmentation.
Space4HGNN: A Novel, Modularized and Reproducible Platform to Evaluate Heterogeneous Graph Neural Network
Heterogeneous Graph Neural Network (HGNN) has been successfully employed in various tasks, but we cannot accurately know the importance of different design dimensions of HGNNs due to diverse architectures and applied scenarios.
Unpaired Image Captioning by Image-level Weakly-Supervised Visual Concept Recognition
The image-level labels are utilized to train a weakly-supervised object recognition model to extract object information (e. g., instance) in an image, and the extracted instances are adopted to infer the relationships among different objects based on an enhanced graph neural network (GNN).
SHREC 2021: Classification in cryo-electron tomograms
To promote innovation in computational methods, we generate a novel simulated dataset to benchmark different methods of localization and classification of biological macromolecules in tomograms.
Federated Class-Incremental Learning
It makes the global model suffer from significant catastrophic forgetting on old classes in real-world scenarios, where local clients often collect new classes continuously and have very limited storage memory to store old classes.
CaCo: Both Positive and Negative Samples are Directly Learnable via Cooperative-adversarial Contrastive Learning
It trains an encoder by distinguishing positive samples from negative ones given query anchors.
Ranked #65 on
Self-Supervised Image Classification
on ImageNet
On the Importance of Asymmetry for Siamese Representation Learning
Many recent self-supervised frameworks for visual representation learning are based on certain forms of Siamese networks.
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective
NER model has achieved promising performance on standard NER benchmarks.
Ranked #8 on
Named Entity Recognition (NER)
on WNUT 2017
Accelerated Multiplicative Weights Update Avoids Saddle Points almost always
We consider non-convex optimization problems with constraint that is a product of simplices.
Simple Open-Vocabulary Object Detection with Vision Transformers
Combining simple architectures with large-scale pre-training has led to massive improvements in image classification.
Ranked #1 on
One-Shot Object Detection
on MS COCO
Image Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstruction
In this paper, we propose a novel image gradient decomposition method that significantly reduces the memory footprint for ptychographic reconstruction by tessellating image gradients and diffraction measurements into tiles.
Provably Safe Reinforcement Learning: Conceptual Analysis, Survey, and Benchmarking
We categorize the methods based on how they adapt the action: action replacement, action projection, and action masking.
Beyond Greedy Search: Tracking by Multi-Agent Reinforcement Learning-based Beam Search
To track the target in a video, current visual trackers usually adopt greedy search for target object localization in each frame, that is, the candidate region with the maximum response score will be selected as the tracking result of each frame.
Robust Sensible Adversarial Learning of Deep Neural Networks for Image Classification
Specifically, we define a sensible adversary which is useful for learning a robust model while keeping high natural accuracy.
Prompt-based Learning for Unpaired Image Captioning
Inspired by the success of Vision-Language Pre-Trained Models (VL-PTMs) in this research, we attempt to infer the cross-domain cue information about a given image from the large VL-PTMs for the UIC task.
SHREC 2022: Protein-ligand binding site recognition
This paper presents the methods that have participated in the SHREC 2022 contest on protein-ligand binding site recognition.
Criteria Comparative Learning for Real-scene Image Super-Resolution
Inspired by the observation that the contrastive relationship could also exist between the criteria, in this work, we propose a novel training paradigm for RealSR, named Criteria Comparative Learning (Cria-CL), by developing contrastive losses defined on criteria instead of image patches.
SPAIC: A Spike-based Artificial Intelligence Computing Framework
In this work, we present a Python based spiking neural network (SNN) simulation and training framework, aka SPAIC that aims to support brain-inspired model and algorithm researches integrated with features from both deep learning and neuroscience.
See Finer, See More: Implicit Modality Alignment for Text-based Person Retrieval
To explore the fine-grained alignment, we further propose two implicit semantic alignment paradigms: multi-level alignment (MLA) and bidirectional mask modeling (BMM).
Learning Spatial-Frequency Transformer for Visual Object Tracking
To handle these issues, in this paper, we propose a unified Spatial-Frequency Transformer that models the Gaussian spatial Prior and High-frequency emphasis Attention (GPHA) simultaneously.
Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classification
sampleFormer aims to capture the dependence of samples in support and query sets for image representation.
PaLI: A Jointly-Scaled Multilingual Language-Image Model
PaLI generates text based on visual and textual inputs, and with this interface performs many vision, language, and multimodal tasks, in many languages.
Debiasing Graph Neural Networks via Learning Disentangled Causal Substructure
However, by presenting a graph classification investigation on the training graphs with severe bias, surprisingly, we discover that GNNs always tend to explore the spurious correlations to make decision, even if the causal correlation always exists.
Revisiting Graph Contrastive Learning from the Perspective of Graph Spectrum
Then we theoretically prove that GCL is able to learn the invariance information by contrastive invariance theorem, together with our GAME rule, for the first time, we uncover that the learned representations by GCL essentially encode the low-frequency information, which explains why GCL works.
Uncovering the Structural Fairness in Graph Contrastive Learning
Recent studies show that graph convolutional network (GCN) often performs worse for low-degree nodes, exhibiting the so-called structural unfairness for graphs with long-tailed degree distributions prevalent in the real world.
Provably Safe Reinforcement Learning via Action Projection using Reachability Analysis and Polynomial Zonotopes
While reinforcement learning produces very promising results for many applications, its main disadvantage is the lack of safety guarantees, which prevents its use in safety-critical systems.
HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensors
The main streams of human activity recognition (HAR) algorithms are developed based on RGB cameras which are suffered from illumination, fast motion, privacy-preserving, and large energy consumption.
Rethinking Batch Sample Relationships for Data Representation: A Batch-Graph Transformer based Approach
(1) It employs a flexible graph model, termed Batch Graph to jointly encode the visual and semantic relationships of samples within each mini-batch.
Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric
In this paper, we propose a single-stage backbone network for Color-Event Unified Tracking (CEUTrack), which achieves the above functions simultaneously.
Ranked #3 on
Object Tracking
on COESOT
Private Multi-Winner Voting for Machine Learning
We use our mechanisms to enable privacy-preserving multi-label learning in the central setting by extending the canonical single-label technique: PATE.
Directed Acyclic Graph Structure Learning from Dynamic Graphs
In a dynamic graph, we propose to simultaneously estimate contemporaneous relationships and time-lagged interaction relationships between the node features.
DEJA VU: Continual Model Generalization For Unseen Domains
To overcome these limitations of DA and DG in handling the Unfamiliar Period during continual domain shift, we propose RaTP, a framework that focuses on improving models' target domain generalization (TDG) capability, while also achieving effective target domain adaptation (TDA) capability right after training on certain domains and forgetting alleviation (FA) capability on past domains.
Machine Learning for Synthetic Data Generation: A Review
In light of these challenges, the concept of synthetic data generation emerges as a promising alternative that allows for data sharing and utilization in ways that real-world data cannot facilitate.
Scaling Vision Transformers to 22 Billion Parameters
The scaling of Transformers has driven breakthrough capabilities for language models.
Ranked #1 on
Zero-Shot Transfer Image Classification
on ObjectNet
A Survey on Spectral Graph Neural Networks
Graph neural networks (GNNs) have attracted considerable attention from the research community.
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey
We also give visualization and analysis of the model parameters and results on representative downstream tasks.
AdPE: Adversarial Positional Embeddings for Pretraining Vision Transformers via MAE+
A criterion in unsupervised pretraining is the pretext task needs to be sufficiently hard to prevent the transformer encoder from learning trivial low-level features not generalizable well to downstream tasks.
Micro-video Tagging via Jointly Modeling Social Influence and Tag Relation
Existing methods mostly focus on analyzing video content, neglecting users' social influence and tag relation.
RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learning
In addition, existing learning methods of RGBT trackers either fuse multimodal features into one for final classification, or exploit the relationship between unimodal branches and fused branch through a competitive learning strategy.
A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision
A key finding is that a small decoder learned on top of a frozen pretrained encoder works surprisingly well.
Efficient Multimodal Sampling via Tempered Distribution Flow
Sampling from high-dimensional distributions is a fundamental problem in statistical research and practice.
Curricular Object Manipulation in LiDAR-based Object Detection
For the loss design, we propose the COMLoss to dynamically predict object-level difficulties and emphasize objects of different difficulties based on training stages.
InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction
Large language models have unlocked strong multi-task capabilities from reading instructive prompts.
Ranked #2 on
Zero-shot Named Entity Recognition (NER)
on CrossNER
(using extra training data)
Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition
The averaged visual tokens and text tokens are concatenated and fed into a fusion Transformer for multi-modal interactive learning.
Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network
Specifically, two views of a HIN (network schema and meta-path views) are proposed to learn node embeddings, so as to capture both of local and high-order structures simultaneously.
ReGeneration Learning of Diffusion Models with Rich Prompts for Zero-Shot Image Translation
To ensure consistent preservation of the shape during image editing, we propose cross-attention guidance based on regeneration learning.
A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition
Particularly, we propose a Confidence-based Partial Label Learning (CPLL) method to integrate the prior confidence (given by annotators) and posterior confidences (learned by models) for crowd-annotated NER.
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model
Pretrained language models have achieved remarkable success in various natural language processing tasks.
Three Towers: Flexible Contrastive Learning with Pretrained Image Models
With 3T, we propose a more flexible strategy that allows the image tower to benefit from both pretrained embeddings and contrastive training.
PaLI-X: On Scaling up a Multilingual Vision and Language Model
We present the training recipe and results of scaling up PaLI-X, a multilingual vision and language model, both in terms of size of the components and the breadth of its training task mixture.
Ranked #1 on
Fine-Grained Image Recognition
on OVEN
AMatFormer: Efficient Feature Matching via Anchor Matching Transformer
Second, AMatFormer adopts a shared FFN module to further embed the features of two images into the common domain and thus learn the consensus feature representations for the matching problem.
Point-Voxel Absorbing Graph Representation Learning for Event Stream based Recognition
To address these issues, we propose a novel dual point-voxel absorbing graph representation learning for event stream data representation.
Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphs
Real-world graphs generally have only one kind of tendency in their connections.
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization
Adversarial training is one of the best-performing methods in improving the robustness of deep language models.
Generative Query Reformulation for Effective Adhoc Search
GenQR directly reformulates the user's input query, while GenPRF provides additional context for the query by making use of pseudo-relevance feedback information.
SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition
Secondly, they adopt either Spiking Neural Networks (SNN) for energy-efficient recognition with suboptimal results, or Artificial Neural Networks (ANN) for energy-intensive, high-performance recognition.
High-performance Data Management for Whole Slide Image Analysis in Digital Pathology
The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario ("CPU scenario"), and (2) a GPU-based deep learning framework scenario ("GPU scenario").
Temporal Sentence Grounding in Streaming Videos
The goal of TSGSV is to evaluate the relevance between a video stream and a given sentence query.
Learning Bottleneck Transformer for Event Image-Voxel Feature Fusion based Classification
Additionally, a bottleneck Transformer is introduced to facilitate the fusion of the dual-stream information.
Unified and Dynamic Graph for Temporal Character Grouping in Long Videos
In this paper, we present a unified and dynamic graph (UniDG) framework for temporal character grouping.
A stochastic block model for community detection in attributed networks
Therefore, a stochastic block model that integrates betweenness centrality and clustering coefficient of nodes for community detection in attributed networks, named BCSBM, is proposed in this paper.
The Rise and Potential of Large Language Model Based Agents: A Survey
Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks.
Provable Training for Graph Contrastive Learning
To this end, we propose the PrOvable Training (POT) for GCL, which regularizes the training of GCL to encode node embeddings that follows the GCL principle better.
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
Tracking using bio-inspired event cameras has drawn more and more attention in recent years.
Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models
This study serves as a clarion call for a collective effort to overhaul and fortify the safety of open-source LLMs against malicious attackers.
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences.
TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
In this paper, we introduce TRACE, a novel benchmark designed to evaluate continual learning in LLMs.
PaLI-3 Vision Language Models: Smaller, Faster, Stronger
This paper presents PaLI-3, a smaller, faster, and stronger vision language model (VLM) that compares favorably to similar models that are 10x larger.
Ranked #2 on
Temporal/Casual QA
on NExT-QA
(using extra training data)
VcT: Visual change Transformer for Remote Sensing Image Change Detection
Then, each pixel of feature map is regarded as a graph node and the graph neural network is proposed to model the structured information for coarse change map prediction.
Improving Generalization of Alignment with Human Preferences through Group Invariant Learning
In this work, we propose a novel approach that can learn a consistent policy via RL across various data groups or domains.
Orthogonal Subspace Learning for Language Model Continual Learning
In this paper, we propose orthogonal low-rank adaptation (O-LoRA), a simple and efficient approach for continual learning in language models, effectively mitigating catastrophic forgetting while learning new tasks.
Ultra-Long Sequence Distributed Transformer
This paper presents a novel and efficient distributed training method, the Long Short-Sequence Transformer (LSS Transformer), for training transformer with long sequences.
Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Models
Current methods typically employ backbone networks to individually extract the features of RGB frames and event streams, and subsequently fuse these features for pattern recognition.
RTQ: Rethinking Video-language Understanding Based on Image-text Model
Recent advancements in video-language understanding have been established on the foundation of image-text models, resulting in promising outcomes due to the shared knowledge between images and videos.
Ranked #9 on
Video Retrieval
on MSR-VTT-1kA
SequencePAR: Understanding Pedestrian Attributes via A Sequence Generation Paradigm
Then, a Transformer decoder is proposed to generate the human attributes by incorporating the visual features and attribute query tokens.
A Generalized Neural Diffusion Framework on Graphs
In this paper, we propose a general diffusion equation framework with the fidelity term, which formally establishes the relationship between the diffusion process with more GNNs.
LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin
Supervised fine-tuning (SFT) is a crucial step for large language models (LLMs), enabling them to align with human instructions and enhance their capabilities in downstream tasks.
Structural Information Guided Multimodal Pre-training for Vehicle-centric Perception
To address this issue, we propose a novel vehicle-centric pre-training framework called VehicleMAE, which incorporates the structural information including the spatial structure from vehicle profile information and the semantic structure from informative high-level natural language descriptions for effective masked vehicle appearance reconstruction.
Pedestrian Attribute Recognition via CLIP based Prompt Vision-Language Fusion
In this paper, we formulate PAR as a vision-language fusion problem and fully exploit the relations between pedestrian images and attribute labels.
Unleashing the Power of CNN and Transformer for Balanced RGB-Event Video Recognition
It is intuitive to combine them for high-performance RGB-Event based video recognition, however, existing works fail to achieve a good balance between the accuracy and model parameters, as shown in Fig.~\ref{firstimage}.
Optimizing Distributed Training on Frontier for Large Language Models
For the training of the 175 Billion parameter model and the 1 Trillion parameter model, we achieved $100\%$ weak scaling efficiency on 1024 and 3072 MI250X GPUs, respectively.
GenoCraft: A Comprehensive, User-Friendly Web-Based Platform for High-Throughput Omics Data Analysis and Visualization
With GenoCraft, researchers and data scientists have access to an array of cutting-edge bioinformatics tools under a user-friendly interface, making it a valuable resource for managing and analyzing large-scale omics data.
Federated Continual Novel Class Learning
In a privacy-focused era, Federated Learning (FL) has emerged as a promising machine learning technique.
CRSOT: Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras
In this work, we formally propose the task of object tracking using unaligned neuromorphic and visible cameras.
TrustLLM: Trustworthiness in Large Language Models
This paper introduces TrustLLM, a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for mainstream LLMs, and discussion of open challenges and future directions.
Secrets of RLHF in Large Language Models Part II: Reward Modeling
We introduce a series of novel methods to mitigate the influence of incorrect and ambiguous preferences in the dataset and fully leverage high-quality preference data.
Uncertainty-aware Bridge based Mobile-Former Network for Event-based Pattern Recognition
The mainstream human activity recognition (HAR) algorithms are developed based on RGB cameras, which are easily influenced by low-quality images (e. g., low illumination, motion blur).
Linear Alignment: A Closed-form Solution for Aligning Human Preferences without Tuning and Feedback
This reliance limits the applicability of RLHF and hinders the development of professional assistants tailored to diverse human preferences.
Graph Contrastive Invariant Learning from the Causal Perspective
How can we fix it and encourage the current GCL to learn better invariant representations?
Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment
The final prediction of the equivalent entity is derived from the LLM's output.
Graph Fairness Learning under Distribution Shifts
Recently, there has been an increasing interest in ensuring fairness on GNNs, but all of them are under the assumption that the training and testing data are under the same distribution, i. e., training data and testing data are from the same graph.
Navigating the OverKill in Large Language Models
Large language models are meticulously aligned to be both helpful and harmless.
StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
The advancement of large language models (LLMs) has significantly propelled the field of code generation.
Federated Learning with New Knowledge: Fundamentals, Advances, and Futures
Federated Learning (FL) is a privacy-preserving distributed learning approach that is rapidly developing in an era where privacy protection is increasingly valued.
A Lightweight Inception Boosted U-Net Neural Network for Routability Prediction
As the modern CPU, GPU, and NPU chip design complexity and transistor counts keep increasing, and with the relentless shrinking of semiconductor technology nodes to nearly 1 nanometer, the placement and routing have gradually become the two most pivotal processes in modern very-large-scale-integrated (VLSI) circuit back-end design.
Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning
In this paper, we propose R$^3$: Learning Reasoning through Reverse Curriculum Reinforcement Learning (RL), a novel method that employs only outcome supervision to achieve the benefits of process supervision for large language models.
CodeChameleon: Personalized Encryption Framework for Jailbreaking Large Language Models
Adversarial misuse, particularly through `jailbreaking' that circumvents a model's safety and ethical protocols, poses a significant challenge for Large Language Models (LLMs).
RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions
In this paper, drawing inspiration from recent works that LLMs are sensitive to the design of the instructions, we utilize instructions in code style, which are more structural and less ambiguous, to replace typically natural language instructions.
Small, Versatile and Mighty: A Range-View Perception Framework
Our proposed Small, Versatile, and Mighty (SVM) network utilizes a pure convolutional architecture to fully unleash the efficiency and multi-tasking potentials of the range view representation.
Minimum Topology Attacks for Graph Neural Networks
To break this dilemma, we propose a new type of topology attack, named minimum-budget topology attack, aiming to adaptively find the minimum perturbation sufficient for a successful attack on each node.
