Search Results for author:
Found 259 papers, 94 papers with code
Large-Scale Few-Shot Learning via Multi-Modal Knowledge Discovery
It is a challenging problem since (1) the identifying process is susceptible to over-fitting with limited samples of an object, and (2) the sample imbalance between a base (known knowledge) category and a novel category is easy to bias the recognition results.
Sequencing-enabled Hierarchical Cooperative CAV On-ramp Merging Control with Enhanced Stability and Feasibility
Subsequently, the lower-level control employs a longitudinal distributed model predictive control (MPC) supplemented by a virtual car-following (CF) concept to ensure asymptotic local stability, l_2 norm string stability, and safety.
Continual Referring Expression Comprehension via Dual Modular Memorization
In this paper, we propose Continual Referring Expression Comprehension (CREC), a new setting for REC, where a model is learning on a stream of incoming tasks.
Clarity ChatGPT: An Interactive and Adaptive Processing System for Image Restoration and Enhancement
The generalization capability of existing image restoration and enhancement (IRE) methods is constrained by the limited pre-trained datasets, making it difficult to handle agnostic inputs such as different degradation levels and scenarios beyond their design scopes.
Cut-and-Paste: Subject-Driven Video Editing with Attention Control
This paper presents a novel framework termed Cut-and-Paste for real-word semantic video editing under the guidance of text prompt and additional reference image.
Mixed Attention Network for Cross-domain Sequential Recommendation
Recent proposed cross-domain sequential recommendation models such as PiNet and DASL have a common drawback relying heavily on overlapped users in different domains, which limits their usage in practical recommender systems.
OR Residual Connection Achieving Comparable Accuracy to ADD Residual Connection in Deep Residual Spiking Neural Networks
Spiking Neural Networks (SNNs) have garnered substantial attention in brain-like computing for their biological fidelity and the capacity to execute energy-efficient spike-driven operations.
Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action Understanding
In this manner, our framework is able to learn the unified representations of uni-modal or multi-modal skeleton input, which is flexible to different kinds of modality input for robust action understanding in practical cases.
Optimal Noise pursuit for Augmenting Text-to-Video Generation
Motivated by this, we further design a semantic-preserving rewriter to enrich the text prompt, where a reference-guided rewriting is devised for reasonable details compensation, and a denoising with a hybrid semantics strategy is proposed to preserve the semantic consistency.
On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $ε$-Greedy Exploration
This paper provides the first theoretical convergence and sample complexity analysis of the practical setting of DQNs with $\epsilon$-greedy policy.
A Link Transmission Model with Variable Speed Limits and Turn-Level Queue Transmission at Signalized Intersections
The link transmission model (LTM) is an efficient and widely used macro-level approach for simulating traffic flow.
Exploring Sparse Spatial Relation in Graph Inference for Text-Based VQA
The associations between these repetitive objects are superfluous for answer reasoning; (2) two spatially distant OCR tokens detected in the image frequently have weak semantic dependencies for answer reasoning; and (3) the co-existence of nearby objects and tokens may be indicative of important visual cues for predicting answers.
ASM: Adaptive Sample Mining for In-The-Wild Facial Expression Recognition
First, the Adaptive Threshold Learning module generates two thresholds, namely the clean and noisy thresholds, for each category.
Facial Expression Recognition
Facial Expression Recognition (FER)
Dual-Path Temporal Map Optimization for Make-up Temporal Video Grounding
Compared with the general video grounding task, MTVG focuses on meticulous actions and changes on the face.
Dual-view Curricular Optimal Transport for Cross-lingual Cross-modal Retrieval
Therefore, we propose Dual-view Curricular Optimal Transport (DCOT) to learn with noisy correspondence in CCR.
Dual Relation Alignment for Composed Image Retrieval
Unlike the general image-text retrieval problem with only one alignment relation, i. e., image-text, we argue for the existence of two types of relations in composed image retrieval.
Exploiting Diverse Feature for Multimodal Sentiment Analysis
Specifically, we achieve the results of 0. 8492 and 0. 8439 for MuSe-Personalisation in terms of arousal and valence CCC.
Fault Separation Based on An Excitation Operator with Application to a Quadrotor UAV
This paper presents an excitation operator based fault separation architecture for a quadrotor unmanned aerial vehicle (UAV) subject to loss of effectiveness (LoE) faults, actuator aging, and load uncertainty.
Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos
Specifically, the proposed Dual-TL uses a Spatial TokenLearner (S-TL) to explore associations in different facial ROIs, which promises the rPPG prediction far away from noisy ROI disturbances.
Self-Supervised Dynamic Hypergraph Recommendation based on Hyper-Relational Knowledge Graph
However, the long-tail distribution of entities leads to sparsity in supervision signals, which weakens the quality of item representation when utilizing KG enhancement.
ViGT: Proposal-free Video Grounding with Learnable Token in Transformer
First, we employed a sharing feature encoder to project both video and query into a joint feature space before performing cross-modal co-attention (i. e., video-to-query attention and query-to-video attention) to highlight discriminative features in each modality.
Data Augmentation for Human Behavior Analysis in Multi-Person Conversations
In this paper, we present the solution of our team HFUT-VUT for the MultiMediate Grand Challenge 2023 at ACM Multimedia 2023.
Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classification
In this paper, we briefly introduce the solution of our team HFUT-VUT for the Micros-gesture Classification in the MiGA challenge at IJCAI 2023.
Extreme Image Compression using Fine-tuned VQGAN Models
Recent advances in generative compression methods have demonstrated remarkable progress in enhancing the perceptual quality of compressed data, especially in scenarios with low bitrates.
Generative Contrastive Graph Learning for Recommendation
Second, feature augmentation imposes the same scale noise augmentation on each node, which neglects the unique characteristics of nodes on the graph.
SAM-U: Multi-box prompts triggered uncertainty estimation for reliable SAM in medical image
Recently, Segmenting Anything has taken an important step towards general artificial intelligence.
A Multi-view Impartial Decision Network for Frontotemporal Dementia Diagnosis
To achieve this, we employ multiple expert models to extract evidence from the abundant neural network information contained in fMRI images.
You Can Mask More For Extremely Low-Bitrate Image Compression
Extensive experiments have demonstrated that our approach outperforms recent state-of-the-art methods in R-D performance, visual quality, and downstream applications, at very low bitrates.
CLERA: A Unified Model for Joint Cognitive Load and Eye Region Analysis in the Wild
Non-intrusive, real-time analysis of the dynamics of the eye region allows us to monitor humans' visual attention allocation and estimate their mental state during the performance of real-world tasks, which can potentially benefit a wide range of human-computer interaction (HCI) applications.
Exploring Resolution Fields for Scalable Image Compression with Uncertainty Guidance
In this work, we explore the potential of resolution fields in scalable image compression and propose the reciprocal pyramid network (RPN) that fulfills the need for more adaptable and versatile compression.
Description-Enhanced Label Embedding Contrastive Learning for Text Classification
Then, we propose a novel Relation of Relation Learning Network (R2-Net) for text classification, in which text classification and R2 classification are treated as optimization targets.
A Survey on Video Moment Localization
Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query.
Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks
In deep learning, mixture-of-experts (MoE) activates one or few experts (sub-networks) on a per-sample or per-token basis, resulting in significant computation reduction.
Unlearnable Examples Give a False Sense of Security: Piercing through Unexploitable Data with Learnable Examples
Unfortunately, we find UEs provide a false sense of security, because they cannot stop unauthorized users from utilizing other unprotected data to remove the protection, by turning unlearnable data into learnable again.
SSD-MonoDETR: Supervised Scale-aware Deformable Transformer for Monocular 3D Object Detection
To tackle this problem, this paper proposes a novel "Supervised Scale-aware Deformable Attention" (SSDA) for monocular 3D object detection.
Geometric Prior Based Deep Human Point Cloud Geometry Compression
The emergence of digital avatars has raised an exponential increase in the demand for human point clouds with realistic and intricate details.
MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learning
The first Multimodal Emotion Recognition Challenge (MER 2023) was successfully held at ACM Multimedia.
Perceptual Quality Assessment of Face Video Compression: A Benchmark and An Effective Method
In this paper, we introduce the large-scale Compressed Face Video Quality Assessment (CFVQA) database, which is the first attempt to systematically understand the perceptual quality and diversified compression distortions in face videos.
Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentification
Moreover, human semantic information and pedestrian identity information are not fully explored.
Uncertainty-inspired Open Set Learning for Retinal Anomaly Identification
Failure to recognize samples from the classes unseen during training is a major limitation of artificial intelligence in the real-world implementation for recognition and classification of retinal anomalies.
Fine-grained Audible Video Description
We explore a new task for audio-visual-language modeling called fine-grained audible video description (FAVD).
Federated Uncertainty-Aware Aggregation for Fundus Diabetic Retinopathy Staging
Our TWEU employs an evidential deep layer to produce the uncertainty score with the DR staging results for client reliability evaluation.
Model Barrier: A Compact Un-Transferable Isolation Domain for Model Intellectual Property Protection
As scientific and technological advancements result from human intellectual labor and computational costs, protecting model intellectual property (IP) has become increasingly important to encourage model creators and owners.
Reliable Multimodality Eye Disease Screening via Mixture of Student's t Distributions
To address this issue, we introduce a novel multimodality evidential fusion pipeline for eye disease screening, EyeMoSt, which provides a measure of confidence for unimodality and elegantly integrates the multimodality information from a multi-distribution fusion perspective.
Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation
Our UML has the potential to explore the development of more reliable and explainable medical image analysis models.
Facial Affect Recognition based on Transformer Encoder and Audiovisual Fusion for the ABAW5 Challenge
In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action Unit (AU) Detection and Emotional Reaction Intensity (ERI) Estimation.
Multimodal Feature Extraction and Fusion for Emotional Reaction Intensity Estimation and Expression Classification in Videos with Transformers
In this paper, we present our advanced solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) Estimation Challenge and Expression (Expr) Classification Challenge.
Adaptive Data-Free Quantization
Data-free quantization (DFQ) recovers the performance of quantized network (Q) without the original data, but generates the fake sample via a generator (G) by learning from full-precision network (P), which, however, is totally independent of Q, overlooking the adaptability of the knowledge from generated samples, i. e., informative or not to the learning process of Q, resulting into the overflow of generalization error.
Improving Audio-Visual Video Parsing with Pseudo Visual Labels
We perform extensive experiments on the LLP dataset and demonstrate that our method can generate high-quality segment-level pseudo labels with the help of our newly proposed loss and the label denoising strategy.
Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering
Knowledge-based visual question answering (VQA) requires external knowledge beyond the image to answer the question.
Ranked #1 on
Visual Question Answering (VQA)
on A-OKVQA
DC-Former: Diverse and Compact Transformer for Person Re-Identification
In this paper, we propose a Diverse and Compact Transformer (DC-Former) that can achieve a similar effect by splitting embedding space into multiple diverse and compact subspaces.
Rethinking Data-Free Quantization as a Zero-Sum Game
how to generate the samples with desirable adaptability to benefit the quantized network?
A Review of Uncertainty Estimation and its Application in Medical Imaging
We further discuss how they can be estimated in medical imaging.
Improving Recommendation Fairness via Data Augmentation
We augment imbalanced training data towards balanced data distribution to improve fairness.
A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity
Based on a data model characterizing both label-relevant and label-irrelevant tokens, this paper provides the first theoretical analysis of training a shallow ViT, i. e., one self-attention layer followed by a two-layer perceptron, for a classification task.
Information Theoretical Importance Sampling Clustering
In this paper, we propose an information theoretical importance sampling based approach for clustering problems (ITISC) which minimizes the worst case of expected distortions under the constraint of distribution deviation.
Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks
Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs.
Reliable Federated Disentangling Network for Non-IID Domain Feature
To the best of our knowledge, our proposed RFedDis is the first work to develop an FL approach based on evidential uncertainty combined with feature disentangling, which enhances the performance and reliability of FL in non-IID domain features.
Audio-Visual Segmentation with Semantics
To deal with these problems, we propose a new baseline method that uses a temporal pixel-wise audio-visual interaction module to inject audio semantics as guidance for the visual segmentation process.
CSDR-BERT: a pre-trained scientific dataset match model for Chinese Scientific Dataset Retrieval
As the number of open and shared scientific datasets on the Internet increases under the open science movement, efficiently retrieving these datasets is a crucial task in information retrieval (IR) research.
FE-TCM: Filter-Enhanced Transformer Click Model for Web Search
In this paper, We use Transformer as the backbone network of feature extraction, add filter layer innovatively, and propose a new Filter-Enhanced Transformer Click Model (FE-TCM) for web search.
Face Inverse Rendering via Hierarchical Decoupling
Previous face inverse rendering methods often require synthetic data with ground truth and/or professional equipment like a lighting stage.
Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification
It is commonly nontrivial to build a robust self-supervised learning model for multisource data classification, due to the fact that the semantic similarities of neighborhood regions are not exploited in existing contrastive learning framework.
Vocabulary-informed Zero-shot and Open-set Learning
Despite significant progress in object categorization, in recent years, a number of important challenges remain; mainly, the ability to learn from limited labeled data and to recognize object classes within large, potentially open, set of labels.
Domain Generalized Stereo Matching via Hierarchical Visual Transformation
In this way, we can prevent the model from exploiting the artifacts of synthetic stereo images as shortcut features, thereby estimating the disparity maps more effectively based on the learned robust and shortcut-invariant representation.
LP-DIF: Learning Local Pattern-Specific Deep Implicit Function for 3D Objects and Scenes
To capture geometry details, current mainstream methods divide 3D shapes into local regions and then learn each one with a local latent code via a decoder, where the decoder shares the geometric similarities among different local regions.
EvidenceCap: Towards trustworthy medical image segmentation via evidential identity cap
Medical image segmentation (MIS) is essential for supporting disease diagnosis and treatment effect assessment.
Bayesian Optimization Enhanced Deep Reinforcement Learning for Trajectory Planning and Network Formation in Multi-UAV Networks
In this paper, we employ multiple UAVs coordinated by a base station (BS) to help the ground users (GUs) to offload their sensing data.
Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images
Specifically, aiming at improving the model's ability to learn the complex pathological features of retinal edema lesions in OCT images, we develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module of our newly designed.
Who is Gambling? Finding Cryptocurrency Gamblers Using Multi-modal Retrieval Methods
Meanwhile, decentralized applications have also attracted intense attention from the online gambling community, with more and more decentralized gambling platforms created through the help of smart contracts.
Contrastive Positive Sample Propagation along the Audio-Visual Event Line
Visual and audio signals often coexist in natural environments, forming audio-visual events (AVEs).
Long-Range Zero-Shot Generative Deep Network Quantization
We find it is because: 1) a normal generator is hard to obtain high diversity of synthetic data, since it lacks long-range information to allocate attention to global features; 2) the synthetic images aim to simulate the statistics of real data, which leads to weak intra-class heterogeneity and limited feature richness.
OSIC: A New One-Stage Image Captioner Coined
To obtain rich features, we use the Swin Transformer to calculate multi-level features, and then feed them into a novel dynamic multi-sight embedding module to exploit both global structure and local texture of input images.
A Stream Learning Approach for Real-Time Identification of False Data Injection Attacks in Cyber-Physical Power Systems
Using this information, the signal retrieval module can easily recover the original control signal and remove the injected false data.
Hybrid Multimodal Fusion for Humor Detection
Our experiments demonstrate the effectiveness of our proposed model and hybrid fusion strategy on multimodal fusion, and the AUC of our proposed model on the test set is 0. 8972.
Delving Globally into Texture and Structure for Image Inpainting
Our model is orthogonal to the fashionable arts, such as Convolutional Neural Networks (CNNs), Attention and Transformer model, from the perspective of texture and structure information for image inpainting.
Switchable Online Knowledge Distillation
Instead of focusing on the accuracy gap at test phase by the existing arts, the core idea of SwitOKD is to adaptively calibrate the gap at training phase, namely distillation gap, via a switching strategy between two modes -- expert mode (pause the teacher while keep the student learning) and learning mode (restart the teacher).
Unsupervised Domain Adaptation via Style-Aware Self-intermediate Domain
Specifically, we propose a novel learning strategy of SSID, which selects samples from both source and target domains as anchors, and then randomly fuses the object and style features of these anchors to generate labeled and style-rich intermediate auxiliary features for knowledge transfer.
Multi-modal Contrastive Representation Learning for Entity Alignment
Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities.
Ranked #2 on
Multi-modal Entity Alignment
on UMVM-oea-d-w-v1
(using extra training data)
Temporal Action Localization with Multi-temporal Scales
However, the temporal features of a low-level scale lack enough semantics for action classification while a high-level scale cannot provide rich details of the action boundaries.
DVR: Micro-Video Recommendation Optimizing Watch-Time-Gain under Duration Bias
Recommender systems are prone to be misled by biases in the data.
TripHLApan: predicting HLA molecules binding peptides based on triple coding matrix and transfer learning
In conclusion, TripHLApan is a powerful tool for predicting the binding of HLA-I and HLA-II molecular peptides for the synthesis of tumor vaccines.
Deep Uncalibrated Photometric Stereo via Inter-Intra Image Feature Fusion
This paper presents a new method for deep uncalibrated photometric stereo, which efficiently utilizes the inter-image representation to guide the normal estimation.
Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis
In this paper, we present our solutions for the Multimodal Sentiment Analysis Challenge (MuSe) 2022, which includes MuSe-Humor, MuSe-Reaction and MuSe-Stress Sub-challenges.
Emotion Separation and Recognition from a Facial Expression by Generating the Poker Face with Vision Transformers
Here, we regard an expressive face as the comprehensive result of a set of facial muscle movements on one's poker face (i. e., emotionless face), inspired by Facial Action Coding System.
Ranked #1 on
Facial Expression Recognition
on FER+
A Semantic-aware Attention and Visual Shielding Network for Cloth-changing Person Re-identification
In addition, a visual clothes shielding module (VCS) is also designed to extract a more robust feature representation for the cloth-changing task by covering the clothing regions and focusing the model on the visual semantic information unrelated to the clothes.
Audio-Visual Segmentation
To deal with the AVS problem, we propose a novel method that uses a temporal pixel-wise audio-visual interaction module to inject audio semantics as guidance for the visual segmentation process.
Recent Results of Energy Disaggregation with Behind-the-Meter Solar Generation
Compared with deterministic dictionary learning, the Bayesian dictionary learning-based approach provides the uncertainty measure for the disaggregation results, at the cost of increased computational complexity.
Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling
Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data.
Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data
In addition, for the first time, this paper characterizes the impact of the input distributions on the sample complexity and the learning rate.
Solutions for Fine-grained and Long-tailed Snake Species Recognition in SnakeCLEF 2022
Automatic snake species recognition is important because it has vast potential to help lower deaths and disabilities caused by snakebites.
KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D Correspondences
Human densepose estimation, aiming at establishing dense correspondences between 2D pixels of human body and 3D human body template, is a key technique in enabling machines to have an understanding of people in images.
TBraTS: Trusted Brain Tumor Segmentation
In our method, uncertainty is modeled explicitly using subjective logic theory, which treats the predictions of backbone neural network as subjective opinions by parameterizing the class probabilities of the segmentation as a Dirichlet distribution.
Prediction-Based Reachability Analysis for Collision Risk Assessment on Highways
Real-time safety systems are crucial components of intelligent vehicles.
A Review-aware Graph Contrastive Learning Framework for Recommendation
Second, while most current models suffer from limited user behaviors, can we exploit the unique self-supervised signals in the review-aware graph to guide two recommendation components better?
Audio-Visual Scene Classification Using A Transfer Learning Based Joint Optimization Strategy
Recently, audio-visual scene classification (AVSC) has attracted increasing attention from multidisciplinary communities.
FCL-GAN: A Lightweight and Real-Time Baseline for Unsupervised Blind Image Deblurring
Blind image deblurring (BID) remains a challenging and significant task.
Detail-recovery Image Deraining via Dual Sample-augmented Contrastive Learning
To bridge the two domain gaps, we propose a semi-supervised detail-recovery image deraining network (Semi-DRDNet) with dual sample-augmented contrastive learning.
Thinking inside The Box: Learning Hypercube Representations for Group Recommendation
Such user and group preferences are commonly represented as points in the vector space (i. e., embeddings), where multiple user embeddings are compressed into one to facilitate ranking for group-item pairs.
EmotionNAS: Two-stream Neural Architecture Search for Speech Emotion Recognition
Speech emotion recognition (SER) is an important research topic in human-computer interaction.
Multi-modal Emotion Estimation for in-the-wild Videos
In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition.
How does unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis
Self-training, a semi-supervised learning algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited.
Compact Bidirectional Transformer for Image Captioning
In this paper, we introduce a Compact Bidirectional Transformer model for image captioning that can leverage bidirectional context implicitly and explicitly while the decoder can be executed parallelly.
Deep Color Consistent Network for Low-Light Image Enhancement
Current low-light image enhancement methods can well improve the illumination.
TextRGNN: Residual Graph Neural Networks for Text Classification
Recently, text classification model based on graph neural network (GNN) has attracted more and more attention.
HBReID: Harder Batch for Re-identification
Triplet loss is a widely adopted loss function in ReID task which pulls the hardest positive pairs close and pushes the hardest negative pairs far away.
Uncovering the Local Hidden Community Structure in Social Networks
We theoretically show that our method can avoid some situations that a broken community and the local community are regarded as one community in the subgraph, leading to the inaccuracy on detection which can be caused by global hidden community detection methods.
Decoupled Low-light Image Enhancement
On the other hand, since the parameter matrix learned from the first stage is aware of the lightness distribution and the scene structure, it can be incorporated into the second stage as the complementary information.
Learning Non-Stationary Time-Series with Dynamic Pattern Extractions
Our results show that our model can predict 4-hour future trends with high accuracy in the Forex dataset, which is crucial in realistic scenarios to assist foreign exchange trading decision making.
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks
Moreover, when the algorithm for training a pruned neural network is specified as an (accelerated) stochastic gradient descent algorithm, we theoretically show that the number of samples required for achieving zero generalization error is proportional to the number of the non-pruned weights in the hidden layer.
Learning the Representation of Behavior Styles with Imitation Learning
Imitation learning is one of the methods for reproducing expert demonstrations adaptively by learning a mapping between observations and actions.
Vibration-based Uncertainty Estimation for Learning from Limited Supervision
We investigate the problem of estimating uncertainty for training data, so that deep neural networks can make use of the results for learning from limited supervision.
How unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis
Self-training, a semi-supervised learning algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited.
Multi View Spatial-Temporal Model for Travel Time Estimation
Specifically, we use graph2vec to model the spatial view, dual-channel temporal module to model the trajectory view, and structural embedding to model traffic semantics.
Leveraging Table Content for Zero-shot Text-to-SQL with Meta-Learning
Compared to the larger pre-trained model and the tabular-specific pre-trained model, our approach is still competitive.
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
Nevertheless, most existing VLP approaches have not fully utilized the intrinsic knowledge within the image-text pairs, which limits the effectiveness of the learned alignments and further restricts the performance of their models.
TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localization
In this work, a novel end-to-end two-stream boundary-aware network (abbreviated as TBNet) is proposed for generic image manipulation localization in which the RGB stream, the frequency stream, and the boundary artifact location are explored in a unified framework.
Multigranular Visual-Semantic Embedding for Cloth-Changing Person Re-identification
To solve these issues, in this work, a novel multigranular visual-semantic embedding algorithm (MVSE) is proposed for cloth-changing person ReID, where visual semantic information and human attributes are embedded into the network, and the generalized features of human appearance can be well learned to effectively solve the problem of clothing changes.
LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching
In order to overcome this problem and boost the performance of attention mechanism, we propose a novel dynamic re-read attention, which can pay close attention to one small region of sentences at each step and re-read the important parts for better sentence representations.
Temporal-Relational Hypergraph Tri-Attention Networks for Stock Trend Prediction
Extensive experiments on real-world data demonstrate the effectiveness of our approach.
Few-shot Learning with Global Relatedness Decoupled-Distillation
To overcome these problems, we propose a new Global Relatedness Decoupled-Distillation (GRDD) method using the global category knowledge and the Relatedness Decoupled-Distillation (RDD) strategy.
Discrimination-Aware Mechanism for Fine-Grained Representation Learning
Therefore, there is a need for a training mechanism that enforces the discriminativeness of all the elements in the feature to capture more the subtle visual cues.
Single View Physical Distance Estimation using Human Pose
We propose a fully automated system that simultaneously estimates the camera intrinsics, the ground plane, and physical distances between people from a single RGB image or video captured by a camera viewing a 3-D scene from a fixed vantage point.
Semi-Autoregressive Transformer for Image Captioning
To tackle this issue, non-autoregressive image captioning models have recently been proposed to significantly accelerate the speed of inference by generating all words in parallel.
DGA-Net Dynamic Gaussian Attention Network for Sentence Semantic Matching
Then, we develop a Dynamic Gaussian Attention (DGA) to dynamically capture the important parts and corresponding local contexts from a detailed perspective.
Harnessing Unrecognizable Faces for Improving Face Recognition
The common implementation of face recognition systems as a cascade of a detection stage and a recognition or verification stage can cause problems beyond failures of the detector.
Learning Elastic Embeddings for Customizing On-Device Recommenders
The core idea is to compose elastic embeddings for each item, where an elastic embedding is the concatenation of a set of embedding blocks that are carefully chosen by an automated search function.
Deconfounded Video Moment Retrieval with Causal Intervention
To fill the research gap, we propose a causality-inspired VMR framework that builds structural causal model to capture the true effect of query and video content on the prediction.
Privileged Graph Distillation for Cold Start Recommendation
The teacher model is composed of a heterogeneous graph structure for warm users and items with privileged CF links.
Set2setRank: Collaborative Set to Set Ranking for Implicit Feedback based Recommendation
Despite the performance gain of these implicit feedback based models, the recommendation results are still far from satisfactory due to the sparsity of the observed item set for each user.
A Survey on Accuracy-oriented Neural Recommendation: From Collaborative Filtering to Information-rich Recommendation
Influenced by the great success of deep learning in computer vision and language understanding, research in recommendation has shifted to inventing new recommender models based on neural networks.
Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling
As a well-established approach, factorization machine (FM) is capable of automatically learning high-order interactions among features to make predictions without the need for manual feature engineering.
Positive Sample Propagation along the Audio-Visual Event Line
To encourage the network to extract high correlated features for positive samples, a new audio-visual pair similarity loss is proposed.
Connected and Automated Vehicle Distributed Control for On-ramp Merging Scenario: A Virtual Rotation Approach
In this study, we propose a rotation-based connected automated vehicle (CAV) distributed cooperative control strategy for an on-ramp merging scenario.
Flatband-Induced Itinerant Ferromagnetism in RbCo$_2$Se$_2$
$A$Co$_2$Se$_2$ ($A$=K, Rb, Cs) is a homologue of the iron-based superconductor, $A$Fe$_2$Se$_2$.
Superconductivity Materials Science
Spectral Top-Down Recovery of Latent Tree Models
For large trees, a common approach, termed divide-and-conquer, is to recover the tree structure in two steps.
Measurement of the absolute branching fractions for purely leptonic $D_s^+$ decays
Constraining our measurement to the Standard Model expectation of lepton universality ($R=9. 75$), we find the more precise results $\cal B(D_s^+\to \tau^+\nu_\tau) = (5. 22\pm0. 10\pm 0. 14)\times10^{-2}$ and $A_{\it CP}(\tau^\pm\nu_\tau) = (-0. 1\pm1. 9\pm1. 0)\%$.
High Energy Physics - Experiment
On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning
Despite the generalization power of the meta-model, it remains elusive that how adversarial robustness can be maintained by MAML in few-shot learning.
Learning Fair Representations for Recommendation: A Graph-based Perspective
For each user, this transformation is achieved under the adversarial learning of a user-centric graph, in order to obfuscate each sensitive feature between both the filtered user embedding and the sub graph structures of this user.