Search Results for author:
Found 44 papers, 14 papers with code
Unimodal and Crossmodal Refinement Network for Multimodal Sequence Fusion
Specifically, to improve unimodal representations, a unimodal refinement module is designed to refine modality-specific learning via iteratively updating the distribution with transformer-based attention layers.
Self-distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach
It incorporates a framewise regularization term in CTC loss to emphasize individual supervision, and leverages the maximizing-a-posteriori of latent alignment to solve the inconsistency problem that arises in distillation between CTC-based models.
Automatic Deduction Path Learning via Reinforcement Learning with Environmental Correction
To this end, we formulate the problem as a partially observable Markov decision problem (POMDP) and employ an environment correction algorithm based on the characteristics of the business.
SDTracker: Synthetic Data Based Multi-Object Tracking
We present SDTracker, a method that harnesses the potential of synthetic data for multi-object tracking of real-world scenes in a domain generalization and semi-supervised fashion.
HandNeRF: Neural Radiance Fields for Animatable Interacting Hands
We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.
An Order-Invariant and Interpretable Hierarchical Dilated Convolution Neural Network for Chemical Fault Detection and Diagnosis
The novelty of HDLCNN lies in its capability of processing tabular data with features of arbitrary order without seeking the optimal order, due to the ability to agglomerate correlated features of feature clustering and the large receptive field of dilated convolution.
Asymmetric Feature Fusion for Image Retrieval
Then, a dynamic mixer is introduced to aggregate these features into a compact embedding for efficient search.
FashionVQA: A Domain-Specific Visual Question Answering System
We see that using the same transformer for encoding the question and decoding the answer, as in language models, achieves maximum accuracy, showing that visual language models (VLMs) make the best visual question answering systems for our dataset.
Few-Shot Learning of Accurate Folding Landscape for Protein Structure Prediction
Data-driven predictive methods which can efficiently and accurately transform protein sequences into biologically active structures are highly valuable for scientific research and therapeutical development.
A Universal PINNs Method for Solving Partial Differential Equations with a Point Source
In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs)method emerges to be a promising method for solving both forward and inverse PDE problems.
PSP: Million-level Protein Sequence Dataset for Protein Structure Prediction
We provide in addition the benchmark training procedure for SOTA protein structure prediction model on this dataset.
Cost-Sensitive Active Learning for Incomplete Data
A reasonable machine learning scenario involves obtaining certain values and labels at cost on request.
Deeply Supervised Skin Lesions Diagnosis with Stage and Branch Attention
Visual features of skin lesions vary significantly because the images are collected from patients with different lesion colours and morphologies by using dissimilar imaging equipment.
Rethinking Efficient Lane Detection via Curve Modeling
This paper presents a novel parametric curve-based method for lane detection in RGB images.
Ranked #2 on
Lane Detection
on LLAMAS
Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplars
We introduce a novel attribute similarity metric to encourage networks to learn the style of facial attributes from the exemplar in a self-supervised way.
Contextual Similarity Distillation for Asymmetric Image Retrieval
To this end, we propose a flexible contextual similarity distillation framework to enhance the small query model and keep its output feature compatible with that of large gallery model, which is crucial with asymmetric retrieval.
Rethinking Feature Uncertainty in Stochastic Neural Networks for Adversarial Robustness
Extensive experiments on well-known white- and black-box attacks show that MFDV-SNN achieves a significant improvement over existing methods, which indicates that it is a simple but effective method to improve model robustness.
Learning Token-based Representation for Image Retrieval
Next, a refinement block is introduced to enhance the visual tokens with self-attention and cross-attention.
Ranked #2 on
Image Retrieval
on RParis (Medium)
Exploring Versatile Prior for Human Motion via Motion Frequency Guidance
Prior plays an important role in providing the plausible constraint on human motion.
Meta-Auto-Decoder for Solving Parametric Partial Differential Equations
Many important problems in science and engineering require solving the so-called parametric partial differential equations (PDEs), i. e., PDEs with different physical parameters, boundary conditions, shapes of computation domains, etc.
Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks
In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs) emerges to be a promising method for solving both forward and inverse PDE problems.
Contextual Similarity Aggregation with Self-attention for Visual Re-ranking
Since our re-ranking model is not directly involved with the visual feature used in the initial retrieval, it is ready to be applied to retrieval result lists obtained from various retrieval algorithms.
DynSTGAT: Dynamic Spatial-Temporal Graph Attention Network for Traffic Signal Control
Then, to efficiently utilize the historical state information of the intersection, we design a sequence model with the temporal convolutional network (TCN) to capture the historical information and further merge it with the spatial information to improve its performance.
The 2nd Anti-UAV Workshop & Challenge: Methods and Results
The 2nd Anti-UAV Workshop \& Challenge aims to encourage research in developing novel and accurate methods for multi-scale object tracking.
SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature
For the fully connected layers, by utilizing the low-rank property of Kronecker factors of Fisher information matrix, our method only requires inverting a small matrix to approximate the curvature with desirable accuracy.
SKFAC:Training Neural Networks with Faster Kronecker-Factored Approximate Curvature
For the fully connected layers, by utilizing the low-rank property of Kronecker factors of Fisher information matrix, our method only requires inverting a small matrix to approximate the curvature with desirable accuracy.
THOR, Trace-based Hardware-adaptive layer-ORiented Natural Gradient Descent Computation
It is well-known that second-order optimizer can accelerate the training of deep neural networks, however, the huge computation cost of second-order optimization makes it impractical to apply in real practice.
IUP: An Intelligent Utility Prediction Scheme for Solid-State Fermentation in 5G IoT
In addition, we design a utility prediction model for SSF based on the Generative Adversarial Networks (GAN) and Fully Connected Neural Network (FCNN).
A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Equations
This paper concerns the a priori generalization analysis of the Deep Ritz Method (DRM) [W. E and B. Yu, 2017], a popular neural-network-based method for solving high dimensional partial differential equations.
Learning Deep Local Features With Multiple Dynamic Attentions for Large-Scale Image Retrieval
To this end, we propose a novel deep local feature learning architecture to simultaneously focus on multiple discriminative local patterns in an image.
AsymptoticNG: A regularized natural gradient optimization algorithm with look-ahead strategy
Optimizers that further adjust the scale of gradient, such as Adam, Natural Gradient (NG), etc., despite widely concerned and used by the community, are often found poor generalization performance, compared with Stochastic Gradient Descent (SGD).
Eigenvalue-corrected Natural Gradient Based on a New Approximation
Using second-order optimization methods for training deep neural networks (DNNs) has attracted many researchers.
Automatic Detection of Cardiac Chambers Using an Attention-based YOLOv4 Framework from Four-chamber View of Fetal Echocardiography
The first step to automatically analyze fetal FC views is locating the fetal four crucial chambers of heart in a US image.
A Trace-restricted Kronecker-Factored Approximation to Natural Gradient
There have been many attempts to use second-order optimization methods for training deep neural networks.
Monocular Human Pose and Shape Reconstruction using Part Differentiable Rendering
In this paper, we introduce body part segmentation as critical supervision.
Ranked #84 on
3D Human Pose Estimation
on Human3.6M
(PA-MPJPE metric)
Empirical distributions of the robustified $t$-test statistics
Based on the median and the median absolute deviation estimators, and the Hodges-Lehmann and Shamos estimators, robustified analogues of the conventional $t$-test statistic are proposed.
Applications
Weight-importance sparse training in keyword spotting
Besides this, at most of time, ASR system is used to deal with real-time problem such as keyword spotting (KWS).
Deep Multiscale Model Learning
Numerical results show that using deep learning and multiscale models, we can improve the forward models, which are conditioned to the available data.
Yuan at SemEval-2018 Task 1: Tweets Emotion Intensity Prediction using Ensemble Recurrent Neural Network
We perform the LSTM and BiLSTM model for the emotion intensity prediction.
DRPose3D: Depth Ranking in 3D Human Pose Estimation
In this paper, we propose a two-stage depth ranking based method (DRPose3D) to tackle the problem of 3D human pose estimation.
YNUDLG at IJCNLP-2017 Task 5: A CNN-LSTM Model with Attention for Multi-choice Question Answering in Examinations
In this paper, we perform convolutional neural networks (CNN) to learn the joint representations of question-answer pairs first, then use the joint representations as the inputs of the long short-term memory (LSTM) with attention to learn the answer sequence of a question for labeling the matching quality of each answer.
Design of Efficient Convolutional Layers using Single Intra-channel Convolution, Topological Subdivisioning and Spatial "Bottleneck" Structure
A topological subdivisioning is adopted to reduce the connection between the input channels and output channels.
Sparse Convolutional Neural Networks
Deep neural networks have achieved remarkable performance in both image classification and object detection problems, at the cost of a large number of parameters and computational complexity.
