Search Results for author:
Found 80 papers, 23 papers with code
Collaborative Learning of Bidirectional Decoders for Unsupervised Text Style Transfer
In this paper, we propose a collaborative learning framework for unsupervised text style transfer using a pair of bidirectional decoders, one decoding from left to right while the other decoding from right to left.
Task-oriented Domain-specific Meta-Embedding for Text Classification
Meta-embedding learning, which combines complementary information in different word embeddings, have shown superior performances across different Natural Language Processing tasks.
Conditional Causal Relationships between Emotions and Causes in Texts
The causal relationships between emotions and causes in text have recently received a lot of attention.
Exploring Non-Autoregressive Text Style Transfer
In this paper, we explore Non-AutoRegressive (NAR) decoding for unsupervised text style transfer.
Stock Movement Prediction Based on Bi-typed and Hybrid-relational Market Knowledge Graph via Dual Attention Networks
Stock Movement Prediction (SMP) aims at predicting listed companies' stock future price trend, which is a challenging task due to the volatile nature of financial markets.
Dual Hierarchical Attention Networks for Bi-typed Heterogeneous Graph Learning
Bi-typed heterogeneous graphs are applied in many real-world scenarios.
Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text
The experiments show that the resultant unified foundation transformer works surprisingly well on both the vision-only and text-only tasks, and the proposed knowledge distillation and gradient masking strategy can effectively lift the performance to approach the level of separately-trained models.
Self-Ensemling for 3D Point Cloud Domain Adaption
In SEN, a student network is kept in a collaborative manner with supervised learning and self-supervised learning, and a teacher network conducts temporal consistency to learn useful representations and ensure the quality of point clouds reconstruction.
Deep Keyphrase Completion
Keyphrase provides accurate information of document content that is highly compact, concise, full of meanings, and widely used for discourse comprehension, organization, and text retrieval.
Towards General Deep Leakage in Federated Learning
We find that image restoration fails even if there is only one incorrectly inferred label in the batch; we also find that when batch images have the same label, the corresponding image is restored as a fusion of that class of images.
Benchmark Problems for CEC2021 Competition on Evolutionary Transfer Multiobjectve Optimization
Evolutionary transfer multiobjective optimization (ETMO) has been becoming a hot research topic in the field of evolutionary computation, which is based on the fact that knowledge learning and transfer across the related optimization exercises can improve the efficiency of others.
SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing
Motivated by the success of T5 (Text-To-Text Transfer Transformer) in pre-training natural language processing models, we propose a unified-modal SpeechT5 framework that explores the encoder-decoder pre-training for self-supervised speech/text representation learning.
Multi-View Self-Attention Based Transformer for Speaker Recognition
In this work, we propose a novel multi-view self-attention mechanism and present an empirical study of different Transformer variants with or without the proposed attention mechanism for speaker recognition.
DM-CT: Consistency Training with Data and Model Perturbation
The common approach of consistency training is performed on the data-level, which typically utilizes the data augmentation strategy (or adversarial training) to make the predictions from the augmented input and the original input to be consistent, so that the model is more robust and attains better generalization ability.
YouRefIt: Embodied Reference Understanding with Language and Gesture
To the best of our knowledge, this is the first embodied reference dataset that allows us to study referring expressions in daily physical scenes to understand referential behavior, human communication, and human-robot interaction.
Graph Trend Networks for Recommendations
Recommender systems aim to provide personalized services to users and are playing an increasingly important role in our daily lives.
DGEM: A New Dual-modal Graph Embedding Method in Recommendation System
In the current deep learning based recommendation system, the embedding method is generally employed to complete the conversion from the high-dimensional sparse feature vector to the low-dimensional dense feature vector.
Jointly Attacking Graph Neural Network and its Explanations
Despite the great success, recent studies have shown that GNNs are highly vulnerable to adversarial attacks, where adversaries can mislead the GNNs' prediction by modifying graphs.
Multiple-criteria Based Active Learning with Fixed-size Determinantal Point Processes
In this paper, we introduce a multiple-criteria based active learning algorithm, which incorporates three complementary criteria, i. e., informativeness, representativeness and diversity, to make appropriate selections in the active learning rounds under different data types.
Intent Disentanglement and Feature Self-supervision for Novel Recommendation
Improving the recommendation of tail items can promote novelty and bring positive effects to both users and providers, and thus is a desirable property of recommender systems.
VLGrammar: Grounded Grammar Induction of Vision and Language
In this work, we study grounded grammar induction of vision and language in a joint learning framework.
Unsupervised Person Re-Identification with Multi-Label Learning Guided Self-Paced Clustering
The multi-label learning module leverages a memory feature bank and assigns each image with a multi-label vector based on the similarities between the image and feature bank.
A HINT from Arithmetic: On Systematic Generalization of Perception, Syntax, and Semantics
Inspired by humans' remarkable ability to master arithmetic and generalize to unseen problems, we present a new dataset, HINT, to study machines' capability of learning generalizable concepts at three different levels: perception, syntax, and semantics.
Tips and Tricks for Webly-Supervised Fine-Grained Recognition: Learning from the WebFG 2020 Challenge
WebFG 2020 is an international challenge hosted by Nanjing University of Science and Technology, University of Edinburgh, Nanjing University, The University of Adelaide, Waseda University, etc.
SMART: A Situation Model for Algebra Story Problems via Attributed Grammar
Solving algebra story problems remains a challenging task in artificial intelligence, which requires a detailed understanding of real-world situations and a strong mathematical reasoning capability.
Learning by Fixing: Solving Math Word Problems with Weak Supervision
To generate more diverse solutions, \textit{tree regularization} is applied to guide the efficient shrinkage and exploration of the solution space, and a \textit{memory buffer} is designed to track and save the discovered various fixes for each problem.
Ranked #1 on
Math Word Problem Solving
on Math23K
(weakly-supervised metric)
Multi Scale Temporal Graph Networks For Skeleton-based Action Recognition
To appropriately describe the relations between joints in the skeleton graph, we propose a multi-scale graph strategy, adopting a full-scale graph, part-scale graph, and core-scale graph to capture the local features of each joint and the contour features of important joints.
A Two-phase Prototypical Network Model for Incremental Few-shot Relation Classification
Relation Classification (RC) plays an important role in natural language processing (NLP).
A Unified Sequence Labeling Model for Emotion Cause Pair Extraction
Existing approaches address the task by first extracting emotion and cause clauses via two binary classifiers separately, and then training another binary classifier to pair them up.
Controllable Abstractive Sentence Summarization with Guiding Entities
Entities are the major proportion and build up the topic of text summaries.
Deep Learning based Monocular Depth Prediction: Datasets, Methods and Applications
Despite the rapid progress in this topic, there are lacking of a comprehensive review, which is needed to summarize the current progress and provide the future directions.
Suppressing Mislabeled Data via Grouping and Self-Attention
Specifically, this plug-and-play AFM first leverages a \textit{group-to-attend} module to construct groups and assign attention weights for group-wise samples, and then uses a \textit{mixup} module with the attention weights to interpolate massive noisy-suppressed samples.
A Wavelet-CNN-LSTM Model for Tailings Pond Risk Prediction
Tailings ponds are places for storing industrial waste.
MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization
MetaMix can be integrated with any of the MAML-based algorithms and learn the decision boundaries generalizing better to new tasks.
Object-aware Multimodal Named Entity Recognition in Social Media Posts with Adversarial Learning
To better exploit visual and textual information in NER, we propose an adversarial gated bilinear attention neural network (AGBAN).
Physical properties revealed by transport measurements on superconducting Nd$_{0.8}$Sr$_{0.2}$NiO$_{2}$ thin films
The angle dependent resistivity at a fixed temperature and different magnetic fields cannot be scaled to one curve, which deviates from the prediction of the anisotropic Ginzburg-Landau theory.
Superconductivity Materials Science Strongly Correlated Electrons
A Competence-aware Curriculum for Visual Concepts Learning via Question Answering
Humans can progressively learn visual concepts from easy to hard questions.
Aligned Dual Channel Graph Convolutional Network for Visual Question Answering
Visual question answering aims to answer the natural language question about a given image.
Neural Mixed Counting Models for Dispersed Topic Discovery
Mixed counting models that use the negative binomial distribution as the prior can well model over-dispersed and hierarchically dependent random variables; thus they have attracted much attention in mining dispersed document topics.
MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation
To the best of our knowledge, this work is the first extremely lightweight neural network trained on monocular video sequences for real-time unsupervised monocular depth estimation, which opens up the possibility of implementing deep learning-based real-time unsupervised monocular depth prediction on low-cost embedded devices.
PoseGAN: A Pose-to-Image Translation Framework for Camera Localization
We present PoseGANs, a conditional generative adversarial networks (cGANs) based framework for the implementation of pose-to-image translation.
Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
In this paper, we address these issues and close the loop of neural-symbolic learning by (1) introducing the \textbf{grammar} model as a \textit{symbolic prior} to bridge neural perception and symbolic reasoning, and (2) proposing a novel \textbf{back-search} algorithm which mimics the top-down human-like learning procedure to propagate the error through the symbolic reasoning module efficiently.
Attacking Black-box Recommendations via Copying Cross-domain User Profiles
In this work, we present our framework CopyAttack, which is a reinforcement learning based black-box attack method that harnesses real users from a source domain by copying their profiles into the target domain with the goal of promoting a subset of items.
Incorporating Effective Global Information via Adaptive Gate Attention for Text Classification
The dominant text classification studies focus on training classifiers using textual instances only or introducing external knowledge (e. g., hand-craft features and domain expert knowledge).
Solving Cold Start Problem in Recommendation with Attribute Graph Neural Networks
More importantly, for a cold start user/item that does not have any interactions, such methods are unable to learn the preference embedding of the user/item since there is no link to this user/item in the graph.
Point2Node: Correlation Learning of Dynamic-Node for Point Cloud Feature Modeling
Point2Node can dynamically explore correlation among all graph nodes from different levels, and adaptively aggregate the learned features.
Effective Semi-Supervised Node Classification on Few-Labeled Graph Data
Graph neural networks (GNNs) are designed for semi-supervised node classification on graphs where only a small subset of nodes have class labels.
Learning Category Correlations for Multi-label Image Recognition with Graph Networks
In this paper, instead of using a pre-defined graph which is inflexible and may be sub-optimal for multi-label classification, we propose the A-GCN, which leverages the popular Graph Convolutional Networks with an Adaptive label correlation graph to model label dependencies.
Why Does a Visual Question Have Different Answers?
Visual question answering is the task of returning the answer to a question about an image.
Product Image Recognition with Guidance Learning and Noisy Supervision
Instead of collecting product images by labor-and time-intensive image capturing, we take advantage of the web and download images from the reviews of several e-commerce websites where the images are casually captured by consumers.
Deep Social Collaborative Filtering
Meanwhile, most of these models treat neighbors' information equally without considering the specific recommendations.
Deep Adversarial Social Recommendation
Recent years have witnessed rapid developments on social recommendation techniques for improving the performance of recommender systems due to the growing influence of social networks to our daily life.
Virtual Mixup Training for Unsupervised Domain Adaptation
Existing methods only impose the locally-Lipschitz constraint around the training points while miss the other areas, such as the points in-between training data.
LO-Net: Deep Real-time Lidar Odometry
We present a novel deep convolutional network pipeline, LO-Net, for real-time lidar odometry estimation.
MMED: A Multi-domain and Multi-modality Event Dataset
In this work, we construct and release a multi-domain and multi-modality event dataset (MMED), containing 25, 165 textual news articles collected from hundreds of news media sites (e. g., Yahoo News, Google News, CNN News.)
pyLLE: a Fast and User Friendly Lugiato-Lefever Equation Solver
We present the development of pyLLE, a freely accessible and cross-platform Lugiato-Lefever equation solver programmed in Python and Julia and optimized for the simulation of microresonator frequency combs.
Mathematical Software Optics
Graph Neural Networks for Social Recommendation
These advantages of GNNs provide great potential to advance social recommendation since data in social recommender systems can be represented as user-user social graph and user-item graph; and learning latent factors of users and items is the key.
Ranked #3 on
Recommendation Systems
on Epinions
(using extra training data)
Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Network
With the rapid growing of remotely sensed imagery data, there is a high demand for effective and efficient image retrieval tools to manage and exploit such data.
Learning Shared Semantic Space with Correlation Alignment for Cross-modal Event Retrieval
In this paper, we propose to learn shared semantic space with correlation alignment (${S}^{3}CA$) for multimodal data representations, which aligns nonlinear correlations of multimodal data distributions in deep neural networks designed for heterogeneous data.
Relative Geometry-Aware Siamese Neural Network for 6DOF Camera Relocalization
6DOF camera relocalization is an important component of autonomous driving and navigation.
An Investigation of Few-Shot Learning in Spoken Term Classification
In this paper, we investigate the feasibility of applying few-shot learning algorithms to a speech task.
Single Bitmap Block Truncation Coding of Color Images Using Hill Climbing Algorithm
Compared with various schemes, the simulation results of the proposed scheme are better than that of the reference schemes in visual quality and time consumption.
Unpaired Multi-Domain Image Generation via Regularized Conditional GANs
To tackle this problem, we propose Regularized Conditional GAN (RegCGAN) which is capable of learning to generate corresponding images in the absence of paired training data.
VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions
Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations.
Unsupervised Cross-dataset Person Re-identification by Transfer Learning of Spatial-Temporal Patterns
Most of the proposed person re-identification algorithms conduct supervised training and testing on single labeled datasets with small size, so directly deploying these trained models to a large-scale real-world camera network may lead to poor performance due to underfitting.
VizWiz Grand Challenge: Answering Visual Questions from Blind People
The study of algorithms to automatically answer visual questions currently is motivated by visual question answering (VQA) datasets constructed in artificial VQA settings.
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the uninterpretable CNN features in conjunction with the question to predict the answer.
On the Effectiveness of Least Squares Generative Adversarial Networks
To overcome such a problem, we propose in this paper the Least Squares Generative Adversarial Networks (LSGANs) which adopt the least squares loss for both the discriminator and the generator.
Locally-Transferred Fisher Vectors for Texture Classification
Texture classification has been extensively studied in computer vision.
AlignGAN: Learning to Align Cross-Domain Images with Conditional Generative Adversarial Networks
Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images.
A Network Framework for Noisy Label Aggregation in Social Media
This paper focuses on the task of noisy label aggregation in social media, where users with different social or culture backgrounds may annotate invalid or malicious tags for documents.
Multiple VLAD encoding of CNNs for image classification
In this paper, we propose a special framework, which is the multiple VLAD encoding method with the CNNs features for image classification.
T-CONV: A Convolutional Neural Network For Multi-scale Taxi Trajectory Prediction
Precise destination prediction of taxi trajectories can benefit many intelligent location based services such as accurate ad for passengers.
Least Squares Generative Adversarial Networks
To overcome such a problem, we propose in this paper the Least Squares Generative Adversarial Networks (LSGANs) which adopt the least squares loss function for the discriminator.
Fusing Subcategory Probabilities for Texture Classification
Texture, as a fundamental characteristic of objects, has attracted much attention in computer vision research.
HCRS: A hybrid clothes recommender system based on user ratings and product features
Nowadays, online clothes-selling business has become popular and extremely attractive because of its convenience and cheap-and-fine price.
