Search Results for author:
Found 108 papers, 32 papers with code
Multi-Granularity Semantic Aware Graph Model for Reducing Position Bias in Emotion Cause Pair Extraction
Besides, a clause graph is also established to model coarse-grained semantic relations between clauses.
A Unified Propagation Forest-based Framework for Fake News Detection
Fake news’s quick propagation on social media brings severe social ramifications and economic damage.
Uncertainty-aware Propagation Structure Reconstruction for Fake News Detection
In this paper, we propose a novel dual graph-based model, Uncertainty-aware Propagation Structure Reconstruction (UPSR) for improving fake news detection.
Intra-class Feature Variation Distillation for Semantic Segmentation
In this paper, different from previous methods performing knowledge distillation for densely pairwise relations, we propose a novel intra-class feature variation distillation (IFVD) to transfer the intra-class feature variation (IFV) of the cumbersome model (teacher) to the compact model (student).
JCDNet: Joint of Common and Definite phases Network for Weakly Supervised Temporal Action Localization
These different actions are defined as conjoint actions, whose rest parts are definite phases, e. g., leaping over the bar in a HighJump.
BrainCLIP: Bridging Brain and Visual-Linguistic Representation via CLIP for Generic Natural Visual Stimulus Decoding from fMRI
In this work, we propose, for the first time, a task-agnostic brain decoding model by unifying the visual stimulus classification and reconstruction tasks in a semantic space.
Blind Omnidirectional Image Quality Assessment: Integrating Local Statistics and Global Semantics
Omnidirectional image quality assessment (OIQA) aims to predict the perceptual quality of omnidirectional images that cover the whole 180$\times$360$^{\circ}$ viewing range of the visual environment.
Efficient 3D Object Reconstruction using Visual Transformers
Reconstructing a 3D object from a 2D image is a well-researched vision problem, with many kinds of deep learning techniques having been tried.
Story Shaping: Teaching Agents Human-like Behavior with Stories
We introduce a technique, Story Shaping, in which a reinforcement learning agent infers tacit knowledge from an exemplar story of how to accomplish a task and intrinsically rewards itself for performing actions that make its current environment adhere to that of the inferred story world.
Reduced-Reference Quality Assessment of Point Clouds via Content-Oriented Saliency Projection
Many dense 3D point clouds have been exploited to represent visual objects instead of traditional images or videos.
Lattice-Free Sequence Discriminative Training for Phoneme-Based Neural Transducers
Compared to the N-best-list based minimum Bayes risk objectives, lattice-free methods gain 40% - 70% relative training time speedup with a small degradation in performance.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Dehazed Image Quality Evaluation: From Partial Discrepancy to Blind Perception
Image dehazing aims to restore spatial details from hazy images.
Affinity Feature Strengthening for Accurate, Complete and Robust Vessel Segmentation
In this paper, we present a novel affinity feature strengthening network (AFN) which adopts a contrast-insensitive approach based on multiscale affinity to jointly model topology and refine pixel-wise segmentation features.
Enhancing and Adversarial: Improve ASR with Speaker Labels
Detailed analysis and experimental verification are conducted to show the optimal positions in the ASR neural network (NN) to apply speaker enhancing and adversarial training.
Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Report
The role of mobile cameras increased dramatically over the past few years, leading to more and more research in automatic image quality enhancement and RAW photo processing.
Monotonic segmental attention for automatic speech recognition
We restrict the decoder attention to segments to avoid quadratic runtime of global attention, better generalize to long sequences, and eventually enable streaming.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
KGCODE-Tab Results for SemTab 2022
This paper presents the results of KGCODE-Tab in the tabular data to knowledge graph matching contest SemTab 2022.
Ranked #1 on
Column Type Annotation
on ToughTables-DBP
Digital Human Interactive Recommendation Decision-Making Based on Reinforcement Learning
Our proposed framework learns through real-time interactions between the digital human and customers dynamically through the state-of-art RL algorithms, combined with multimodal embedding and graph embedding, to improve the accuracy of personalization and thus enable the digital human agent to timely catch the attention of the customer.
An Embarrassingly Simple Approach to Semi-Supervised Few-Shot Learning
Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data.
FasterX: Real-Time Object Detection Based on Edge GPUs for UAV Applications
Real-time object detection on Unmanned Aerial Vehicles (UAVs) is a challenging issue due to the limited computing resources of edge GPU devices as Internet of Things (IoT) nodes.
Blind Quality Assessment of 3D Dense Point Clouds with Structure Guided Resampling
Objective quality assessment of 3D point clouds is essential for the development of immersive multimedia systems in real-world applications.
Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity
There has been a growing interest in developing image super-resolution (SR) algorithms that convert low-resolution (LR) to higher resolution images, but automatically evaluating the visual quality of super-resolved images remains a challenging problem.
RTN: Reinforced Transformer Network for Coronary CT Angiography Vessel-level Image Quality Assessment
Therefore, we propose a Progressive Reinforcement learning based Instance Discarding module (termed as PRID) to progressively remove quality-irrelevant/negative instances for CCTA VIQA.
Speaker-Guided Encoder-Decoder Framework for Emotion Recognition in Conversation
Since the dependencies between speakers are complex and dynamic, which consist of intra- and inter-speaker dependencies, the modeling of speaker-specific information is a vital role in ERC.
Deep Decomposition and Bilinear Pooling Network for Blind Night-Time Image Quality Evaluation
The DDB-Net contains three modules, i. e., an image decomposition module, a feature encoding module, and a bilinear pooling module.
Multi-Granularity Semantic Aware Graph Model for Reducing Position Bias in Emotion-Cause Pair Extraction
Besides, a clause graph is also established to model coarse-grained semantic relations between clauses.
Efficient Training of Neural Transducer for Speech Recognition
In this work, we propose an efficient 3-stage progressive training pipeline to build highly-performing neural transducer models from scratch with very limited computation resources in a reasonable short time period.
HIT-UAV: A High-altitude Infrared Thermal Dataset for Unmanned Aerial Vehicles
This paper presents a High-altitude infrared thermal dataset, HIT-UAV, for object detection applications on Unmanned Aerial Vehicles (UAVs).
Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech
However, the works apply pre-training with character-based units to enhance the TTS phoneme encoder, which is inconsistent with the TTS fine-tuning that takes phonemes as input.
A Brief Survey on Adaptive Video Streaming Quality Assessment
In this paper, we provide a brief overview of adaptive video streaming quality assessment.
Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Features
One of the key communicative competencies is the ability to maintain fluency in monologic speech and the ability to produce sophisticated language to argue a position convincingly.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Multi-agent Reinforcement Learning for Cooperative Lane Changing of Connected and Autonomous Vehicles in Mixed Traffic
In this paper, we formulate the lane-changing decision making of multiple AVs in a mixed-traffic highway environment as a multi-agent reinforcement learning (MARL) problem, where each AV makes lane-changing decisions based on the motions of both neighboring AVs and HDVs.
Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layers
Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains.
Raw Bayer Pattern Image Synthesis for Computer Vision-oriented Image Signal Processing Pipeline Design
It is shown that by adding another transformation, the proposed method is able to synthesize high-quality RAW Bayer images with arbitrary size.
On Language Model Integration for RNN Transducer based Speech Recognition
In this work, we study various ILM correction-based LM integration methods formulated in a common RNN-T framework.
AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce
Live streaming is becoming an increasingly popular trend of sales in E-commerce.
GGP: A Graph-based Grouping Planner for Explicit Control of Long Text Generation
With these two synergic representations, we then regroup these phrases into a fine-grained plan, based on which we generate the final long text.
SPMoE: Generate Multiple Pattern-Aware Outputs with Sparse Pattern Mixture of Experts
Each one-to-one mapping is associated with a conditional generation pattern and is modeled with an expert in SPMoE.
Label-Specific Dual Graph Neural Network for Multi-Label Text Classification
Multi-label text classification is one of the fundamental tasks in natural language processing.
Transformer-Encoder-GRU (T-E-GRU) for Chinese Sentiment Analysis on Chinese Comment Text
Chinese sentiment analysis (CSA) has always been one of the challenges in natural language processing due to its complexity and uncertainty.
Unsupervised Segmentation for Terracotta Warrior with Seed-Region-Growing CNN(SRG-Net)
Then we present a supervised segmentation and unsupervised reconstruction networks to learn the characteristics of 3D point clouds.
Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds
Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MPVConv improves the accuracy of the backbone (PointNet) by up to \textbf{36\%}, and achieves higher accuracy than the voxel-based model with up to \textbf{34}$\times$ speedups.
Towards Propagation Uncertainty: Edge-enhanced Bayesian Graph Convolutional Networks for Rumor Detection
Detecting rumors on social media is a very critical task with significant implications to the economy, public health, etc.
A Fixed Version of Quadratic Program in Gradient Episodic Memory
Gradient Episodic Memory is indeed a novel method for continual learning, which solves new problems quickly without forgetting previously acquired knowledge.
PEN4Rec: Preference Evolution Networks for Session-based Recommendation
The process can strengthen the effect of relevant sequential behaviors during the preference evolution and weaken the disturbance from preference drifting.
Ranked #1 on
Session-Based Recommendations
on Last.FM
Challenging distributional models with a conceptual network of philosophical terms
We investigate the possibilities and limitations of using distributional semantic models for analyzing philosophical data by means of a realistic use-case.
Adaptive Hypergraph Convolutional Network for No-Reference 360-degree Image Quality Assessment
In the hypergraph construction, we build a location-based hyperedge and a content-based hyperedge for each viewport.
Image Super-Resolution Quality Assessment: Structural Fidelity Versus Statistical Naturalness
In this paper, we assess the quality of SISR generated images in a two-dimensional (2D) space of structural fidelity versus statistical naturalness.
SRLF: A Stance-aware Reinforcement Learning Framework for Content-based Rumor Detection on Social Media
The rapid development of social media changes the lifestyle of people and simultaneously provides an ideal place for publishing and disseminating rumors, which severely exacerbates social panic and triggers a crisis of social trust.
Multi Voxel-Point Neurons Convolution (MVPConv) for Fast and Accurate 3D Deep Learning
Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MVPConv improves the accuracy of the backbone (PointNet) by up to 36%, and achieves higher accuracy than the voxel-based model with up to 34 times speedup.
Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognition
Subword units are commonly used for end-to-end automatic speech recognition (ASR), while a fully acoustic-oriented subword modeling approach is somewhat missing.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
The Impact of ASR on the Automatic Analysis of Linguistic Complexity and Sophistication in Spontaneous L2 Speech
In recent years, automated approaches to assessing linguistic complexity in second language (L2) writing have made significant progress in gauging learner performance, predicting human ratings of the quality of learner productions, and benchmarking L2 development.
Equivalence of Segmental and Neural Transducer Modeling: A Proof of Concept
With the advent of direct models in automatic speech recognition (ASR), the formerly prevalent frame-wise acoustic modeling based on hidden Markov models (HMM) diversified into a number of modeling architectures like encoder-decoder attention models, transducer models and segmental models (direct HMM).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Bayesian Graph Convolutional Network for Traffic Prediction
Under this framework, the graph structure is viewed as a random realization from a parametric generative model, and its posterior is inferred using the observed topology of the road network and traffic data.
No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness
To our knowledge, the proposed model is the first no-reference quality assessment method for 360-degreee images that combines multi-frequency information and image naturalness.
FedH2L: Federated Learning with Model and Statistical Heterogeneity
Federated learning (FL) enables distributed participants to collectively learn a strong global model without sacrificing their individual data privacy.
Electronic transport properties and hydrostatic pressure effect of FeSe$_{0.67}$Te$_{0.33}$ single crystals free of phase separation
FeSe$_{1-x}$Te$_{x}$ superconductors manifest some intriguing electronic properties depending on the value of $x$.
Superconductivity Materials Science
Improving robustness of softmax corss-entropy loss via inference information
Several state-of-the-arts start from improving the inter-class separability of training samples by modifying loss functions, where we argue that the adversarial samples are ignored and thus limited robustness to adversarial attacks is resulted.
Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learning
In this way, we can explicitly exploit the credibility of publishers and users for early fake news detection.
Deep Multi-Scale Features Learning for Distorted Image Quality Assessment
In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction.
Unsupervised Segmentation for Terracotta Warrior Point Cloud (SRG-Net)
Then we present a supervised segmentation and unsupervised reconstruction networks to learn the characteristics of 3D point clouds.
Phoneme Based Neural Transducer for Large Vocabulary Speech Recognition
To join the advantages of classical and end-to-end approaches for speech recognition, we present a simple, novel and competitive approach for phoneme-based neural transducer modeling.
Bayesian Spatio-Temporal Graph Convolutional Network for Traffic Forecasting
The graph structure in our network is learned from the physical topology of the road network and traffic data in an end-to-end manner, which discovers a more accurate description of the relationship among traffic flows.
Affinity Space Adaptation for Semantic Segmentation Across Domains
Specifically, we perform domain adaptation on the affinity relationship between adjacent pixels termed affinity space of source and target domain.
Residual Spatial Attention Network for Retinal Vessel Segmentation
In this work, we propose the Residual Spatial Attention Network (RSAN) for retinal vessel segmentation.
Empirical Fourier Decomposition: An Accurate Adaptive Signal Decomposition Method
An accurate adaptive signal decomposition method, called the empirical Fourier decomposition (EFD), is proposed to solve the problems in this work.
LIRA: Lifelong Image Restoration from Unknown Blended Distortions
Most existing image restoration networks are designed in a disposable way and catastrophically forget previously learned distortions when trained on a new distortion removal task.
Adaptive support driven Bayesian reweighted algorithm for sparse signal recovery
For example, sparse Bayesian learning (SBL) was proposed to learn major features from a dictionary of basis functions, which makes identified models interpretable.
Learning Disentangled Feature Representation for Hybrid-distorted Image Restoration
Hybrid-distorted image restoration (HD-IR) is dedicated to restore real distorted image that is degraded by multiple distortions.
Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentiment Analysis
Furthermore, we design a Sentiment-based Rethinking mechanism (SR) by refining the HIN with sentiment label information to learn a more sentiment-aware document representation.
Rethinking Distributional Matching Based Domain Adaptation
In this paper, in order to devise robust DA algorithms, we first systematically analyze the limitations of DM based methods, and then build new benchmarks with more realistic domain shifts to evaluate the well-accepted DM methods.
DyHGCN: A Dynamic Heterogeneous Graph Convolutional Network to Learn Users' Dynamic Preferences for Information Diffusion Prediction
For one thing, previous works cannot jointly utilize both the social network and diffusion graph for prediction, which is insufficient to model the complexity of the diffusion process and results in unsatisfactory prediction performance.
AutoSUM: Automating Feature Extraction and Multi-user Preference Simulation for Entity Summarization
In this paper, a novel integration method called AutoSUM is proposed for automatic feature extraction and multi-user preference simulation to overcome the drawbacks of previous methods.
A systematic comparison of grapheme-based vs. phoneme-based label units for encoder-decoder-attention models
Following the rationale of end-to-end modeling, CTC, RNN-T or encoder-decoder-attention models for automatic speech recognition (ASR) use graphemes or grapheme-based subword units based on e. g. byte-pair encoding (BPE).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Blind Quality Assessment for Image Superresolution Using Deep Two-Stream Convolutional Networks
Numerous image superresolution (SR) algorithms have been proposed for reconstructing high-resolution (HR) images from input images with lower spatial resolutions.
Channel Attention Residual U-Net for Retinal Vessel Segmentation
Retinal vessel segmentation is a vital step for the diagnosis of many early eye-related diseases.
Dense Residual Network for Retinal Vessel Segmentation
But for other retinal imaging modalities, more research is needed to explore vascular extraction.
Gradient-based Feature Extraction From Raw Bayer Pattern Images
In this paper, the impact of demosaicing on gradient extraction is studied and a gradient-based feature extraction pipeline based on raw Bayer pattern images is proposed.
The RWTH ASR System for TED-LIUM Release 2: Improving Hybrid HMM with SpecAugment
We present a complete training pipeline to build a state-of-the-art hybrid HMM-based ASR system on the 2nd release of the TED-LIUM corpus.
Online Meta-Critic Learning for Off-Policy Actor-Critic Methods
Off-Policy Actor-Critic (Off-PAC) methods have proven successful in a variety of continuous control tasks.
Beyond Statistical Relations: Integrating Knowledge Relations into Style Correlations for Multi-Label Music Style Classification
Based on the two types of relations, we use a graph convolutional network to learn the deep correlations between styles automatically.
Query-bag Matching with Mutual Coverage for Information-seeking Conversations in E-commerce
Information-seeking conversation system aims at satisfying the information needs of users through conversations.
Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
Existing works mainly focus on matching candidate responses with every context utterance on multiple levels of granularity, which ignore the side effect of using excessive context information.
Ranked #5 on
Conversational Response Selection
on RRS
ALOHA: Artificial Learning of Human Attributes for Dialogue Agents
We propose Human Level Attributes (HLAs) based on tropes as the basis of a method for learning dialogue agents that can imitate the personalities of fictional characters.
Feature Fusion Detector for Semantic Cognition of Remote Sensing
Based on experiments on the remote sensing dataset from Google Earth, our LFFN has proved effective and practical for the semantic cognition of remote sensing, achieving 89% mAP which is 4. 1% higher than that of FPN.
Jointly embedding the local and global relations of heterogeneous graph for rumor detection
The development of social media has revolutionized the way people communicate, share information and make decisions, but it also provides an ideal platform for publishing and spreading rumors.
Learning review representations from user and product level information for spam detection
Then, we use orthogonal decomposition and fusion attention to learn a user, review, and product representation from the review information.
Tensor Oriented No-Reference Light Field Image Quality Assessment
Light field image (LFI) quality assessment is becoming more and more important, which helps to better guide the acquisition, processing and application of immersive media.
Binocular Rivalry Oriented Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Measurement
Stereoscopic image quality measurement (SIQM) has become increasingly important for guiding stereo image processing and commutation systems due to the widespread usage of 3D contents.
Multimedia Image and Video Processing
No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement
In this paper, we propose a No-Reference Light Field image Quality Assessment (NR-LFQA) scheme, where the main idea is to quantify the LFI quality degradation through evaluating the spatial quality and angular consistency.
An Intelligent Testing Strategy for Vocabulary Assessment of Chinese Second Language Learners
In this paper, we propose a novel testing strategy by combining automatic item generation (AIG) and computerized adaptive testing (CAT) in vocabulary assessment for Chinese L2 learners.
LSTM Language Models for LVCSR in First-Pass Decoding and Lattice-Rescoring
LSTM based language models are an important part of modern LVCSR systems as they significantly improve performance over traditional backoff language models.
Stereoscopic Omnidirectional Image Quality Assessment Based on Predictive Coding Theory
In this paper, based on the predictive coding theory of the human vision system (HVS), we propose a stereoscopic omnidirectional image quality evaluator (SOIQE) to cope with the characteristics of 3D 360-degree images.
Spectral Perturbation Meets Incomplete Multi-view Data
In this work, we show a strong link between perturbation risk bounds and incomplete multi-view clustering.
ESA: Entity Summarization with Attention
Entity summarization aims at creating brief but informative descriptions of entities from knowledge graphs.
Review-Driven Answer Generation for Product-Related Questions in E-Commerce
Then, we devise a mechanism to identify the relevant information from the noise-prone review snippets and incorporate this information to guide the answer generation.
Feature-Critic Networks for Heterogeneous Domain Generalization
The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training.
Ranked #97 on
Domain Generalization
on PACS
Hierarchical Reinforcement Learning for Multi-agent MOBA Game
Real Time Strategy (RTS) games require macro strategies as well as micro strategies to obtain satisfactory performance since it has large state space, action space, and hidden information.
TextField: Learning A Deep Direction Field for Irregular Scene Text Detection
Experimental results show that the proposed TextField outperforms the state-of-the-art methods by a large margin (28% and 8%) on two curved text datasets: Total-Text and CTW1500, respectively, and also achieves very competitive performance on multi-oriented datasets: ICDAR 2015 and MSRA-TD500.
Ranked #20 on
Scene Text Detection
on Total-Text
Unsupervised Single Image Deraining with Self-supervised Constraints
Most existing single image deraining methods require learning supervised models from a large set of paired synthetic training data, which limits their generality, scalability and practicality in real-world multimedia applications.
Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving
This paper presents a novel method for analysing the robustness of semantic segmentation models and provides a number of metrics to evaluate the classification performance over a variety of environmental conditions.
Data-driven Discovery of Cyber-Physical Systems
Cyber-physical systems (CPSs) embed software into the physical world.
Adapting Semantic Segmentation Models for Changes in Illumination and Camera Perspective
Semantic segmentation using deep neural networks has been widely explored to generate high-level contextual information for autonomous vehicles.
A Deep Relevance Model for Zero-Shot Document Filtering
In the era of big data, focused analysis for diverse topics with a short response time becomes an urgent demand.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce
Building multi-turn information-seeking conversation systems is an important and challenging research topic.
Histograms of Gaussian normal distribution for feature matching in clutter scenes
Especially in cluttered scenes there are many feature mismatches between scenes and models.
CFAR Line Detector for Polarimetric SAR Images Using Wilks’ Test Statistic
In this letter, a constant false-alarm rate line detector for polarimetric synthetic aperture radar (Pol-SAR) images is presented based on Wilks’ test statistic, which can be used to test the equality of two covariance matrices following the complex Wishart distribution.
