Search Results for author:
Found 152 papers, 42 papers with code
Chinese Long and Short Form Choice Exploiting Neural Network Language Modeling Approaches
This paper presents our work in long and short form choice, a significant question of lexical choice, which plays an important role in many Natural Language Understanding tasks.
Gradations of Error Severity in Automatic Image Descriptions
Because our manipulated descriptions form minimal pairs with the reference descriptions, we are able to assess the impact of different kinds of errors on the perceived quality of the descriptions.
标签先验知识增强的方面类别情感分析方法研究(Aspect-Category based Sentiment Analysis Enhanced by Label Prior Knowledge)
“当前, 基于方面类别的情感分析研究旨在将方面类别检测和面向类别的情感分类两个任务协同进行。然而, 现有研究未能有效关注情感数据集中存在的噪声标签, 影响了情感分析的质量。基于此, 本文提出一种标签先验知识增强的方面类别情感分析方法(AP-LPK)。首先本文为面向类别的情感分类构建了自回归提示训练方式, 可以激发预训练语言模型的潜力。同时该方式通过自回归生成标签词, 以期获得比非自回归更好的语义一致性。其次, 每个类别的标签分布作为标签先验知识引入, 并通过伯努利分布对其进行进一步精炼, 以用于减轻噪声标签的干扰。然后, AP-LPK将上述两个步骤分别得到的情感类别分布进行融合, 以获得最终的情感类别预测概率。最后, 本文提出的AP-LPK方法在五个数据集上进行评估, 包括SemEval 2015和2016的四个基准数据集和AI Challenger 2018的餐厅领域大规模数据集。实验结果表明, 本文提出的方法在F1指标上优于现有方法。”
Breast density in MRI: an AI-based quantification and relationship to assessment in mammography
Mammographic breast density is a well-established risk factor for breast cancer.
Relation-R1: Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relational Comprehension
Recent advances in multi-modal large language models (MLLMs) have significantly improved object-level grounding and region captioning, but remain limited in visual relation understanding (\eg, scene graph generation), particularly in modeling \textit{N}-ary relationships that identify multiple semantic roles among an action event.
Knowledge Acquisition on Mass-shooting Events via LLMs for AI-Driven Justice
Mass-shooting events pose a significant challenge to public safety, generating large volumes of unstructured textual data that hinder effective investigations and the formulation of public policy.
Predicting ulcer in H&E images of inflammatory bowel disease using domain-knowledge-driven graph neural network
In this work, we propose a weakly-supervised model called DomainGCN that employs a graph convolution neural network (GCN) and incorporates domain-specific knowledge of ulcer features, specifically, the presence of epithelium, lymphocytes, and debris for WSI-level ulcer prediction in IBD.
Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUs
Our exploration demonstrates that Ascend NPUs are capable of efficiently and effectively training dense models with more than 100 billion parameters.
SlimSpeech: Lightweight and Efficient Text-to-Speech with Slim Rectified Flow
Recently, flow matching based speech synthesis has significantly enhanced the quality of synthesized speech while reducing the number of inference steps.
Emerging Cyber Attack Risks of Medical AI Agents
Large language models (LLMs)-powered AI agents exhibit a high level of autonomy in addressing medical and healthcare challenges.
Accelerating and enhancing thermodynamic simulations of electrochemical interfaces
Electrochemical interfaces are crucial in catalysis, energy storage, and corrosion, where their stability and reactivity depend on complex interactions between the electrode, adsorbates, and electrolyte.
Personalize Anything for Free with Diffusion Transformer
Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing.
A Novel Ophthalmic Benchmark for Evaluating Multimodal Large Language Models with Fundus Photographs and OCT Images
These shortcomings hinder the accurate assessment of MLLMs' ability to interpret OCT scans and their broader applicability in ophthalmology.
Reducing Large Language Model Safety Risks in Women's Health using Semantic Entropy
This study highlights the potential of SE as a key safeguard in the responsible deployment of AI-driven tools in women's health, leading to safer and more effective digital health interventions.
Exploring Incremental Unlearning: Techniques, Challenges, and Future Directions
The growing demand for data privacy in Machine Learning (ML) applications has seen Machine Unlearning (MU) emerge as a critical area of research.
Representational Alignment with Chemical Induced Fit for Molecular Relational Learning
The representational similarity between substructure pairs determines the functional compatibility of molecular binding sites.
YETI (YET to Intervene) Proactive Interventions by Multimodal AI Agents in Augmented Reality Tasks
Such AR capabilities can help AI Agents see and listen to actions that users take which can relate to multimodal capabilities of human users.
BENet: A Cross-domain Robust Network for Detecting Face Forgeries via Bias Expansion and Latent-space Attention
BENet enhances the detection of fake faces by addressing limitations in current detectors related to variations across different types of fake face generation techniques, where ``cross-domain" refers to the diverse range of these deepfakes, each considered a separate domain.
Beyond Sight: Towards Cognitive Alignment in LVLM via Enriched Visual Knowledge
Specifically, the VE's representation of visual information may not fully align with LLM's cognitive framework, leading to a mismatch where visual features exceed the language model's interpretive range.
MemoryFormer: Minimize Transformer Computation by Removing Fully-Connected Layers
This is made possible by utilizing an alternative method for feature transformation to replace the linear projection of fully-connected layers.
Artificial Intelligence for Biomedical Video Generation
As a prominent subfield of Artificial Intelligence Generated Content (AIGC), video generation has achieved notable advancements in recent years.
A Survey on Bundle Recommendation: Methods, Applications, and Challenges
In recent years, bundle recommendation systems have gained significant attention in both academia and industry due to their ability to enhance user experience and increase sales by recommending a set of items as a bundle rather than individual items.
Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code Review
Public Code Review (PCR) is an assistant to the internal code review of the development team, in the form of a public Software Question Answering (SQA) community, to help developers access high-quality and efficient review services.
An accelerate Prediction Strategy for Dynamic Multi-Objective Optimization
To effectively track the changes in the PS and PF in both decision and objective spaces, we propose an adaptive prediction strategy that incorporates second-order derivatives to predict and adjust the algorithms search behavior.
A Survey on Multimodal Benchmarks: In the Era of Large AI Models
The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content.
Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Model
Due to the inherent difficulty in modeling phonetic similarities across different languages, code-switching speech recognition presents a formidable challenge.
Dynamic Language Group-Based MoE: Enhancing Code-Switching Speech Recognition with Hierarchical Routing
However, the existing CS-ASR work on MoE has yet to leverage the advantages of MoE's parameter scaling ability fully.
From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generation
Despite remarkable progress in PSG, almost all existing methods neglect the importance of shape-aware features, which inherently focus on the contours and boundaries of objects.
CoMM: A Coherent Interleaved Image-Text Dataset for Multimodal Understanding and Generation
To address this gap, we introduce CoMM, a high-quality Coherent interleaved image-text MultiModal dataset designed to enhance the coherence, consistency, and alignment of generated multimodal content.
LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation
And the effectiveness of the method is accompanied by the extensive number of sampling steps, leading to an extended synthesis time necessary for generating high-quality audio.
Seeing Beyond Classes: Zero-Shot Grounded Situation Recognition via Language Explainer
This complex task usually involves three steps: verb recognition, semantic role grounding, and noun recognition.
Enhancing Sign Language Teaching: A Mixed Reality Approach for Immersive Learning and Multi-Dimensional Feedback
Furthermore, we use mixed reality technology to construct a scenario-based 3D sign language classroom and explore the user experience of scenario teaching.
On Unified Prompt Tuning for Request Quality Assurance in Public Code Review
Public Code Review (PCR) can be implemented through a Software Question Answering (SQA) community, which facilitates high knowledge dissemination.
CrimeAlarm: Towards Intensive Intent Dynamics in Fine-grained Crime Prediction
Granularity and accuracy are two crucial factors for crime event prediction.
MealRec$^+$: A Meal Recommendation Dataset with Meal-Course Affiliation for Personalization and Healthiness
Due to constraints related to user health privacy and meal scenario characteristics, the collection of data that includes both meal-course affiliation and two levels of interactions is impeded.
Federated Distillation: A Survey
Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients.
ContourDiff: Unpaired Image-to-Image Translation with Structural Consistency for Medical Imaging
We then propose ContourDiff, a novel image-to-image translation algorithm that leverages domain-invariant anatomical contour representations of images to preserve the anatomical structures during translation.
One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models
This work studies the adversarial robustness of VLMs from the novel perspective of the text prompt instead of the extensively studied model weights (frozen in this work).
Primary and Secondary Factor Consistency as Domain Knowledge to Guide Happiness Computing in Online Assessment
We achieve this through: (1) proving that multiple prediction models with additive factor attributions will have the desirable property of primary and secondary relations consistency, and (2) showing that factor relations with quantity can be represented as an importance distribution for encoding domain knowledge.
Towards Causal Classification: A Comprehensive Study on Graph Neural Networks
The exploration of Graph Neural Networks (GNNs) for processing graph-structured data has expanded, particularly their potential for causal analysis due to their universal approximation capabilities.
SegmentAnyBone: A Universal Model that Segments Any Bone at Any Location on MRI
In our study, we propose a versatile, publicly available deep-learning model for bone segmentation in MRI across multiple standard MRI locations.
Persona-centric Metamorphic Relation guided Robustness Evaluation for Multi-turn Dialogue Modelling
For that reason, this work evaluates several widely used training paradigms including learning from scratch, pretrain + fine-tune and prompt learning in personalized dialogue retrieval to know if they are more robust or if they have the same flaws as their predecessor.
MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis
The challenges of modeling such a multi-modal style controllable TTS mainly lie in two aspects:1)aligning the multi-modal information into a unified style space to enable the input of arbitrary modality as the style prompt in a single system, and 2)efficiently transferring the unified style representation into the given text content, thereby empowering the ability to generate prompt style-related voice.
Higher-Order Equivariant Neural Networks for Charge Density Prediction in Materials
The calculation of electron density distribution using density functional theory (DFT) in materials and molecules is central to the study of their quantum and macro-scale properties, yet accurate and efficient calculation remains a long-standing challenge.
Exploring Causal Learning through Graph Neural Networks: An In-depth Review
In machine learning, exploring data correlations to predict outcomes is a fundamental task.
Compositional Zero-shot Learning via Progressive Language-based Observations
Compositional zero-shot learning aims to recognize unseen state-object compositions by leveraging known primitives (state and object) during training.
Interpretable Geoscience Artificial Intelligence (XGeoS-AI): Application to Demystify Image Recognition
Experimental results demonstrate that the effectiveness, versatility, and heuristics of the proposed framework have great potential in solving geoscience image recognition problems.
OODRobustBench: a Benchmark and Large-Scale Analysis of Adversarial Robustness under Distribution Shift
The latter enables the prediction of OOD robustness from ID robustness.
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models
Automated theorem proving (ATP) has become an appealing domain for exploring the reasoning ability of the recent successful generative language models.
VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence
To be commensurate with this capacity, in addition to the real data used for pre-training, we also generated and leveraged synthetic ophthalmic imaging data.
Cross-domain Robust Deepfake Bias Expansion Network for Face Forgery Detection
In addition, to further heighten the amplification of forged clues, BENet incorporates a Latent-Space Attention (LSA) module.
LEGO-Prover: Neural Theorem Proving with Growing Libraries
Our ablation study indicates that these newly added skills are indeed helpful for proving theorems, resulting in an improvement from a success rate of 47. 1% to 50. 4%.
Ranked #1 on
Automated Theorem Proving
on miniF2F-valid
(Pass@100 metric)
Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion
In our study, we propose a novel Clustered FedStack framework based on the previously published Stacked Federated Learning (FedStack) framework.
Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions
Effective patient monitoring is vital for timely interventions and improved healthcare outcomes.
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
These issues compromise both the accuracy and the computational efficiency of models in both Machine Learning and Unlearning.
QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems
The deep learning models achieved state-of-the-art results in both prediction and classification tasks.
PDRL: Multi-Agent based Reinforcement Learning for Predictive Monitoring
The PDRL framework is able to learn the future states of the traffic and weather forecasting and the cumulative rewards are gradually increasing over each episode.
Graph-enabled Reinforcement Learning for Time Series Forecasting with Adaptive Intelligence
In this study, we propose a novel approach for predicting time-series data using GNN and monitoring with Reinforcement Learning (RL).
When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System
Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized.
FIMO: A Challenge Formal Dataset for Automated Theorem Proving
We present FIMO, an innovative dataset comprising formal mathematical problem statements sourced from the International Mathematical Olympiad (IMO) Shortlisted Problems.
Compositional Feature Augmentation for Unbiased Scene Graph Generation
Specifically, we first decompose each relation triplet feature into two components: intrinsic feature and extrinsic feature, which correspond to the intrinsic characteristics and extrinsic contexts of a relation triplet, respectively.
RealLiFe: Real-Time Light Field Reconstruction via Hierarchical Sparse Gradient Descent
Based on this insight, we introduce EffLiFe, a novel light field optimization method, which leverages the proposed Hierarchical Sparse Gradient Descent (HSGD) to produce high-quality light fields from sparse view images in real time.
Community Detection Graph Convolutional Network for Overlap-Aware Speaker Diarization
The CDGCN-based clustering method consists of graph generation, sub-graph detection, and Graph-based Overlapped Speech Detection (Graph-OSD).
A Survey of Multimodal Information Fusion for Smart Healthcare: Mapping the Journey from Data to Wisdom
The components of the comprehensive survey presented in this paper form the foundation for more successful implementation of multimodal fusion in smart healthcare.
AROID: Improving Adversarial Robustness Through Online Instance-Wise Data Augmentation
Deep neural networks are vulnerable to adversarial examples.
CRS-FL: Conditional Random Sampling for Communication-Efficient and Privacy-Preserving Federated Learning
Federated Learning (FL), a privacy-oriented distributed ML paradigm, is being gaining great interest in Internet of Things because of its capability to protect participants data privacy.
Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models
To dynamically fuse different cues, we further introduce a chain-of-thought method that prompts LLMs to generate reasonable weights for different visual cues.
Machine-learning-accelerated simulations to enable automatic surface reconstruction
Here, we present a bi-faceted computational loop to predict surface phase diagrams of multi-component materials that accelerates both the energy scoring and statistical sampling methods.
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models.
Improved Adversarial Training Through Adaptive Instance-wise Loss Smoothing
We find that during training an overall reduction of adversarial loss is achieved by sacrificing a considerable proportion of training samples to be more vulnerable to adversarial attack, which results in an uneven distribution of adversarial vulnerability among data.
Large AI Models in Health Informatics: Applications, Challenges, and the Future
Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions.
A Coarse-to-Fine Place Recognition Approach using Attention-guided Descriptors and Overlap Estimation
Place recognition is a challenging but crucial task in robotics.
A Comparative Study of Deep Learning and Iterative Algorithms for Joint Channel Estimation and Signal Detection in OFDM Systems
Joint channel estimation and signal detection (JCESD) is crucial in orthogonal frequency division multiplexing (OFDM) systems, but traditional algorithms perform poorly in low signal-to-noise ratio (SNR) scenarios.
A Unified BEV Model for Joint Learning of 3D Local Features and Overlap Estimation
For overlap detection, a cross-attention module is applied for interacting contextual information of input point clouds, followed by a classification head to estimate the overlapping region.
Data Augmentation Alone Can Improve Adversarial Training
Data augmentation, which is effective at preventing overfitting in standard training, has been observed by many previous works to be ineffective in mitigating overfitting in adversarial training.
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
The adoption of artificial intelligence (AI) in healthcare is growing rapidly.
Understanding and Combating Robust Overfitting via Input Loss Landscape Analysis and Regularization
Adversarial training is widely used to improve the robustness of deep neural networks to adversarial attack.
Graph Contrastive Learning for Materials
By leveraging a series of material-specific transformations, we introduce CrystalCLR, a framework for constrastive learning of representations with crystal graph neural networks.
Towards A Unified Conformer Structure: from ASR to ASV Task
Transformer has achieved extraordinary performance in Natural Language Processing and Computer Vision tasks thanks to its powerful self-attention mechanism, and its variant Conformer has become a state-of-the-art architecture in the field of Automatic Speech Recognition (ASR).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Antibody Representation Learning for Drug Discovery
Therapeutic antibody development has become an increasingly popular approach for drug development.
Spatial-aware Speaker Diarization for Multi-channel Multi-party Meeting
This paper describes a spatial-aware speaker diarization system for the multi-channel multi-party meeting.
Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation
To this end, we propose a novel model-agnostic Label Semantic Knowledge Distillation (LS-KD) for unbiased SGG.
NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation
To this end, we propose a novel NoIsy label CorrEction and Sample Training strategy for SGG: NICEST.
PanGu-Coder: Program Synthesis with Function-Level Language Modeling
We present PanGu-Coder, a pretrained decoder-only language model adopting the PanGu-Alpha architecture for text-to-code generation, i. e. the synthesis of programming language solutions given a natural language problem description.
Learning to Prove Trigonometric Identities
We define the normalized form of trigonometric identities, design a set of rules for the proof and put forward a method which can generate theoretically infinite trigonometric identities.
Hiding Your Signals: A Security Analysis of PPG-based Biometric Authentication
It reduces the success rate of rPPG spoofing attacks in user authentication to 0. 05.
Trichomonas Vaginalis Segmentation in Microscope Images
Trichomoniasis is a common infectious disease with high incidence caused by the parasite Trichomonas vaginalis, increasing the risk of getting HIV in humans if left untreated.
Towards Real-Time Visual Tracking with Graded Color-names Features
MeanShift algorithm has been widely used in tracking tasks because of its simplicity and efficiency.
The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generation
Then, in Pos-NSD, we use a clustering-based algorithm to divide all positive samples into multiple sets, and treat the samples in the noisiest set as noisy positive samples.
Deep Representation Decomposition for Rate-Invariant Speaker Verification
While promising performance for speaker verification has been achieved by deep speaker embeddings, the advantage would reduce in the case of speaking-style variability.
MealRec: A Meal Recommendation Dataset
A publicly available dataset specialising in meal recommendation research for the research community is in urgent demand.
Graph Convolutional Network Based Semi-Supervised Learning on Multi-Speaker Meeting Data
In this work, we present a GCN-based approach for semi-supervised learning.
Improving Cross-lingual Speech Synthesis with Triplet Training Scheme
Recent advances in cross-lingual text-to-speech (TTS) made it possible to synthesize speech in a language foreign to a monolingual speaker.
What is Next when Sequential Prediction Meets Implicitly Hard Interaction?
The experiences in the form of the unlikelihood of correct responses are drawn from each other by MED, which provides mutual exclusivity knowledge to figure out implicitly hard interactions.
Dual Space Graph Contrastive Learning
In addition, we conduct extensive experiments to analyze the impact of different graph encoders on DSGC, giving insights about how to better leverage the advantages of contrastive learning between different spaces.
Scalable Geometric Deep Learning on Molecular Graphs
Deep learning in molecular and materials sciences is limited by the lack of integration between applied science, artificial intelligence, and high-performance computing.
Adder Attention for Vision Transformer
With the new operation, vision transformers constructed using additions can also provide powerful feature representations.
Reinforcement Learning based Path Exploration for Sequential Explainable Recommendation
Recent advances in path-based explainable recommendation systems have attracted increasing attention thanks to the rich information provided by knowledge graphs.
Learning Text-Image Joint Embedding for Efficient Cross-Modal Retrieval with Deep Feature Engineering
This paper introduces a two-phase deep feature engineering framework for efficient learning of semantics enhanced joint embedding, which clearly separates the deep feature engineering in data preprocessing from training the text-image joint embedding model.
Visual-aware Attention Dual-stream Decoder for Video Captioning
Video captioning is a challenging task that captures different visual parts and describes them in sentences, for it requires visual and linguistic coherence.
DG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perception
The existing MOTS studies face two critical challenges: 1) the published datasets inadequately capture the real-world complexity for network training to address various driving settings; 2) the working pipeline annotation tool is under-studied in the literature to improve the quality of MOTS learning examples.
An Automated Portfolio Trading System with Feature Preprocessing and Recurrent Reinforcement Learning
We propose a novel portfolio trading system, which contains a feature preprocessing module and a trading module.
Financial Trading with Feature Preprocessing and Recurrent Reinforcement Learning
Financial trading aims to build profitable strategies to make wise investment decisions in the financial market.
Generate & Rank: A Multi-task Framework for Math Word Problems
Math word problem (MWP) is a challenging and critical task in natural language processing.
Ranked #3 on
Math Word Problem Solving
on Math23K
Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation
They utilize simple and fixed schemes, like neighborhood information aggregation or mathematical calculation of vectors, to fuse the embeddings of different user behaviors to obtain a unified embedding to represent a user's behavioral patterns which will be used in downstream recommendation tasks.
XMUSPEECH System for VoxCeleb Speaker Recognition Challenge 2021
This paper describes the XMUSPEECH speaker recognition and diarisation systems for the VoxCeleb Speaker Recognition Challenge 2021.
Instance-wise or Class-wise? A Tale of Neighbor Shapley for Concept-based Explanation
Deep neural networks have demonstrated remarkable performance in many data-driven and prediction-oriented applications, and sometimes even perform better than humans.
Approximation Properties of Deep ReLU CNNs
This paper focuses on establishing $L^2$ approximation properties for deep ReLU convolutional neural networks (CNNs) in two-dimensional space.
A Novel Dataset for Keypoint Detection of quadruped Animals from Images
In this paper, we studied the problem of localizing a generic set of keypoints across multiple quadruped or four-legged animal species from images.
DEXTER: Deep Encoding of External Knowledge for Named Entity Recognition in Virtual Assistants
Named entity recognition (NER) is usually developed and tested on text from well-written sources.
Learning Joint Embedding with Modality Alignments for Cross-Modal Retrieval of Recipes and Food Images
This paper presents a three-tier modality alignment approach to learning text-image joint embedding, coined as JEMA, for cross-modal retrieval of cooking recipes and food images.
Efficient Deep Feature Calibration for Cross-Modal Joint Embedding Learning
This paper introduces a two-phase deep feature calibration framework for efficient learning of semantics enhanced text-image cross-modal joint embedding, which clearly separates the deep feature calibration in data preprocessing from training the joint embedding model.
Learning TFIDF Enhanced Joint Embedding for Recipe-Image Cross-Modal Retrieval Service
We present a Multi-modal Semantics enhanced Joint Embedding approach (MSJE) for learning a common feature space between the two modalities (text and image), with the ultimate goal of providing high-performance cross-modal retrieval services.
OLR 2021 Challenge: Datasets, Rules and Baselines
In addition to the Language Identification (LID) tasks, multilingual Automatic Speech Recognition (ASR) tasks are introduced to OLR 2021 Challenge for the first time.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Oriental Language Recognition (OLR) 2020: Summary and Analysis
The fifth Oriental Language Recognition (OLR) Challenge focuses on language recognition in a variety of complex environments to promote its development.
SSC: Semantic Scan Context for Large-Scale Place Recognition
We also present a two-step global semantic ICP to obtain the 3D pose (x, y, yaw) used to align the point cloud to improve matching performance.
Ranked #1 on
Visual Place Recognition
on KITTI
An Integrated Framework for Two-pass Personalized Voice Trigger
For the SV system, we proposed a multi-task learning network, where phonetic branch is trained with the character label of the utterance, and speaker branch is trained with the label of the speaker.
Phoneme-aware and Channel-wise Attentive Learning for Text DependentSpeaker Verification
This paper proposes a multi-task learning network with phoneme-aware and channel-wise attentive learning strategies for text-dependent Speaker Verification (SV).
SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure
LiDAR-based SLAM system is admittedly more accurate and stable than others, while its loop closure detection is still an open issue.
DMBGN: Deep Multi-Behavior Graph Networks for Voucher Redemption Rate Prediction
In this paper, we propose a Deep Multi-behavior Graph Networks (DMBGN) to shed light on this field for the voucher redemption rate prediction.
CREAD: Combined Resolution of Ellipses and Anaphora in Dialogues
In this work, we propose a novel joint learning framework of modeling coreference resolution and query rewriting for complex, multi-turn dialogue understanding.
Evaluation of Transportation Systems and Novel UV-Oriented Solution for Integration, Resilience, Inclusiveness and Sustainability
ransportation systems have revolutionized the form of society.
ReLU Deep Neural Networks from the Hierarchical Basis Perspective
We study ReLU deep neural networks (DNNs) by investigating their connections with the hierarchical basis method in finite element methods.
Compacting Deep Neural Networks for Internet of Things: Methods and Applications
Deep Neural Networks (DNNs) have shown great success in completing complex tasks.
Measurement methods of radial flow in relativistic heavy-ion collisions
Radial flow can be directly extracted from the azimuthal distribution of mean transverse rapidity.
Nuclear Theory High Energy Physics - Phenomenology Nuclear Experiment
CFNS Ad-Hoc meeting on Radiative Corrections Whitepaper
Current precision scattering experiments and even more so many experiments planed for the Electron Ion Collider will be limited by systematics.
Nuclear Theory
Manifold Learning-based Word Representation Refinement Incorporating Global and Local Information
Our second method refines word representations by aligning original and re-fined embedding spaces based on local tangent space instead of performing weighted locally linear combination twice.
Conversational Semantic Parsing for Dialog State Tracking
We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog.
Direct Signal Separation Via Extraction of Local Frequencies with Adaptive Time-Varying Parameters
In this paper, we propose an adaptive signal separation operation (ASSO) for effective and accurate separation of a single-channel blind-source multi-component signal, via introducing a time-varying parameter that adapts locally to IFs and using linear chirp (linear frequency modulation) signals to approximate components at each time instant.
A Chirplet Transform-based Mode Retrieval Method for Multicomponent Signals with Crossover Instantaneous Frequencies
We use the chirplet transform (CT) to represent a multicomponent signal in the three-dimensional space of time, frequency and chirp rate and introduce a CT-based signal separation scheme (CT3S) to retrieve modes.
Analysis of Adaptive Synchrosqueezing Transform with a Time-varying Parameter
The WSST with a time-varying parameter, called the adaptive WSST, was introduced very recently in the paper "Adaptive synchrosqueezing transform with a time-varying parameter for non-stationary signal separation".
Complementing Representation Deficiency in Few-shot Image Classification: A Meta-Learning Approach
As a result, a meta-learner cannot be trained well in a high-dimensional parameter space to generalize to new tasks.
Ranked #18 on
Few-Shot Image Classification
on FC100 5-way (5-shot)
AP20-OLR Challenge: Three Tasks and Their Baselines
Based on Kaldi and Pytorch, recipes for i-vector and x-vector systems are also conducted as baselines for the three tasks.
Noise Robust Named Entity Understanding for Voice Assistants
Named Entity Recognition (NER) and Entity Linking (EL) play an essential role in voice assistant interaction, but are challenging due to the special difficulties associated with spoken user queries.
Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT
Materials and Methods In this retrospective and multi-center study, a deep learning model, COVID-19 detection neural network (COVNet), was developed to extract visual features from volumetric chest CT exams for the detection of COVID-19.
A BERT based Sentiment Analysis and Key Entity Detection Approach for Online Financial Texts
Aiming at the issue, we propose a sentiment analysis and key entity detection approach based on BERT, which is applied in online financial text mining and public opinion analysis in social media.
Deep Visual Waterline Detection within Inland Marine Environment
This paper attempts to find a solution to guarantee the effectiveness of waterline detection for inland maritime applications with general digital camera sensor.
When is ACL's Deadline? A Scientific Conversational Agent
Our conversational agent UKP-ATHENA assists NLP researchers in finding and exploring scientific literature, identifying relevant authors, planning or post-processing conference visits, and preparing paper submissions using a unified interface based on natural language inputs and responses.
Choosing between Long and Short Word Forms in Mandarin
Between 80{\%} and 90{\%} of all Chinese words have long and short form such as 老虎/虎 (lao-hu/hu , tiger) (Duanmu:2013).
Leveraging User Engagement Signals For Entity Labeling in a Virtual Assistant
Personal assistant AI systems such as Siri, Cortana, and Alexa have become widely used as a means to accomplish tasks through natural language commands.
Social Influence-based Attentive Mavens Mining and Aggregative Representation Learning for Group Recommendation
To tackle the issue of preference aggregation for group recommendation, we propose a novel attentive aggregation representation learning method based on sociological theory for group recommendation, namely SIAGR (short for "Social Influence-based Attentive Group Recommendation"), which takes attention mechanisms and the popular method (BERT) as the aggregation representation for group profile modeling.
An Item Recommendation Approach by Fusing Images based on Neural Networks
There are rich formats of information in the network, such as rating, text, image, and so on, which represent different aspects of user preferences.
Combining Q&A Pair Quality and Question Relevance Features on Community-based Question Retrieval
The Q&A community has become an important way for people to access knowledge and information from the Internet.
Deep neural network-based classification model for Sentiment Analysis
Based on the Bi-LSTM model, the classification model of word-level attention mechanism is studied.
Using Context Information to Enhance Simple Question Answering
With the rapid development of knowledge bases(KBs), question answering(QA)based on KBs has become a hot research issue.
The combination of context information to enhance simple question answering
With the rapid development of knowledge base, question answering based on knowledge base has been a hot research issue.
Image-to-Video Person Re-Identification by Reusing Cross-modal Embeddings
In this paper, we propose an end-to-end neural network framework for image-to-video person reidentification by leveraging cross-modal embeddings learned from extra information. Concretely speaking, cross-modal embeddings from image captioning and video captioning models are reused to help learned features be projected into a coordinated space, where similarity can be directly computed.
GPU based Parallel Optimization for Real Time Panoramic Video Stitching
In order to solve these problems, we propose a real-time panoramic video stitching framework. The framework we propose mainly consists of three algorithms, LORB image feature extraction algorithm, feature point matching algorithm based on LSH and GPU parallel video stitching algorithm based on CUDA. The experiment results show that the algorithm mentioned can improve the performance in the stages of feature extraction of images stitching and matching, the running speed of which is 11 times than that of the traditional ORB algorithm and 639 times than that of the traditional SIFT algorithm.
Relational Network for Skeleton-Based Action Recognition
We introduce the Recurrent Relational Network to learn the spatial features in a single skeleton, followed by a multi-layer LSTM to learn the temporal features in the skeleton sequences.
Ranked #110 on
Skeleton Based Action Recognition
on NTU RGB+D
Modeling Group Dynamics Using Probabilistic Tensor Decompositions
We propose a probabilistic modeling framework for learning the dynamic patterns in the collective behaviors of social agents and developing profiles for different behavioral groups, using data collected from multiple information sources.
Saliency Detection with Spaces of Background-based Distribution
In this letter, an effective image saliency detection method is proposed by constructing some novel spaces to model the background and redefine the distance of the salient patches away from the background.
Sensing Subjective Well-being from Social Media
Nowadays, people are motivated to share their experiences and feelings on social media, so we propose to sense SWB from the vast user generated data on social media.
