Search Results for author:
Found 174 papers, 69 papers with code
Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation
End-to-end simultaneous speech-to-text translation aims to directly perform translation from streaming source speech to target text with high translation quality and low latency.
\textrm{DuReader}_{\textrm{vis}}: A Chinese Dataset for Open-domain Document Visual Question Answering
Open-domain question answering has been used in a wide range of applications, such as web search and enterprise search, which usually takes clean texts extracted from various formats of documents (e. g., web pages, PDFs, or Word documents) as the information source.
SgSum:Transforming Multi-document Summarization into Sub-graph Selection
Comparing with traditional methods, our method has two main advantages: (1) the relations between sentences are captured by modeling both the graph structure of the whole document set and the candidate sub-graphs; (2) directly outputs an integrate summary in the form of sub-graph which is more informative and coherent.
Findings of the Third Workshop on Automatic Simultaneous Translation
This paper reports the results of the shared task we hosted on the Third Workshop of Automatic Simultaneous Translation (AutoSimTrans).
PLATO-KAG: Unsupervised Knowledge-Grounded Conversation via Joint Modeling
Large-scale conversation models are turning to leveraging external knowledge to improve the factual accuracy in response generation.
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset
This paper describes in detail the construction process and data statistics of DuSQL.
Learning Adaptive Segmentation Policy for Simultaneous Translation
The policy learns to segment the source text by considering possible translations produced by the translation model, maintaining consistency between the segmentation and translation.
Findings of the Second Workshop on Automatic Simultaneous Translation
This paper presents the results of the shared task of the 2nd Workshop on Automatic Simultaneous Translation (AutoSimTrans).
Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking
Large language models (LLMs) face inherent performance bottlenecks under parameter constraints, particularly in processing critical tokens that demand complex reasoning.
BeamLoRA: Beam-Constraint Low-Rank Adaptation
Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods.
OmniRL: In-Context Reinforcement Learning by Large-Scale Meta-Training in Randomized Worlds
We introduce OmniRL, a highly generalizable in-context reinforcement learning (ICRL) model that is meta-trained on hundreds of thousands of diverse tasks.
Curiosity-Driven Reinforcement Learning from Human Feedback
Reinforcement learning from human feedback (RLHF) has proven effective in aligning large language models (LLMs) with human preferences, but often at the cost of reduced output diversity.
K-space Diffusion Model Based MR Reconstruction Method for Simultaneous Multislice Imaging
Simultaneous Multi-Slice(SMS) is a magnetic resonance imaging (MRI) technique which excites several slices concurrently using multiband radiofrequency pulses to reduce scanning time.
Mixture of Hidden-Dimensions Transformer
MOHD offers a new perspective for scaling the model, showcasing the potential of hidden dimension sparsity to boost efficiency
MONOPOLY: Learning to Price Public Facilities for Revaluing Private Properties with Large-Scale Urban Data
We have conducted extensive experiments with the large-scale urban data of several metropolises in China.
DuMapper: Towards Automatic Verification of Large-Scale POIs with Street Views at Baidu Maps
With the increased popularity of mobile devices, Web mapping services have become an indispensable tool in our daily lives.
Quantum Neural Network for Accelerated Magnetic Resonance Imaging
Magnetic resonance image reconstruction starting from undersampled k-space data requires the recovery of many potential nonlinear features, which is very difficult for algorithms to recover these features.
Optimized Magnetic Resonance Fingerprinting Using Ziv-Zakai Bound
Sequence optimization is crucial for improving the accuracy and efficiency of MRF.
FlashMask: Efficient and Rich Mask Extension of FlashAttention
In this paper, we propose FlashMask, an extension of FlashAttention that introduces a column-wise sparse representation of attention masks.
MoistNet: Machine Vision-based Deep Learning Models for Wood Chip Moisture Content Measurement
This study explores the use of deep learning and machine vision to predict moisture content classes from RGB images of wood chips.
Activation Function Optimization Scheme for Image Classification
Finally, we statistically investigate the generalization of the resultant activation functions developed through the optimization scheme.
HGAMN: Heterogeneous Graph Attention Matching Network for Multilingual POI Retrieval at Baidu Maps
To mitigate challenge \#2, we construct edges between POI and query nodes based on the co-occurrences between queries and POIs, where queries in different languages and formulations can be aggregated for individual POIs.
Pediatric TSC-Related Epilepsy Classification from Clinical MR Images Using Quantum Neural Network
Tuberous sclerosis complex (TSC) manifests as a multisystem disorder with significant neurological implications.
Joint PET-MRI Reconstruction with Diffusion Stochastic Differential Model
In this study, PET is generated from MRI by learning joint probability distribution as the relationship.
MR Optimized Reconstruction of Simultaneous Multi-Slice Imaging Using Diffusion Model
Diffusion model has been successfully applied to MRI reconstruction, including single and multi-coil acquisition of MRI data.
A review on vision-based motion estimation
In addition to the development of each branch of vision-based motion measurement methods, this paper also discussed the advantages and disadvantages of existing methods.
Exploring the Causality of End-to-End Autonomous Driving
Deep learning-based models are widely deployed in autonomous driving areas, especially the increasingly noticed end-to-end solutions.
BEVWorld: A Multimodal World Model for Autonomous Driving via Unified BEV Latent Space
The world model consists of two parts: the multi-modal tokenizer and the latent BEV sequence diffusion model.
Efficient Surgical Tool Recognition via HMM-Stabilized Deep Learning
Recognizing various surgical tools, actions and phases from surgery videos is an important problem in computer vision with exciting clinical applications.
BASES: Large-scale Web Search User Simulation with Large Language Model based Agents
Due to the excellent capacities of large language models (LLMs), it becomes feasible to develop LLM-based agents for reliable user simulation.
Towards Boosting Many-to-Many Multilingual Machine Translation with Large Language Models
The training paradigm for machine translation has gradually shifted, from learning neural machine translation (NMT) models with extensive parallel corpora to instruction finetuning on multilingual large language models (LLMs) with high-quality translation pairs.
Joint Diffusion: Mutual Consistency-Driven Diffusion Model for PET-MRI Co-Reconstruction
The complementary information can contribute to image reconstruction.
A Two-Stage Generative Model with CycleGAN and Joint Diffusion for MRI-based Brain Tumor Detection
However, current supervised learning methods require extensively annotated images and the state-of-the-art generative models used in unsupervised methods often have limitations in covering the whole data distribution.
Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imaging
Long scan time significantly hinders the widespread applications of three-dimensional multi-contrast cardiac magnetic resonance (3D-MC-CMR) imaging.
GLS-CSC: A Simple but Effective Strategy to Mitigate Chinese STM Models' Over-Reliance on Superficial Clue
To address this issue, it is crucial to analyze and mitigate the influence of superficial clues on STM models.
Physics-Informed DeepMRI: Bridging the Gap from Heat Diffusion to k-Space Interpolation
In order to enhance interpretability and overcome the acceleration limitations, this paper introduces an interpretable framework that unifies both $k$-space interpolation techniques and image-domain methods, grounded in the physical principles of heat diffusion equations.
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation
Consistency regularization methods, such as R-Drop (Liang et al., 2021) and CrossConST (Gao et al., 2023), have achieved impressive supervised and zero-shot performance in the neural machine translation (NMT) field.
Dual Meta-Learning with Longitudinally Generalized Regularization for One-Shot Brain Tissue Segmentation Across the Human Lifespan
However, segmentation on longitudinal data is challenging due to dynamic brain changes across the lifespan.
Dynamic Dual-Graph Fusion Convolutional Network For Alzheimer's Disease Diagnosis
In this paper, a dynamic dual-graph fusion convolutional network is proposed to improve Alzheimer's disease (AD) diagnosis performance.
Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation
In this study, we present the first analysis on the factual knowledge boundaries of LLMs and how retrieval augmentation affects LLMs on open-domain question answering (QA), with a bunch of important findings.
Learning Multilingual Sentence Representations with Cross-lingual Consistency Regularization
Multilingual sentence representations are the foundation for similarity-based bitext mining, which is crucial for scaling multilingual neural machine translation (NMT) system to more languages.
TOME: A Two-stage Approach for Model-based Retrieval
Recently, model-based retrieval has emerged as a new paradigm in text retrieval that discards the index in the traditional retrieval model and instead memorizes the candidate corpora using model parameters.
Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularization
The experimental analysis also proves that CrossConST could close the sentence representation gap and better align the representation space.
Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model
JPD of MRI and noise-added PET was learned in the diffusion process.
Meta-Learning Enabled Score-Based Generative Model for 1.5T-Like Image Reconstruction from 0.5T MRI
We theoretically uncovered that the combination of these challenges renders conventional deep learning methods that directly learn the mapping from a low-field MR image to a high-field MR image unsuitable.
Dual Meta-Learning with Longitudinally Consistent Regularization for One-Shot Brain Tissue Segmentation Across the Human Lifespan
However, segmentation on longitudinal data is challenging due to dynamic brain changes across the lifespan.
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation
Recent cross-lingual cross-modal works attempt to extend Vision-Language Pre-training (VLP) models to non-English inputs and achieve impressive performance.
Ranked #1 on
Multimodal Machine Translation
on Multi30K
CLOP: Video-and-Language Pre-Training with Knowledge Regularizations
To this end, we propose a Cross-modaL knOwledge-enhanced Pre-training (CLOP) method with Knowledge Regularizations.
PLATO-K: Internal and External Knowledge Enhanced Dialogue Generation
Recently, the practical deployment of open-domain dialogue systems has been plagued by the knowledge issue of information deficiency and factual inaccuracy.
ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts
Recent progress in diffusion models has revolutionized the popular technology of text-to-image generation.
Ranked #12 on
Text-to-Image Generation
on MS COCO
A Novel Adaptive Causal Sampling Method for Physics-Informed Neural Networks
We point out that it is not sufficient to only consider the residual loss in adaptive sampling and sampling should obey temporal causality.
Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards
Derivative-free prompt learning has emerged as a lightweight alternative to prompt tuning, which only requires model inference to optimize the prompts.
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding
Recent years have witnessed the rise and success of pre-training techniques in visually-rich document understanding.
Ranked #2 on
Semantic entity labeling
on FUNSD
ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training
They attempt to learn cross-modal representation using contrastive learning on image-text pairs, however, the built inter-modal correlations only rely on a single view for each modality.
Ranked #1 on
Image Retrieval
on AIC-ICC
Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction
Recently, score-based diffusion models have shown satisfactory performance in MRI reconstruction.
Towards Boosting the Open-Domain Chatbot with Human Feedback
Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users.
DuETA: Traffic Congestion Propagation Pattern Modeling via Efficient Graph Learning for ETA Prediction at Baidu Maps
In this work, we focus on modeling traffic congestion propagation patterns to improve ETA performance.
K-UNN: k-Space Interpolation With Untrained Neural Network
Recently, untrained neural networks (UNNs) have shown satisfactory performances for MR image reconstruction on random sampling trajectories without using additional full-sampled training data.
Accelerating Magnetic Resonance T1\r{ho} Mapping Using Simultaneously Spatial Patch-based and Parametric Group-based Low-rank Tensors (SMART)
Prospective reconstruction results further demonstrate the capability of the SMART method in accelerating MR T1\r{ho} imaging.
Link the World: Improving Open-domain Conversation with Dynamic Spatiotemporal-aware Knowledge
Making chatbots world aware in a conversation like a human is a crucial challenge, where the world may contain dynamic knowledge and spatiotemporal state.
Evolutionary Game-Theoretical Analysis for General Multiplayer Asymmetric Games
First, there is inaccuracy when analysing the simplified payoff table.
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation
We introduce Bi-SimCut: a simple but effective training strategy to boost neural machine translation (NMT) performance.
Ranked #1 on
Machine Translation
on WMT2014 German-English
Less Learn Shortcut: Analyzing and Mitigating Learning of Spurious Feature-Label Correlation
In this study, we focus on the spurious correlation between word features and labels that models learn from the biased data distribution of training data.
A Fine-grained Interpretability Evaluation Benchmark for Neural NLP
Based on this benchmark, we conduct experiments on three typical models with three saliency methods, and unveil their strengths and weakness in terms of interpretability.
ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval
Our method 1) introduces a self on-the-fly distillation method that can effectively distill late interaction (i. e., ColBERT) to vanilla dual-encoder, and 2) incorporates a cascade distillation process to further improve the performance with a cross-encoder teacher.
HelixADMET: a robust and endpoint extensible ADMET system incorporating self-supervised knowledge transfer
Additionally, the pre-trained model provided by H-ADMET can be fine-tuned to generate new and customised ADMET endpoints, meeting various demands of drug research and development requirements.
A Thorough Examination on Zero-shot Dense Retrieval
Recent years have witnessed the significant advance in dense retrieval (DR) based on powerful pre-trained language models (PLM).
Towards Multi-Turn Empathetic Dialogs with Positive Emotion Elicitation
In this task, the agent conducts empathetic responses along with the target of eliciting the user's positive emotions in the multi-turn dialog.
Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals
For example, users have determined the departure, the destination, and the travel time for booking a flight.
Multi-Weight Respecification of Scan-specific Learning for Parallel Imaging
Parallel imaging is widely used in magnetic resonance imaging as an acceleration technology.
ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention
We argue that two factors, information bottleneck sensitivity and inconsistency between different attention topologies, could affect the performance of the Sparse Transformer.
DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine
In this paper, we present DuReader_retrieval, a large-scale Chinese dataset for passage retrieval.
ERNIE-GeoL: A Geography-and-Language Pre-trained Model and its Applications in Baidu Maps
One of the main reasons for this plateau is the lack of readily available geographic knowledge in generic PTMs.
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning
In particular, we propose to conduct grounded learning on both images and texts via a sharing grounded space, which helps bridge unaligned images and texts, and align the visual and textual semantic spaces on different types of corpora.
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
Most of the open-domain dialogue models tend to perform poorly in the setting of long-term human-bot conversations.
Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion
Experimental results show that the matching of sentence similarity calculation method based on multi model nonlinear fusion is 84%, and the F1 value of the model is 75%.
Rice Diseases Detection and Classification Using Attention Based Neural Network and Bayesian Optimization
In this research, an attention-based depthwise separable neural network with Bayesian optimization (ADSNN-BO) is proposed to detect and classify rice disease from rice leaf images.
A Gradient Mapping Guided Explainable Deep Neural Network for Extracapsular Extension Identification in 3D Head and Neck Cancer Computed Tomography Images
However, manual annotation of lymph node region is a required data preprocessing step in most of the current ML-based ECE diagnosis studies.
ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation
To explore the landscape of large-scale pre-training for bidirectional text-image generation, we train a 10-billion parameter ERNIE-ViLG model on a large-scale dataset of 145 million (Chinese) image-text pairs which achieves state-of-the-art performance for both text-to-image and image-to-text tasks, obtaining an FID of 7. 9 on MS-COCO for text-to-image synthesis and best results on COCO-CN and AIC-ICC for image captioning.
Ranked #41 on
Text-to-Image Generation
on MS COCO
TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversations
Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations.
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
A unified framework named ERNIE 3. 0 was recently proposed for pre-training large-scale knowledge enhanced models and trained a model with 10 billion parameters.
Equilibrated Zeroth-Order Unrolled Deep Networks for Accelerated MRI
Specifically, focusing on accelerated MRI, we unroll a zeroth-order algorithm, of which the network module represents the regularizer itself, so that the network output can be still covered by the regularization model.
DuQM: A Chinese Dataset of Linguistically Perturbed Natural Questions for Evaluating the Robustness of Question Matching Models
For this purpose, we create a Chinese dataset namely DuQM which contains natural questions with linguistic perturbations to evaluate the robustness of question matching models.
End-to-end Adaptive Distributed Training on PaddlePaddle
The experiments demonstrate that our framework can satisfy various requirements from the diversity of applications and the heterogeneity of resources with highly competitive performance.
Highly accelerated MR parametric mapping by undersampling the k-space and reducing the contrast number simultaneously with deep learning
Methods: The proposed framework consists of a reconstruction module and a generative module.
Docking-based Virtual Screening with Multi-Task Learning
Machine learning shows great potential in virtual screening for drug discovery.
SgSum: Transforming Multi-document Summarization into Sub-graph Selection
Comparing with traditional methods, our method has two main advantages: (1) the relations between sentences are captured by modeling both the graph structure of the whole document set and the candidate sub-graphs; (2) directly outputs an integrate summary in the form of sub-graph which is more informative and coherent.
Building Chinese Biomedical Language Models via Multi-Level Text Discrimination
In this work we introduce eHealth, a Chinese biomedical PLM built from scratch with a new pre-training framework.
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
In this paper, we propose a novel joint training approach for dense passage retrieval and passage re-ranking.
ERNIE-SPARSE: Robust Efficient Transformer Through Hierarchically Unifying Isolated Information
The first factor is information bottleneck sensitivity, which is caused by the key feature of Sparse Transformer — only a small number of global tokens can attend to all other tokens.
Do What Nature Did To Us: Evolving Plastic Recurrent Neural Networks For Generalized Tasks
While artificial neural networks (ANNs) have been widely adopted in machine learning, researchers are increasingly obsessed by the gaps between ANNs and natural neural networks (NNNs).
Self-Supervised Learning for MRI Reconstruction with a Parallel Network Training Framework
Specifically, during model optimization, two subsets are constructed by randomly selecting part of k-space data from the undersampled data and then fed into two parallel reconstruction networks to perform information recovery.
PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation
To explore the limit of dialogue generation pre-training, we present the models of PLATO-XL with up to 11 billion parameters, trained on both Chinese and English social media conversations.
DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendation
In this paper, we provide a bilingual parallel human-to-human recommendation dialog dataset (DuRecDial 2. 0) to enable researchers to explore a challenging task of multilingual and cross-lingual conversational recommendation.
Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning
In contrast, biological neural networks (BNNs) can adapt to various new tasks by continually updating the neural connections based on the inputs, which is aligned with the paradigm of learning effective learning rules in addition to static parameters, e. g., meta-learning.
Mixup Decoding for Diverse Machine Translation
To further improve the faithfulness and diversity of the translations, we propose two simple but effective approaches to select diverse sentence pairs in the training corpus and adjust the interpolation weight for each pair correspondingly.
DuTrust: A Sentiment Analysis Dataset for Trustworthiness Evaluation
Therefore, in order to systematically evaluate the factors for building trustworthy systems, we propose a novel and well-annotated sentiment analysis dataset to evaluate robustness and interpretability.
GEDIT: Geographic-Enhanced and Dependency-Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps
We approach this task as a sequence tagging problem, where the goal is to produce <POI name, accessibility label> pairs from unstructured text.
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval
Recently, dense passage retrieval has become a mainstream approach to finding relevant information in various natural language processing tasks.
DuReader\_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications
Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements.
Discovering Dialog Structure Graph for Coherent Dialog Generation
Learning discrete dialog structure graph from human-human dialogs yields basic insights into the structure of conversation, and also provides background knowledge to facilitate dialog generation.
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
We trained the model with 10 billion parameters on a 4TB corpus consisting of plain texts and a large-scale knowledge graph.
ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Prediction
Recent advances in graph neural networks (GNNs) have shown great promise in applying GNNs for molecular representation learning.
Ranked #2 on
Molecular Property Prediction
on QM9
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression
Specifically, the first stage, General Distillation, performs distillation with guidance from pretrained teacher, gerenal data and latent distillation loss.
BASS: Boosting Abstractive Summarization with Unified Semantic Graph
Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text.
Link Prediction on N-ary Relational Facts: A Graph-based Approach
The key to our approach is to represent the n-ary structure of a fact as a small heterogeneous graph, and model this graph with edge-biased fully-connected attention.
A Unified Pre-training Framework for Conversational AI
In this work, we explore the application of PLATO-2 on various dialogue systems, including open-domain conversation, knowledge grounded dialogue, and task-oriented conversation.
BSTC: A Large-Scale Chinese-English Speech Translation Dataset
This corpus is expected to promote the research of automatic simultaneous translation as well as the development of practical systems.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Deep Manifold Learning for Dynamic MR Imaging
The nonlinear manifold is designed to characterize the temporal correlation of dynamic signals.
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing
For better distribution matching, we require that at least 80% of SQL patterns in the training data are covered by generated queries.
Learning to Select External Knowledge with Multi-Scale Negative Sampling
The Track-1 of DSTC9 aims to effectively answer user requests or questions during task-oriented dialogues, which are out of the scope of APIs/DB.
Knowledge Distillation based Ensemble Learning for Neural Machine Translation
Under this framework, we introduce word-level ensemble learning and sequence-level ensemble learning for neural machine translation, where sequence-level ensemble learning is capable of aggregating translation models with different decoding strategies.
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora
In this paper, we propose ERNIE-M, a new training method that encourages the model to align the representation of multiple languages with monolingual corpora, to overcome the constraint that the parallel corpus size places on the model performance.
Ranked #14 on
Zero-Shot Cross-Lingual Transfer
on XTREME
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer
Transformers are not suited for processing long documents, due to their quadratically increasing memory and time consumption.
Ranked #1000000000 on
Text Classification
on IMDb
Discovering Dialog Structure Graph for Open-Domain Dialog Generation
Learning interpretable dialog structure from human-human dialogs yields basic insights into the structure of conversation, and also provides background knowledge to facilitate dialog generation.
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning
Existed pre-training methods either focus on single-modal tasks or multi-modal tasks, and cannot effectively adapt to each other.
Ranked #4 on
Image Captioning
on MS COCO
Peer Offloading with Delayed Feedback in Fog Networks
Besides, peer competition occurs when different FNs offload tasks to one FN at the same time.
Federated learning with class imbalance reduction
Based on the scheme, a device selection algorithm towards minimal class imbalance is proposed, thus can improve the convergence performance of the global model.
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
We argue that such contiguously masking method neglects to model the intra-dependencies and inter-relation of coarse-grained linguistic information.
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering
In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers.
Ranked #4 on
Passage Retrieval
on Natural Questions
Conversational Graph Grounded Policy Learning for Open-Domain Conversation Generation
To address the challenge of policy learning in open-domain multi-turn conversation, we propose to represent prior information about dialog transitions as a graph and learn a graph grounded dialog policy, aimed at fostering a more coherent and controllable dialog.
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning
To build a high-quality open-domain chatbot, we introduce the effective training process of PLATO-2 via curriculum learning.
ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graph
Thus, ERNIE-ViL can learn the joint representations characterizing the alignments of the detailed semantics across vision and language.
Ranked #2 on
Visual Question Answering (VQA)
on VCR (QA-R) test
Deep Low-rank Prior in Dynamic MR Imaging
The deep learning methods have achieved attractive performance in dynamic MR cine imaging.
Leveraging Graph to Improve Abstractive Multi-Document Summarization
Graphs that capture relations between textual units have great benefits for detecting salient information from multiple documents and generating overall coherent summaries.
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis
In particular, the prediction of aspect-sentiment pairs is converted into multi-label classification, aiming to capture the dependency between words in a pair.
Ranked #14 on
Stock Market Prediction
on Astock
Towards Conversational Recommendation over Multi-Type Dialogs
We propose a new task of conversational recommendation over multi-type dialogs, where the bots can proactively and naturally lead a conversation from a non-recommendation dialog (e. g., QA) to a recommendation dialog, taking into account user's interests and feedback.
Quantifying the Economic Impact of COVID-19 in Mainland China Using Human Mobility Data
While these strategies have effectively dealt with the critical situations of outbreaks, the combination of the pandemic and mobility controls has slowed China's economic growth, resulting in the first quarterly decline of Gross Domestic Product (GDP) since GDP began to be calculated, in 1992.
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications
Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements.
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation
Current pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks.
Ranked #1 on
Question Generation
on SQuAD1.1
(using extra training data)
Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding
Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
CoKE: Contextualized Knowledge Graph Embedding
This work presents Contextualized Knowledge Graph Embedding (CoKE), a novel paradigm that takes into account such contextual nature, and learns dynamic, flexible, and fully contextualized entity and relation embeddings.
D-NET: A Pre-Training and Fine-Tuning Framework for Improving the Generalization of Machine Reading Comprehension
In this paper, we introduce a simple system Baidu submitted for MRQA (Machine Reading for Question Answering) 2019 Shared Task that focused on generalization of machine reading comprehension (MRC) models.
PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable
Pre-training models have been proved effective for a wide range of natural language processing tasks.
Multi-agent Learning for Neural Machine Translation
Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e. g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite direction.
Model Learning: Primal Dual Networks for Fast MR imaging
Experi-ments on in vivo MR data demonstrate that the proposed method achieves supe-rior MR reconstructions from highly undersampled k-space data over other state-of-the-art image reconstruction methods.
Baidu Neural Machine Translation Systems for WMT19
In this paper we introduce the systems Baidu submitted for the WMT19 shared task on Chinese{\textless}-{\textgreater}English news translation.
DuTongChuan: Context-aware Translation Model for Simultaneous Interpreting
In this paper, we present DuTongChuan, a novel context-aware translation model for simultaneous interpreting.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding
Recently, pre-trained models have achieved state-of-the-art results in various language understanding tasks, which indicates that pre-training on large-scale corpora may play a crucial role in natural language processing.
Ranked #1 on
Chinese Sentence Pair Classification
on LCQMC Dev
Chinese Named Entity Recognition
Chinese Reading Comprehension
+8
Joint extraction of entities and overlapping relations using position-attentive sequence labeling
Joint entity and relation extraction is to detect entity and relation using a single model.
Ranked #2 on
Relation Extraction
on NYT-single
Proactive Human-Machine Conversation with Explicit Conversation Goal
Konv enables a very challenging task as the model needs to both understand dialogue and plan over the given knowledge graph.
Model-based Deep Medical Imaging: the roadmap of generalizing iterative reconstruction model using deep learning
Usually, acquiring less data is a direct but important strategy to address these issues.
Proactive Human-Machine Conversation with Explicit Conversation Goals
DuConv enables a very challenging task as the model needs to both understand dialogue and plan over the given knowledge graph.
End-to-End Speech Translation with Knowledge Distillation
End-to-end speech translation (ST), which directly translates from source language speech into target language text, has attracted intensive attentions in recent years.
Knowledge Aware Conversation Generation with Explainable Reasoning over Augmented Graphs
Two types of knowledge, triples from knowledge graphs and texts from documents, have been studied for knowledge aware open-domain conversation generation, in which graph paths can narrow down vertex candidates for knowledge selection decision, and texts can provide rich information for response generation.
Utilizing Imbalanced Data and Classification Cost Matrix to Predict Movie Preferences
The proposed movie genre recommendation system solves problems such as small dataset, imbalanced response, and unequal classification costs.
Modeling Coherence for Discourse Neural Machine Translation
Discourse coherence plays an important role in the translation of one text.
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework
Simultaneous translation, which translates sentences before they are finished, is useful in many scenarios but is notoriously difficult due to word-order differences.
Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification
Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine.
Ranked #3 on
Question Answering
on MS MARCO
DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applications
Experiments show that human performance is well above current state-of-the-art baseline systems, leaving plenty of room for the community to make improvements.
Multi-task Attention-based Neural Networks for Implicit Discourse Relationship Representation and Identification
We present a novel multi-task attention based neural network model to address implicit discourse relationship representation and identification through two types of representation learning, an attention based neural network for learning discourse relationship representation with two arguments and a multi-task framework for learning knowledge from annotated and unannotated corpora.
A Unified Architecture for Semantic Role Labeling and Relation Classification
This paper describes a unified neural architecture for identifying and classifying multi-typed semantic relations between words in a sentence.
A Universal Framework for Inductive Transfer Parsing across Multi-typed Treebanks
Various treebanks have been released for dependency parsing.
Chinese Poetry Generation with Planning based Neural Network
Chinese poetry generation is a very challenging task in natural language processing.
Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning
Various treebanks have been released for dependency parsing.
A Representation Learning Framework for Multi-Source Transfer Parsing
Cross-lingual model transfer has been a promising approach for inducing dependency parsers for low-resource languages where annotated treebanks are not available.
Cross-lingual zero-shot dependency parsing
Representation Learning
