Search Results for author:
Found 206 papers, 100 papers with code
Rethinking Denoised Auto-Encoding in Language Pre-Training
Pre-trained self-supervised models such as BERT have achieved striking success in learning sequence representations, especially for natural language processing.
Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation
In this paper, we propose to leverage word-formation knowledge to enhance Chinese WSD.
Translation as Cross-Domain Knowledge: Attention Augmentation for Unsupervised Cross-Domain Segmenting and Labeling Tasks
The nature of no word delimiter or inflection that can indicate segment boundaries or word semantics increases the difficulty of Chinese text understanding, and also intensifies the demand for word-level semantic knowledge to accomplish the tagging goal in Chinese segmenting and labeling tasks.
Position Offset Label Prediction for Grammatical Error Correction
We introduce a novel position offset label prediction subtask to the encoder-decoder architecture for grammatical error correction (GEC) task.
VidTwin: Video VAE with Decoupled Structure and Dynamics
Recent advancements in video autoencoders (Video AEs) have significantly improved the quality and efficiency of video generation.
PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension
To provide a comprehensive evaluation, PunchBench incorporates diverse question formats and image-captions from various domains.
Hyperspectral Image Cross-Domain Object Detection Method based on Spectral-Spatial Feature Alignment
For solving the problem of domain-shift, we propose a HSI cross-domain object detection method based on spectral-spatial feature alignment, which is the first attempt in the object detection community to the best of our knowledge.
Unveiling Molecular Secrets: An LLM-Augmented Linear Model for Explainable and Calibratable Molecular Property Prediction
The core of MoleX is to model complicated molecular structure-property relationships using a simple linear model, augmented by LLM knowledge and a crafted calibration strategy.
Temporal Reasoning Transfer from Text to Video
Video Large Language Models (Video LLMs) have shown promising capabilities in video comprehension, yet they struggle with tracking temporal changes and reasoning about temporal relationships.
Enhancing Data Quality through Self-learning on Imbalanced Financial Risk Data
In the financial risk domain, particularly in credit default prediction and fraud detection, accurate identification of high-risk class instances is paramount, as their occurrence can have significant economic implications.
Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts
To be specific, before the top-K routing decision, Loss-Free Balancing will first apply an expert-wise bias to the routing scores of each expert.
DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models
Specifically, we trace back the semantic relevance flow from generated language tokens to raw visual encoder patches and the intermediate outputs produced by projectors.
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Recent talking avatar generation models have made strides in achieving realistic and accurate lip synchronization with the audio, but often fall short in controlling and conveying detailed expressions and emotions of the avatar, making the generated video less vivid and controllable.
LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?
Diffusion models have exhibited remarkable capabilities in text-to-image generation.
Ranked #8 on
Image Captioning
on COCO Captions
(ROUGE-L metric)
Towards Multimodal Video Paragraph Captioning Models Robust to Missing Modality
Video paragraph captioning (VPC) involves generating detailed narratives for long videos, utilizing supportive modalities such as speech and event boundaries.
TempCompass: Do Video LLMs Really Understand Videos?
Motivated by these two problems, we propose the \textbf{TempCompass} benchmark, which introduces a diversity of temporal aspects and task formats.
Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents
In this work, we take the first step to investigate one of the typical safety threats, backdoor attack, to LLM-based agents.
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
This work proposes TimeChat, a time-sensitive multimodal large language model specifically designed for long video understanding.
Ranked #2 on
Video-Text Retrieval
on Test-of-Time
(using extra training data)
VITATECS: A Diagnostic Dataset for Temporal Concept Understanding of Video-Language Models
The ability to perceive how objects change over time is a crucial ingredient in human intelligence.
RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge
Therefore, to evaluate the ability of LLMs to discern the reliability of external knowledge, we create a benchmark from existing knowledge bases.
FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation
The multi-aspect categorization of FETV enables fine-grained analysis of the metrics' reliability in different scenarios.
TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
TESTA can reduce the number of visual tokens by 75% and thus accelerate video encoding.
Ranked #1 on
Video Retrieval
on Condensed Movies
(using extra training data)
Incorporating Pre-trained Model Prompting in Multimodal Stock Volume Movement Prediction
Existing multimodal works that train models from scratch face the problem of lacking universal knowledge when modeling financial news.
MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
To deal with the label shortage problem, we present a simple yet effective zero-shot approach MultiCapCLIP that can generate visual captions for different scenarios and languages without any labeled vision-caption pairs of downstream datasets.
Towards Codable Watermarking for Injecting Multi-bits Information to LLMs
As large language models (LLMs) generate texts with increasing fluency and realism, there is a growing need to identify the source of texts to prevent the abuse of LLMs.
M$^3$IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning
To tackle this challenge and promote research in the vision-language field, we introduce the Multi-Modal, Multilingual Instruction Tuning (M$^3$IT) dataset, designed to optimize VLM alignment with human instructions.
Can Language Models Understand Physical Concepts?
Language models~(LMs) gradually become general-purpose interfaces in the interactive and embodied world, where the understanding of physical concepts is an essential prerequisite.
Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
In-context learning (ICL) emerges as a promising capability of large language models (LLMs) by providing them with demonstration examples to perform diverse tasks.
Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adapter
However, as pre-trained language models (PLMs) continue to increase in size, the communication cost for transmitting parameters during synchronization has become a training speed bottleneck.
Edit As You Wish: Video Caption Editing with Multi-grained User Control
In this paper, we propose a novel \textbf{V}ideo \textbf{C}aption \textbf{E}diting \textbf{(VCE)} task to automatically revise an existing video description guided by multi-grained user requests.
PALM: Open Fundus Photograph Dataset with Pathologic Myopia Recognition and Anatomical Structure Annotation
Our databases comprises 1200 images with associated labels for the pathologic myopia category and manual annotations of the optic disc, the position of the fovea and delineations of lesions such as patchy retinal atrophy (including peripapillary atrophy) and retinal detachment.
Diffusion Theory as a Scalpel: Detecting and Purifying Poisonous Dimensions in Pre-trained Language Models Caused by Backdoor or Bias
To settle this issue, we propose the Fine-purifying approach, which utilizes the diffusion theory to study the dynamic process of fine-tuning for finding potentially poisonous dimensions.
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
This work proposes POMP, a prompt pre-training method for vision-language models.
Fine-Tuning Deteriorates General Textual Out-of-Distribution Detection by Distorting Task-Agnostic Features
We find that: (1) no existing method behaves well in both settings; (2) fine-tuning PLMs on in-distribution data benefits detecting semantic shifts but severely deteriorates detecting non-semantic shifts, which can be attributed to the distortion of task-agnostic features.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
Integrating Local Real Data with Global Gradient Prototypes for Classifier Re-Balancing in Federated Long-Tailed Learning
Federated Learning (FL) has become a popular distributed learning paradigm that involves multiple clients training a global model collaboratively in a data privacy-preserving manner.
When to Trust Aggregated Gradients: Addressing Negative Client Sampling in Federated Learning
Federated Learning has become a widely-used framework which allows learning a global model on decentralized local datasets under the condition of protecting local data privacy.
A Survey on In-context Learning
With the increasing capabilities of large language models (LLMs), in-context learning (ICL) has emerged as a new paradigm for natural language processing (NLP), where LLMs make predictions based on contexts augmented with a few examples.
Aligning Source Visual and Target Language Domains for Unpaired Video Captioning
To this end, we introduce the unpaired video captioning task aiming to train models without coupled video-caption pairs in target language.
Gradient Knowledge Distillation for Pre-trained Language Models
Knowledge distillation (KD) is an effective framework to transfer knowledge from a large-scale teacher to a compact yet well-performing student.
DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention
To enhance the correlation between vision and language in disentangled spaces, we introduce the visual concepts to DiMBERT which represent visual information in textual format.
Retrieval-Augmented and Knowledge-Grounded Language Models for Faithful Clinical Medicine
We demonstrate the effectiveness of our method in generating patient discharge instructions.
Prophet Attention: Predicting Attention with Future Attention for Image Captioning
Especially for image captioning, the attention based models are expected to ground correct image regions with proper generated words.
Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models
In this work, we take the first step to exploit the pre-trained (unfine-tuned) weights to mitigate backdoors in fine-tuned language models.
Expose Backdoors on the Way: A Feature-Based Efficient Defense against Textual Backdoor Attacks
In this work, we take the first step to investigate the unconcealment of textual poisoned samples at the intermediate-feature level and propose a feature-based efficient online defense method.
Holistic Sentence Embeddings for Better Out-of-Distribution Detection
On the basis of the observations that token averaging and layer combination contribute to improving OOD detection, we propose a simple embedding approach named Avg-Avg, which averages all token representations from each intermediate layer as the sentence embedding and significantly surpasses the state-of-the-art on a comprehensive suite of benchmarks by a 9. 33% FAR95 margin.
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization
It demonstrates that flat minima tend to imply better generalization abilities.
Dim-Krum: Backdoor-Resistant Federated Learning for NLP with Dimension-wise Krum-Based Aggregation
NLP attacks tend to have small relative backdoor strengths, which may result in the failure of robust federated aggregation methods for NLP attacks.
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
We then design a Model Uncertainty--aware Knowledge Integration (MUKI) framework to recover the golden supervision for the student.
Stock Trading Volume Prediction with Dual-Process Meta-Learning
Our method can model the common pattern behind different stocks with a meta-learner, while modeling the specific pattern for each stock across time spans with stock-dependent parameters.
Distributional Correlation--Aware Knowledge Distillation for Stock Trading Volume Prediction
Traditional knowledge distillation in classification problems transfers the knowledge via class correlations in the soft label produced by teacher models, which are not available in regression problems like stock trading volume prediction.
Delving into the Openness of CLIP
However, evaluating the openness of CLIP-like models is challenging, as the models are open to arbitrary vocabulary in theory, but their accuracy varies in practice.
Hierarchical Inductive Transfer for Continual Dialogue Learning
However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of the dialogue system on the embedded devices but also causes knowledge forgetting on pre-trained models and knowledge interference among diverse dialogue tasks.
DFTR: Depth-supervised Fusion Transformer for Salient Object Detection
This paper, for the first time, seeks to expand the applicability of depth supervision to the Transformer architecture.
REFUGE2 Challenge: A Treasure Trove for Multi-Dimension Analysis and Evaluation in Glaucoma Screening
Here we release a multi-annotation, multi-quality, and multi-device color fundus image dataset for glaucoma analysis on an original challenge -- Retinal Fundus Glaucoma Challenge 2nd Edition (REFUGE2).
ADAM Challenge: Detecting Age-related Macular Degeneration from Fundus Images
The ADAM challenge consisted of four tasks which cover the main aspects of detecting and characterizing AMD from fundus images, including detection of AMD, detection and segmentation of optic disc, localization of fovea, and detection and segmentation of lesions.
CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark
We argue that for general-purpose language intelligence evaluation, the benchmark itself needs to be comprehensive and systematic.
Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models
As many fine-tuned pre-trained language models~(PLMs) with promising performance are generously released, investigating better ways to reuse these models is vital as it can greatly reduce the retraining computational cost and the potential environmental side-effects.
KNAS: Green Neural Architecture Search
Many existing neural architecture search (NAS) solutions rely on downstream training for architecture evaluation, which takes enormous computations.
Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation
KGAE consists of a pre-constructed knowledge graph, a knowledge-driven encoder and a knowledge-driven decoder.
RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Motivated by this observation, we construct a word-based robustness-aware perturbation to distinguish poisoned samples from clean samples to defend against the backdoor attacks on natural language processing (NLP) models.
Well-classified Examples are Underestimated in Classification with Deep Neural Networks
The conventional wisdom behind learning deep classification models is to focus on bad-classified examples and ignore well-classified examples that are far from the decision boundary.
Topology-Imbalance Learning for Semi-Supervised Node Classification
The class imbalance problem, as an important issue in learning node representations, has drawn increasing attention from the community.
Dynamic Knowledge Distillation for Pre-trained Language Models
Knowledge distillation~(KD) has been proved effective for compressing large-scale pre-trained language models.
Adversarial Parameter Defense by Multi-Step Risk Minimization
To enhance neural networks, we propose the adversarial parameter defense algorithm that minimizes the average risk of multiple adversarial parameter corruptions.
How to Inject Backdoors with Better Consistency: Logit Anchoring on Clean Data
In this work, we observe an interesting phenomenon that the variations of parameters are always AWPs when tuning the trained clean model to inject backdoors.
Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification
Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations.
Long-term, Short-term and Sudden Event: Trading Volume Movement Prediction with Graph-based Multi-view Modeling
Trading volume movement prediction is the key in a variety of financial applications.
ASAT: Adaptively Scaled Adversarial Training in Time Series
Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization ability of neural networks, train robust neural networks, and provide interpretability for neural networks.
O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioning
Video captioning combines video understanding and language generation.
Rethinking Stealthiness of Backdoor Attack against NLP Models
In this work, we point out a potential problem of current backdoor attacking research: its evaluation ignores the stealthiness of backdoor attacks, and most of existing backdoor attacking methods are not stealthy either to system deployers or to system users.
Contrastive Attention for Automatic Chest X-ray Report Generation
In addition, according to the analysis, the CA model can help existing models better attend to the abnormal regions and provide more accurate descriptions which are crucial for an interpretable diagnosis.
Neural Network Surgery: Injecting Data Patterns into Pre-trained Models with Minimal Instance-wise Side Effects
Motivated by neuroscientific evidence and theoretical results, we demonstrate that side effects can be controlled by the number of changed parameters and thus, we propose to conduct \textit{neural network surgery} by only modifying a limited number of parameters.
A Global Past-Future Early Exit Method for Accelerating Inference of Pre-trained Language Models
We first take into consideration all the linguistic information embedded in the past layers and then take a further step to engage the future information which is originally inaccessible for predictions.
Alleviating the Knowledge-Language Inconsistency: A Study for Deep Commonsense Knowledge
Knowledge facts are typically represented by relational triples, while we observe that some commonsense facts are represented by the triples whose forms are inconsistent with the expression of language.
Learning Relation Alignment for Calibrated Cross-modal Retrieval
To bridge the semantic gap between the two modalities, previous studies mainly focus on word-region alignment at the object level, lacking the matching between the linguistic relation among the words and the visual relation among the regions.
Ranked #5 on
Image-to-Text Retrieval
on MS COCO
Rethinking Skip Connection with Layer Normalization in Transformers and ResNets
In this work, we investigate how the scale factors in the effectiveness of the skip connection and reveal that a trivial adjustment of the scale will lead to spurious gradient exploding or vanishing in line with the deepness of the models, which could be addressed by normalization, in particular, layer normalization, which induces consistent improvements over the plain skip connection.
Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models
However, in this paper, we find that it is possible to hack the model in a data-free way by modifying one single word embedding vector, with almost no accuracy sacrificed on clean samples.
Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation
The finding of general knowledge is further hindered by the unidirectional distillation, as the student should obey the teacher and may discard some knowledge that is truly general but refuted by the teacher.
A Gradient-based Kernel Approach for Efficient Network Architecture Search
Inspired by our new finding, we explore a simple yet effective network architecture search (NAS) approach that leverages gradient correlation and gradient values to find well-performing architectures.
High-Likelihood Area Matters --- Rewarding Near-Correct Predictions Under Imbalanced Distributions
We find in practice that the high-likelihood area contains correct predictions for tail classes and it plays a vital role in learning imbalanced class distributions.
CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
On the other hand, the exiting decisions made by internal classifiers are unreliable, leading to wrongly emitted early predictions.
Learning Robust Representation for Clustering through Locality Preserving Variational Discriminative Network
Recent deep learning based methods focus on learning clustering oriented representations.
Rethinking the Promotion Brought by Contrastive Learning to Semi-Supervised Node Classification
Graph Contrastive Learning (GCL) has proven highly effective in promoting the performance of Semi-Supervised Node Classification (SSNC).
EQG-RACE: Examination-Type Question Generation
Question Generation (QG) is an essential component of the automatic intelligent tutoring systems, which aims to generate high-quality questions for facilitating the reading practice and assessments.
Rethinking Skip Connection with Layer Normalization
In this work, we investigate how the scale factors in the effectiveness of the skip connection and reveal that a trivial adjustment of the scale will lead to spurious gradient exploding or vanishing in line with the deepness of the models, which could by addressed by normalization, in particular, layer normalization, which induces consistent improvements over the plain skip connection.
Prophet Attention: Predicting Attention with Future Attention
Especially for image captioning, the attention based models are expected to ground correct image regions with proper generated words.
Pretrain-KGE: Learning Knowledge Representation from Pretrained Language Models
Conventional knowledge graph embedding (KGE) often suffers from limited knowledge representation, leading to performance degradation especially on the low-resource problem.
A Backbone Replaceable Fine-tuning Framework for Stable Face Alignment
The proposed framework achieves at least 40% improvement on stability evaluation metrics while enhancing detection accuracy versus state-of-the-art methods.
CAPT: Contrastive Pre-Training for Learning Denoised Sequence Representations
Pre-trained self-supervised models such as BERT have achieved striking success in learning sequence representations, especially for natural language processing.
Regularizing Dialogue Generation by Imitating Implicit Scenarios
Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario.
Graph-based Multi-hop Reasoning for Long Text Generation
The reasoning module is responsible for searching skeleton paths from a knowledge graph to imitate the imagination process in the human writing for semantic transfer.
Collaborative Group Learning
Collaborative learning has successfully applied knowledge transfer to guide a pool of small student networks towards robust local minima.
Robust Retinal Vessel Segmentation from a Data Augmentation Perspective
In this paper, we propose two new data augmentation modules, namely, channel-wise random Gamma correction and channel-wise random vessel augmentation.
How to Ask Good Questions? Try to Leverage Paraphrases
Given a sentence and its relevant answer, how to ask good questions is a challenging task, which has many real applications.
Exploring the Vulnerability of Deep Neural Networks: A Study of Parameter Corruption
We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding this matter.
Building BROOK: A Multi-modal and Facial Video Database for Human-Vehicle Interaction Research
Finally, we discuss related issues when building such a database and our future directions in the context of BROOK.
Rethinking and Improving Natural Language Generation with Layer-Wise Multi-View Decoding
While it is common practice to draw information from only the last encoder layer, recent work has proposed to use representations from different encoder layers for diversified levels of information.
Parallel Data Augmentation for Formality Style Transfer
The main barrier to progress in the task of Formality Style Transfer is the inadequacy of training data.
AGE Challenge: Angle Closure Glaucoma Evaluation in Anterior Segment Optical Coherence Tomography
To address this, we organized the Angle closure Glaucoma Evaluation challenge (AGE), held in conjunction with MICCAI 2019.
Jointly Modeling Aspect and Sentiment with Dynamic Heterogeneous Graph Neural Networks
Target-Based Sentiment Analysis aims to detect the opinion aspects (aspect extraction) and the sentiment polarities (sentiment detection) towards them.
Query-Variant Advertisement Text Generation with Association Knowledge
In this paper, we propose the query-variant advertisement text generation task that aims to generate candidate advertisement texts for different web search queries with various needs based on queries and item keywords.
Mining Commonsense Facts from the Physical World
In this paper, we propose a new task of mining commonsense facts from the raw text that describes the physical world.
Visual Agreement Regularized Training for Multi-Modal Machine Translation
Further analysis demonstrates that the proposed regularized training can effectively improve the agreement of attention on the image, leading to better use of visual information.
Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection
Self-attention based Transformer has demonstrated the state-of-the-art performances in a number of natural language processing tasks.
Pretrain-KGEs: Learning Knowledge Representation from Pretrained Models for Knowledge Graph Embeddings
Learning knowledge graph embeddings (KGEs) is an efficient approach to knowledge graph completion.
MUSE: Parallel Multi-Scale Attention for Sequence to Sequence Learning
In this work, we explore parallel multi-scale representation learning on sequence data, striving to capture both long-range and short-range language structures.
Ranked #8 on
Machine Translation
on WMT2014 English-French
Understanding and Improving Layer Normalization
Unlike them, we find that the derivatives of the mean and variance are more important than forward normalization by re-centering and re-scaling backward gradients.
Ranked #5 on
Machine Translation
on IWSLT2015 English-Vietnamese
HighwayGraph: Modelling Long-distance Node Relations for Improving General Graph Neural Network
To address this issue, we propose to model long-distance node relations by simply relying on shallow GNN architectures with two solutions: (1) Implicitly modelling by learning to predict node pair relations (2) Explicitly modelling by adding edges between nodes that potentially have the same label.
LexicalAT: Lexical-Based Adversarial Reinforcement Training for Robust Sentiment Classification
The generator learns to generate examples to attack the classifier while the classifier learns to defend these attacks.
Specificity-Driven Cascading Approach for Unsupervised Sentiment Modification
The task of unsupervised sentiment modification aims to reverse the sentiment polarity of the input text while preserving its semantic content without any parallel data.
Asking Clarification Questions in Knowledge-Based Question Answering
We provide representative baselines for these tasks and further introduce a coarse-to-fine model for clarification question generation.
Blast-wave description of $Υ$ elliptic flow at energies available at the CERN Large Hadron Collider
A simultaneous blast-wave fit to particle yields and elliptic flow ($v_{2}$) measured as a function of transverse momentum in Pb-Pb collisions at LHC energies is presented.
High Energy Physics - Phenomenology Nuclear Experiment Nuclear Theory
An Adaptive and Momental Bound Method for Stochastic Learning
The dynamic learning rate bounds are based on the exponential moving averages of the adaptive learning rates themselves, which smooth out unexpected large learning rates and stabilize the training of deep neural networks.
Pun-GAN: Generative Adversarial Network for Pun Generation
It consists of a generator to produce pun sentences, and a discriminator to distinguish between the generated pun sentences and the real sentences with specific word senses.
Aligning Cross-Lingual Entities with Multi-Aspect Information
Multilingual knowledge graphs (KGs), such as YAGO and DBpedia, represent entities in different languages.
Group, Extract and Aggregate: Summarizing a Large Amount of Finance News for Forex Movement Prediction
In this work, we propose a BERT-based Hierarchical Aggregation Model to summarize a large amount of finance news to predict forex movement.
Sparse Transformer: Concentrated Attention Through Explicit Selection
Extensive experimental results on a series of natural language processing tasks, including neural machine translation, image captioning, and language modeling, all demonstrate the advantages of Sparse Transformer in model performance.
Recursive Graphical Neural Networks for Text Classification
Graph is a natural structure to describe the complicated relation between tokens.
Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting
We study sequence-to-sequence (seq2seq) pre-training with data augmentation for sentence rewriting.
Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View
Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks.
Ranked #51 on
Node Classification
on Cora
Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generation
We propose a novel model to separate the generation into two stages: key fact prediction and surface realization.
A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification
In this way, we can reduce the dependence of the model on the label order, as well as capture high-order correlations between labels.
Learning to Control the Fine-grained Sentiment for Story Ending Generation
Therefore, we propose a generic and novel framework which consists of a sentiment analyzer and a sentimental generator, respectively addressing the two challenges.
Cross-Modal Commentator: Automatic Machine Commenting Based on Cross-Modal Information
Automatic commenting of online articles can provide additional opinions and facts to the reader, which improves user experience and engagement on social media platforms.
MAAM: A Morphology-Aware Alignment Model for Unsupervised Bilingual Lexicon Induction
The task of unsupervised bilingual lexicon induction (UBLI) aims to induce word translations from monolingual corpora in two languages.
Enhancing Topic-to-Essay Generation with External Commonsense Knowledge
Experiments show that with external commonsense knowledge and adversarial training, the generated essays are more novel, diverse, and topic-consistent than existing methods in terms of both automatic and human evaluation.
Towards Fine-grained Text Sentiment Transfer
In this paper, we focus on the task of fine-grained text sentiment transfer (FGST).
Coherent Comments Generation for Chinese Articles with a Graph-to-Sequence Model
In this paper, we propose to generate comments with a graph-to-sequence model that models the input news as a topic interaction graph.
PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation
Through this method, we generate synthetic data using a large amount of unlabeled data in the target domain and then obtain a word segmentation model for the target domain.
Imitation Learning for Non-Autoregressive Neural Machine Translation
Non-autoregressive translation models (NAT) have achieved impressive inference speedup.
A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfer
Unsupervised text style transfer aims to alter text styles while preserving the content, without aligned data for supervision.
Coherent Comment Generation for Chinese Articles with a Graph-to-Sequence Model
In this paper, we propose to generate comments with a graph-to-sequence model that models the input news as a topic interaction graph.
Memorized Sparse Backpropagation
Neural network learning is usually time-consuming since backpropagation needs to compute full gradients and backpropagate them across multiple layers.
A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfer
Therefore, in this paper, we propose a dual reinforcement learning framework to directly transfer the style of the text via a one-step mapping model, without any separation of content and style.
Ranked #1 on
Unsupervised Text Style Transfer
on GYAFC
Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations
In vision-and-language grounding problems, fine-grained representations of the image are considered to be of paramount importance.
Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual Storytelling
The visual storytelling (VST) task aims at generating a reasonable and coherent paragraph-level story with the image stream as input.
Ranked #21 on
Visual Storytelling
on VIST
Adaptive Gradient Methods with Dynamic Bound of Learning Rate
Recent work has put forward some algorithms such as AMSGrad to tackle this issue but they failed to achieve considerable improvement over existing methods.
Learning Personalized End-to-End Goal-Oriented Dialog
Most existing works on dialog systems only consider conversation content while neglecting the personality of the user the bot is interacting with, which begets several unsolved issues.
Learning Unsupervised Word Mapping by Maximizing Mean Discrepancy
In order to avoid such sophisticated alternate optimization, we propose to learn unsupervised word mapping by directly maximizing the mean discrepancy between the distribution of transferred embedding and target embedding.
Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning
The lack of labeled data is one of the main challenges when building a task-oriented dialogue system.
Diversity-Promoting GAN: A Cross-Entropy Based Generative Adversarial Network for Diversified Text Generation
Existing text generation methods tend to produce repeated and {''}boring{''} expressions.
Unsupervised Machine Commenting with Neural Variational Topic Model
To fully exploit the unpaired data, we completely remove the need for parallel data and propose a novel unsupervised approach to train an automatic article commenting model, relying on nothing but unpaired articles and comments.
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
We introduce the task of automatic live commenting.
Evaluating Semantic Rationality of a Sentence: A Sememe-Word-Matching Neural Network based on HowNet
To evaluate the effectiveness of the proposed model, we build a large-scale rationality evaluation dataset.
A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification
However, the Seq2Seq model is not suitable for the MLTC task in essence.
simNet: Stepwise Image-Topic Merging Network for Generating Detailed and Comprehensive Image Captions
The encode-decoder framework has shown recent success in image captioning.
An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
Different from conventional text generation tasks, the mapping between inputs and responses in conversations is more complicated, which highly demands the understanding of utterance-level semantic dependency, a relation between the whole meanings of inputs and outputs.
Ranked #2 on
Text Generation
on DailyDialog
Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
We propose a novel model for multi-label text classification, which is based on sequence-to-sequence learning.