Search Results for author:
Found 32 papers, 20 papers with code
EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction
Multi-triple extraction is a challenging task due to the existence of informative inter-triple correlations, and consequently rich interactions across the constituent entities and relations. While existing works only explore entity representations, we propose to explicitly introduce relation representation, jointly represent it with entities, and novelly align them to identify valid triples. We perform comprehensive experiments on document-level relation extraction and joint entity and relation extraction along with ablations to demonstrate the advantage of the proposed method.
Document-level Relation Extraction
Joint Entity and Relation Extraction
+2
Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text Generation
Compositional generalization, representing the model's ability to generate text with new attribute combinations obtained by recombining single attributes from the training data, is a crucial property for multi-aspect controllable text generation (MCTG) methods.
RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customization
However, the inherent entangled influence scope of pseudo-words with the given text results in a dual-optimum paradox, i. e., the similarity of the given subjects and the controllability of the given text could not be optimal simultaneously.
Gradual Residuals Alignment: A Dual-Stream Framework for GAN Inversion and Image Attribute Editing
GAN-based image attribute editing firstly leverages GAN Inversion to project real images into the latent space of GAN and then manipulates corresponding latent codes.
Benchmarking Large Language Models on Controllable Generation under Diversified Instructions
While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions.
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation
Then we propose an emotion correlation enhanced decoder, with a novel correlation-aware aggregation and soft/hard strategy, respectively improving the emotion perception and response generation.
Grammatical Error Correction via Mixed-Grained Weighted Training
In this paper, the inherent discrepancies are manifested in two aspects, namely, accuracy of data annotation and diversity of potential annotations.
On the Calibration of Large Language Models and Alignment
As large language models attract increasing attention and find widespread application, concurrent challenges of reliability also arise at the same time.
Improving Image Captioning via Predicting Structured Concepts
Having the difficulty of solving the semantic gap between images and texts for the image captioning task, conventional studies in this area paid some attention to treating semantic concepts as a bridge between the two modalities and improved captioning performance accordingly.
Random Entity Quantization for Parameter-Efficient Compositional Knowledge Graph Representation
We analyze this phenomenon and reveal that entity codes, the quantization outcomes for expressing entities, have higher entropy at the code level and Jaccard distance at the codeword level under random entity quantization.
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text Generation
Then we design a novel attribute distribution reconstruction method to balance the obtained distributions and use the reconstructed distributions to guide language models for generation, effectively avoiding the issue of Attribute Collapse.
DreamIdentity: Improved Editability for Efficient Face-identity Preserved Image Generation
While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images.
ExpertPrompting: Instructing Large Language Models to be Distinguished Experts
The answering quality of an aligned large language model (LLM) can be drastically improved if treated with proper crafting of prompts.
Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation
Existing autoregressive models follow the two-stage generation paradigm that first learns a codebook in the latent space for image reconstruction and then completes the image generation autoregressively based on the learned codebook.
Towards Accurate Image Coding: Improved Autoregressive Image Generation with Dynamic Vector Quantization
Existing vector quantization (VQ) based autoregressive models follow a two-stage generation paradigm that first learns a codebook to encode images as discrete codes, and then completes generation based on the learned codebook.
Inductive Relation Prediction from Relational Paths and Context with Hierarchical Transformers
Relation prediction on knowledge graphs (KGs) is a key research topic.
$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
In-Context Learning (ICL), which formulates target tasks as prompt completion conditioned on in-context demonstrations, has become the prevailing utilization of LLMs.
Crossing the Gap: Domain Generalization for Image Captioning
In this paper, we introduce a new setting called Domain Generalization for Image Captioning (DGIC), where the data from the target domain is unseen in the learning process.
Learning Semantic Relationship Among Instances for Image-Text Matching
Image-text matching, a bridge connecting image and language, is an important task, which generally learns a holistic cross-modal embedding to achieve a high-quality semantic alignment between the two modalities.
Intra-class Adaptive Augmentation with Neighbor Correction for Deep Metric Learning
They have overlooked the wide characteristic changes of different classes and can not model abundant intra-class variations for generations.
ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting
In this paper, we argue that the limited capacity of language models comes from 1) implicit language modeling; 2) unidirectional feature representation; and 3) language model with noise input.
Ranked #4 on
Text Spotting
on SCUT-CTW1500
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction
Relational triple extraction is challenging for its difficulty in capturing rich correlations between entities and relations.
Ranked #1 on
Relation Extraction
on WebNLG
Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularity
In this paper, we consider introducing an auxiliary task of Chinese pronunciation prediction (CPP) to improve CSC, and, for the first time, systematically discuss the adaptivity and granularity of this auxiliary task.
DSE-GAN: Dynamic Semantic Evolution Generative Adversarial Network for Text-to-Image Generation
Text-to-image generation aims at generating realistic images which are semantically consistent with the given text.
Negative-Aware Attention Framework for Image-Text Matching
Image-text matching, as a fundamental task, bridges the gap between vision and language.
Lesion-Aware Transformers for Diabetic Retinopathy Grading
First, to the best of our knowledge, this is the first work to formulate lesion discovery as a weakly supervised lesion localization problem via a transformer decoder.
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition
Additionally, based on the ensemble of iterative predictions, we propose a self-training method which can learn from unlabeled images effectively.
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction
Our experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN.
Ranked #3 on
Relation Extraction
on DocRED
Overcoming Language Priors with Self-supervised Learning for Visual Question Answering
Our method can compensate for the data biases by generating balanced data without introducing external annotations.
Image Captioning with Context-Aware Auxiliary Guidance
Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image.
Curriculum Learning for Natural Language Understanding
With the great success of pre-trained language models, the pretrain-finetune paradigm now becomes the undoubtedly dominant solution for natural language understanding (NLU) tasks.
Graph Structured Network for Image-Text Matching
The GSMN explicitly models object, relation and attribute as a structured phrase, which not only allows to learn correspondence of object, relation and attribute separately, but also benefits to learn fine-grained correspondence of structured phrase.
Ranked #16 on
Cross-Modal Retrieval
on Flickr30k
