Search Results for author:
Found 10 papers, 0 papers with code
Fusion Models for Improved Visual Captioning
Building on these recent developments, and with the aim of improving the quality of generated captions, the contribution of our work in this paper is two-fold: First, we propose a generic multimodal model fusion framework for caption generation as well as emendation where we utilize different fusion strategies to integrate a pretrained Auxiliary Language Model (AuxLM) within the traditional encoder-decoder visual captioning frameworks.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+5
Integrating Image Captioning with Rule-based Entity Masking
Particularly, these image features are subdivided into global and local features, where global features are extracted from the global representation of the image, while local features are extracted from the objects detected locally in an image.
Sparse Graph to Sequence Learning for Vision Conditioned Long Textual Sequence Generation
Generating longer textual sequences when conditioned on the visual information is an interesting problem to explore.
Image Manipulation with Natural Language using Two-sidedAttentive Conditional Generative Adversarial Network
We propose the Two-sidEd Attentive conditional Generative Adversarial Network (TEA-cGAN) to generate semantically manipulated images while preserving other contents such as background intact.
Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods
Interest in Artificial Intelligence (AI) and its applications has seen unprecedented growth in the last few years.
Linking Tweets with Monolingual and Cross-Lingual News using Transformed Word Embeddings
But the gap in word usage between informal social media content such as tweets and diligently written content (e. g. news articles) make such assembling difficult.
Describing Natural Images Containing Novel Objects with Knowledge Guided Assitance
Images in the wild encapsulate rich knowledge about varied abstract concepts and cannot be sufficiently described with models built only using image-caption pairs containing selected objects.
