Search Results for author:
Found 15 papers, 4 papers with code
From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models
This survey paper serves as a comprehensive resource for researchers and practitioners in the fields of natural language processing, computer vision, and data analysis, providing valuable insights and directions for future research in chart understanding leveraging large foundation models.
Aligning Large Language Models for Controllable Recommendations
Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable, and controllable.
Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning
This work inaugurates a new domain in factual error correction for chart captions, presenting a novel evaluation mechanism, and demonstrating an effective approach to ensuring the factuality of generated chart captions.
Factual Inconsistency Detection in Chart Captioning
Image Captioning
+1
PhyloGFN: Phylogenetic inference with generative flow networks
Phylogenetics is a branch of computational biology that studies the evolutionary relationships among biological entities.
Enhanced Chart Understanding in Vision and Language Task via Cross-modal Pre-training on Plot Table Pairs
Building cross-model intelligence that can understand charts and communicate the salient information hidden behind them is an appealing challenge in the vision and language(V+L) community.
Focus! Relevant and Sufficient Context Selection for News Image Captioning
In our paper, we first demonstrate that by combining more fine-grained context that captures the key named entities (obtained via an oracle) and the global context that summarizes the news, we can dramatically improve the model's ability to generate accurate news captions.
Insta-VAX: A Multimodal Benchmark for Anti-Vaccine and Misinformation Posts Detection on Social Media
The dataset and classifiers contribute to monitoring and tracking of vaccine discussions for social scientific and public health efforts in combating the problem of vaccine misinformation.
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
Vision-and-language pre-training has achieved impressive success in learning multimodal representations between vision and language.
Gunrock 2.0: A User Adaptive Social Conversational System
Gunrock 2. 0 is built on top of Gunrock with an emphasis on user adaptation.
Addressing Time Bias in Bipartite Graph Ranking for Important Node Identification
The problem of ranking the nodes in bipartite networks is valuable for many real-world applications.
Gunrock: A Social Bot for Complex and Engaging Long Conversations
Gunrock is the winner of the 2018 Amazon Alexa Prize, as evaluated by coherence and engagement from both real users and Amazon-selected expert conversationalists.
Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation
Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems.
A Visual Attention Grounding Neural Model for Multimodal Machine Translation
The model leverages a visual attention grounding mechanism that links the visual semantics with the corresponding textual semantics.
Ranked #12 on
Multimodal Machine Translation
on Multi30K
Reflexive Regular Equivalence for Bipartite Data
Reflexive regular equivalence can also use the structure of transitivities -- in a network sense -- the contribution of which is controlled by the algorithm's only free-parameter, $\alpha$.
