Search Results for author:
Found 10 papers, 4 papers with code
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation
We present DiffChat, a novel method to align Large Language Models (LLMs) to "chat" with prompt-as-input Text-to-Image Synthesis (TIS) models (e. g., Stable Diffusion) for interactive image creation.
PEneo: Unifying Line Extraction, Line Grouping, and Entity Linking for End-to-end Document Pair Extraction
However, simply concatenating SER and RE serially can lead to severe error propagation, and it fails to handle cases like multi-line entities in real scenarios.
Revisiting Scene Text Recognition: A Data Perspective
To this end, we consolidate a large-scale real STR dataset, namely Union14M, which comprises 4 million labeled images and 10 million unlabeled images, to assess the performance of STR models in more complex real-world scenarios.
ConaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval
Large-scale pre-trained text-image models with dual-encoder architectures (such as CLIP) are typically adopted for various vision-language applications, including text-image retrieval.
CWP: Instance complexity weighted channel-wise soft masks for network pruning
In this paper, we propose a simple yet effective differentiable network pruning method CWP based on instance complexity weighted filter importance scores.
LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding
LiLT can be pre-trained on the structured documents of a single language and then directly fine-tuned on other languages with the corresponding off-the-shelf monolingual/multilingual pre-trained textual models.
Ranked #5 on
Key Information Extraction
on CORD
MatchVIE: Exploiting Match Relevancy between Entities for Visual Information Extraction
Through key-value matching based on relevancy evaluation, the proposed MatchVIE can bypass the recognitions to various semantics, and simply focuses on the strong relevancy between entities.
Tag, Copy or Predict: A Unified Weakly-Supervised Learning Framework for Visual Information Extraction using Sequences
Visual information extraction (VIE) has attracted increasing attention in recent years.
Optical Character Recognition
Optical Character Recognition (OCR)
+2
Towards Robust Visual Information Extraction in Real World: New Dataset and Novel Solution
Visual information extraction (VIE) has attracted considerable attention recently owing to its various advanced applications such as document understanding, automatic marking and intelligent education.
Joint Layout Analysis, Character Detection and Recognition for Historical Document Digitization
In this framework, two branches named character branch and layout branch are added behind the feature extraction network.
