Search Results for author:
Found 11 papers, 0 papers with code
Image Description Dataset for Language Learners
We focus on image description and a corresponding assessment system for language learners.
BioVL-QR: Egocentric Biochemical Video-and-Language Dataset Using Micro QR Codes
From our preliminary study, we found that detecting objects only using Micro QR Codes is still difficult because the researchers manipulate objects, causing blur and occlusion frequently.
Text-driven Affordance Learning from Egocentric Vision
The key idea of our approach is employing textual instruction, targeting various affordances for a wide range of objects.
Automatic Construction of a Large-Scale Corpus for Geoparsing Using Wikipedia Hyperlinks
By utilizing hyperlinks, we can accurately assign location expressions with coordinates even with ambiguous location expressions in the texts.
On the Audio Hallucinations in Large Audio-Video Language Models
This paper refers to this as audio hallucinations and analyzes them in large audio-video language models.
Vision-Language Models Learn Super Images for Efficient Partially Relevant Video Retrieval
The zero-shot QASIR yields two discoveries: (1) it enables VLMs to generalize to super images and (2) the grid size $N$, image resolution, and VLM size are key trade-off parameters between performance and computation costs.
Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos
We propose a novel benchmark for cross-view knowledge transfer of dense video captioning, adapting models from web instructional videos with exocentric views to an egocentric view.
Recipe Generation from Unsegmented Cooking Videos
However, unlike DVC, in recipe generation, recipe story awareness is crucial, and a model should extract an appropriate number of events in the correct order and generate accurate sentences based on them.
Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows
We present a new multimodal dataset called Visual Recipe Flow, which enables us to learn each cooking action result in a recipe text.
Visual Grounding Annotation of Recipe Flow Graph
Visual grounding is provided as bounding boxes to image sequences of recipes, and each bounding box is linked to an element of the workflow.
Procedural Text Generation from a Photo Sequence
Multimedia procedural texts, such as instructions and manuals with pictures, support people to share how-to knowledge.
