Search Results for author:
Found 8 papers, 5 papers with code
Re-thinking Temporal Search for Long-Form Video Understanding
Specifically, under an inference budget of 32 frames, T* improves GPT-4o's performance from 50. 5% to 53. 1% and LLaVA-OneVision-72B's performance from 56. 5% to 62. 4% on LongVideoBench XL subset.
Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding
Understanding long video content is a complex endeavor that often relies on densely sampled frame captions or end-to-end feature selectors, yet these techniques commonly overlook the logical relationships between textual queries and visual elements.
SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reduction
Large Language Models (LLMs) have demonstrated improved generation performance by incorporating externally retrieved knowledge, a process known as retrieval-augmented generation (RAG).
Improving Gloss-free Sign Language Translation by Reducing Representation Density
In this paper, we identify a representation density problem that could be a bottleneck in restricting the performance of gloss-free SLT.
Contrastive Learning
Gloss-free Sign Language Translation
+2
GeoDeformer: Geometric Deformable Transformer for Action Recognition
Specifically, at the core of GeoDeformer is the Geometric Deformation Predictor, a module designed to identify and quantify potential spatial and temporal geometric deformations within the given video.
Spatial-Temporal Alignment Network for Action Recognition
This paper studies introducing viewpoint invariant feature representations in existing action recognition architecture.
Cross-modality Data Augmentation for End-to-End Sign Language Translation
To tackle these challenges, we propose a novel Cross-modality Data Augmentation (XmDA) framework to transfer the powerful gloss-to-text translation capabilities to end-to-end sign language translation (i. e. video-to-text) by exploiting pseudo gloss-text pairs from the sign gloss translation model.
Ranked #4 on
Sign Language Translation
on CSL-Daily
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation
In this paper, to overcome the limitation, we propose a Prompt based domain text Generation (PGEN) approach to produce the large-scale in-domain spoken language text data.
