Search Results for author:
Found 5 papers, 1 papers with code
Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation
Video-to-Text (VTT) is the task of automatically generating descriptions for short audio-visual video clips, which can support visually impaired people to understand scenes of a YouTube video for instance.
Extended Self-Critical Pipeline for Transforming Videos to Text (TRECVID-VTT Task 2021) -- Team: MMCUniAugsburg
For both models, we train on the complete VATEX dataset and 90% of the TRECVID-VTT dataset for pretraining while using the remaining 10% for validation.
Addressing Data Bias Problems for Chest X-ray Image Report Generation
Automatic medical report generation from chest X-ray images is one possibility for assisting doctors to reduce their workload.
Image Captioning with Clause-Focused Metrics in a Multi-Modal Setting for Marketing
Furthermore, we introduce a novel metric that allows us to assess whether the generated captions meet our requirements (i. e., subject, predicate, object, and product name) and describe a series of experiments on caption quality and how to address annotator disagreements for the image ratings with an approach called soft targets.
Multimodal Image Captioning for Marketing Analysis
Thanks to adding the third output modality, it also considerably improves the quality of generated captions for images depicting branded products.
