Search Results for author:
Found 17 papers, 6 papers with code
AesopAgent: Agent-driven Evolutionary System on Story-to-Video Production
In the Horizontal Layer, we introduce a novel RAG-based evolutionary system that optimizes the whole video generation workflow and the steps within the workflow.
Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification
Besides, pioneer ZSL models use convolutional neural networks pre-trained on ImageNet, which focus on the main objects appearing in each image, neglecting the background context that also matters in RS scene classification.
Jointly Optimized Global-Local Visual Localization of UAVs
Our GLVL network is a two-stage visual localization approach, combining a large-scale retrieval module that finds similar regions with the UAV flight scene, and a fine-grained matching module that localizes the precise UAV coordinate, enabling real-time and precise localization.
ModelScope Text-to-Video Technical Report
This paper introduces ModelScopeT2V, a text-to-video synthesis model that evolves from a text-to-image synthesis model (i. e., Stable Diffusion).
Ranked #8 on
Text-to-Video Generation
on MSR-VTT
VideoComposer: Compositional Video Synthesis with Motion Controllability
The pursuit of controllability as a higher standard of visual content creation has yielded remarkable progress in customizable image synthesis.
Ranked #5 on
Text-to-Video Generation
on EvalCrafter Text-to-Video (ECTV) Dataset
(using extra training data)
Distinctive Image Captioning via CLIP Guided Group Optimization
Image captioning models are usually trained according to human annotated ground-truth captions, which could generate accurate but generic captions.
Multi-dimension Geospatial feature learning for urban region function recognition
In this paper, we propose a Multi-dimension Feature Learning Model~(MDFL) using high-dimensional GBD data in conjunction with RS images for urban region function recognition.
On Distinctive Image Captioning via Comparing and Reweighting
First, we propose a distinctiveness metric -- between-set CIDEr (CIDErBtw) to evaluate the distinctiveness of a caption with respect to those of similar images.
Attribute Prototype Network for Any-Shot Learning
While a visual-semantic embedding layer learns global features, local features are learned through an attribute prototype network that simultaneously regresses and decorrelates attributes from intermediate features.
Ranked #5 on
GZSL Video Classification
on ActivityNet-GZSL(main)
VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning
Our model visually divides a set of images from seen classes into clusters of local image regions according to their visual similarity, and further imposes their class discrimination and semantic relatedness.
Group-based Distinctive Image Captioning with Memory Attention
In particular, we propose a group-based memory attention (GMA) module, which stores object features that are unique among the image group (i. e., with low similarity to objects in other images).
Where is the Model Looking At?--Concentrate and Explain the Network Attention
We generate attribute-based textual explanations for the network and ground the attributes on the image to show visual explanations.
SRQA: Synthetic Reader for Factoid Question Answering
This model enhances the question answering system in the multi-document scenario from three aspects: model structure, optimization goal, and training method, corresponding to Multilayer Attention (MA), Cross Evidence (CE), and Adversarial Training (AT) respectively.
ASTRAL: Adversarial Trained LSTM-CNN for Named Entity Recognition
Under such circumstances, how to make full use of the information extracted by word embedding requires more in-depth research.
Attribute Prototype Network for Zero-Shot Learning
As an additional benefit, our model points to the visual evidence of the attributes in an image, e. g. for the CUB dataset, confirming the improved attribute localization ability of our image representation.
Compare and Reweight: Distinctive Image Captioning Using Similar Images Sets
A wide range of image captioning models has been developed, achieving significant improvement based on popular metrics, such as BLEU, CIDEr, and SPICE.
A3Net: Adversarial-and-Attention Network for Machine Reading Comprehension
Meanwhile, we construct A3Net for the WebQA dataset.
