Search Results for author:
Found 8 papers, 4 papers with code
Exploiting Image–Text Synergy for Contextual Image Captioning
Modern web content - news articles, blog posts, educational resources, marketing brochures - is predominantly multimodal.
Towards Enhanced Controllability of Diffusion Models
We rely on the inductive bias of the progressive denoising process of diffusion models to encode pose/layout information in the spatial structure mask and semantic/style information in the style code.
Controlled and Conditional Text to Image Generation with Diffusion Prior
We observe that Diffusion Prior can be used in a memory and compute efficient way to constrain the generation to a specific domain without altering the larger Diffusion Decoder.
PRedItOR: Text Guided Image Editing with Diffusion Prior
We combine this with structure preserving edits on the image decoder using existing approaches such as reverse DDIM to perform text guided image editing.
Cross-Modal Coherence for Text-to-Image Retrieval
Common image-text joint understanding techniques presume that images and the associated text can universally be characterized by a single implicit model.
AESOP: Abstract Encoding of Stories, Objects, and Pictures
Visual storytelling and story comprehension are uniquely human skills that play a central role in how we learn about and experience the world.
GitEvolve: Predicting the Evolution of GitHub Repositories
Given its crucial role, there is a need to better understand and model the dynamics of GitHub as a social platform.
Show Me a Story: Towards Coherent Neural Story Illustration
We propose an end-to-end network for the visual illustration of a sequence of sentences forming a story.
