Search Results for author:
Found 25 papers, 10 papers with code
Cosmos World Foundation Model Platform for Physical AI
We position a world foundation model as a general-purpose world model that can be fine-tuned into customized world models for downstream applications.
Illusion3D: 3D Multiview Illusion with 2D Diffusion Priors
Automatically generating multiview illusions is a compelling challenge, where a single piece of visual content offers distinct interpretations from different viewing perspectives.
Rethinking Score Distillation as a Bridge Between Image Distributions
We compare our method to existing approaches for score distillation sampling and show that it can produce high-frequency details with realistic colors.
Coherent Zero-Shot Visual Instruction Generation
Despite the advances in text-to-image synthesis, particularly with diffusion models, generating visual instructions that require consistent representation and smooth state transitions of objects across sequential steps remains a formidable challenge.
On the Content Bias in Fréchet Video Distance
We show that FVD with features extracted from the recent large-scale self-supervised video models is less biased toward image quality.
On the Content Bias in Frechet Video Distance
Frechet Video Distance (FVD) a prominent metric for evaluating video generation models is known to conflict with human perception occasionally.
Grounded Text-to-Image Synthesis with Attention Refocusing
Driven by the scalable diffusion models trained on large-scale datasets, text-to-image synthesis methods have shown compelling results.
Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models
Despite tremendous progress in generating high-quality images using diffusion models, synthesizing a sequence of animated frames that are both photorealistic and temporally coherent is still in its infancy.
Ranked #7 on
Text-to-Video Generation
on UCF-101
Expressive Text-to-Image Generation with Rich Text
For each region, we enforce its text attributes by creating region-specific detailed prompts and applying region-specific guidance, and maintain its fidelity against plain-text generation through region-based injections.
Text-driven Visual Synthesis with Latent Diffusion Prior
There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation.
Hyperbolic Contrastive Learning for Visual Representations beyond Objects
To exploit such a structure, we propose a contrastive learning framework where a Euclidean loss is used to learn object representations and a hyperbolic loss is used to encourage representations of scenes to lie close to representations of their constituent objects in a hyperbolic space.
MUGEN: A Playground for Video-Audio-Text Multimodal Understanding and GENeration
Altogether, MUGEN can help progress research in many tasks in multimodal understanding and generation.
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer
Videos are created to express emotion, exchange information, and share experiences.
Ranked #22 on
Video Generation
on UCF-101
Robust Contrastive Learning Using Negative Samples with Diminished Semantics
We also show that model bias favors texture and shape features differently under different test settings.
Visual Conceptual Blending with Large-scale Language and Vision Models
We ask the question: to what extent can recent large-scale language and image generation models blend visual concepts?
Shift Invariance Can Reduce Adversarial Robustness
Using this, we prove that shift invariance in neural networks produces adversarial examples for the simple case of two classes, each consisting of a single image with a black or white dot on a gray background.
Creative Sketch Generation
Sketching or doodling is a popular creative activity that people engage in.
Smooth Kernels Improve Adversarial Robustness and Perceptually-Aligned Gradients
Recent research has shown that CNNs are often overly sensitive to high-frequency textural patterns.
Learned Interpolation for 3D Generation
The typical approach for incorporating this creative process is to interpolate in a learned latent space so as to avoid the problem of generating unrealistic instances by exploiting the model's learned structure.
Getting Topology and Point Cloud Generation to Mesh
In this work, we explore the idea that effective generative models for point clouds under the autoencoding framework must acknowledge the relationship between a continuous surface, a discretized mesh, and a set of points sampled from the surface.
Developing Creative AI to Generate Sculptural Objects
We explore the intersection of human and machine creativity by generating sculptural objects through machine learning.
Personalizing Search Results Using Hierarchical RNN with Query-aware Attention
Our analysis reveals that the attention model is able to attribute higher weights to more related past sessions after fine training.
Learning Robust Global Representations by Penalizing Local Predictive Power
Despite their renowned predictive power on i. i. d.
Ranked #114 on
Domain Generalization
on PACS
Hallucinating Point Cloud into 3D Sculptural Object
Our approach extends DeepDream from images to 3D point clouds.
