Search Results for author:
Found 32 papers, 8 papers with code
EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Model
In this work, we introduce the new task of continuous emotional image content generation (C-EICG) and present EmotiCrafter, an emotional image generation model that generates images based on text prompts and Valence-Arousal values.
MotionBridge: Dynamic Video Inbetweening with Flexible Controls
By generating plausible and smooth transitions between two image frames, video inbetweening is an essential tool for video editing and long video synthesis.
SUGAR: Subject-Driven Video Customization in a Zero-Shot Manner
Compared to previous methods, SUGAR achieves state-of-the-art results in identity preservation, video dynamics, and video-text alignment for subject-driven video customization, demonstrating the effectiveness of our proposed method.
UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics
We introduce UniReal, a unified framework designed to address various image generation and editing tasks.
LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priors
In this paper, we propose a novel image generation pipeline based on Latent Diffusion Models (LDMs) that generates images with two layers: a foreground layer (RGBA) with transparency information and a background layer (RGB).
GroupDiff: Diffusion-based Group Portrait Editing
The training data engine covers the diverse needs of group portrait editing.
Toffee: Efficient Million-Scale Dataset Construction for Subject-Driven Text-to-Image Generation
Our dataset is 5 times the size of previous largest dataset, yet our cost is tens of thousands of GPU hours lower.
NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generation
The success of denoising diffusion models in representing rich data distributions over 2D raster images has prompted research on extending them to other data representations, such as vector graphics.
Text-to-Vector Generation with Neural Path Representation
By optimizing the combination of neural paths, we can incorporate geometric constraints while preserving expressivity in generated SVGs.
GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting
We propose GS-LRM, a scalable large reconstruction model that can predict high-quality 3D Gaussian primitives from 2-4 posed sparse images in 0. 23 seconds on single A100 GPU.
SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editing
Compared with existing methods for personalized subject swapping, SwapAnything has three unique advantages: (1) precise control of arbitrary objects and parts rather than the main subject, (2) more faithful preservation of context pixels, (3) better adaptation of the personalized concept to the image.
Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Tasks
Diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis.
AnaMoDiff: 2D Analogical Motion Diffusion via Disentangled Denoising
We present AnaMoDiff, a novel diffusion-based method for 2D motion analogies that is applied to raw, unannotated videos of articulated characters.
Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation
This paper proposes an image-vector dual diffusion model for generative layout design.
Localizing and Editing Knowledge in Text-to-Image Generative Models
We adapt Causal Mediation Analysis for text-to-image models and trace knowledge about distinct visual attributes to various (causal) components in the (i) UNet and (ii) text-encoder of the diffusion model.
Text-Guided Vector Graphics Customization
In this paper, we propose a novel pipeline that generates high-quality customized vector graphics based on textual prompts while preserving the properties and layer-wise information of a given exemplar SVG.
NPF-200: A Multi-Modal Eye Fixation Dataset and Method for Non-Photorealistic Videos
Non-photorealistic videos are in demand with the wave of the metaverse, but lack of sufficient research studies.
Language-based Photo Color Adjustment for Graphic Designs
We also introduce an approach for generating a synthetic graphic design dataset with instructions to enable model training.
FashionTex: Controllable Virtual Try-on with Text and Texture
Virtual try-on attracts increasing research attention as a promising way for enhancing the user experience for online cloth shopping.
AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representation
Traditional modeling pipelines keep an asset library storing unique object templates, which is both versatile and memory efficient in practice.
Grid-guided Neural Radiance Fields for Large Urban Scenes
An alternative solution is to use a feature grid representation, which is computationally efficient and can naturally scale to a large scene with increased grid resolutions.
Neural Preset for Color Style Transfer
In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed.
UniColor: A Unified Framework for Multi-Modal Colorization with Transformer
In the first stage, multi-modal conditions are converted into a common representation of hint points.
TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition
To mitigate this problem, we developed TransRank, a unified framework for recognizing Transformations in a Ranking formulation.
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering
The wide span of viewing positions within these scenes yields multi-scale renderings with very different levels of detail, which poses great challenges to neural radiance field and biases it towards compromised results.
Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation
While the average prediction accuracy has been improved significantly over the years, the performance on hard poses with depth ambiguity, self-occlusion, and complex or rare poses is still far from satisfactory.
Ranked #30 on
Skeleton Based Action Recognition
on NTU RGB+D 120
Unifying Global-Local Representations in Salient Object Detection with Transformer
In this paper, we introduce a new attention-based encoder, vision transformer, into salient object detection to ensure the globalization of the representations from shallow to deep layers.
Delving Deep Into Many-to-Many Attention for Few-Shot Video Object Segmentation
The key is to model the relationship between the query videos and the support images for propagating the object information.
BlockPlanner: City Block Generation With Vectorized Graph Representation
City modeling is the foundation for computational urban planning, navigation, and entertainment.
What makes instance discrimination good for transfer learning?
Contrastive visual pretraining based on the instance discrimination pretext task has made significant progress.
Distilling Localization for Self-Supervised Representation Learning
To address this problem, we propose a data-driven approach for learning invariance to backgrounds.
