Search Results for author:
Found 29 papers, 9 papers with code
Concept Decomposition for Visual Exploration and Inspiration
Each node in the tree represents a sub-concept using a learned vector embedding injected into the latent space of a pretrained text-to-image model.
PersonalTailor: Personalizing 2D Pattern Design from 3D Garment Point Clouds
Garment pattern design aims to convert a 3D garment to the corresponding 2D panels and their sewing structure.
Word-As-Image for Semantic Typography
A word-as-image is a semantic typography technique where a word illustration presents a visualization of the meaning of the word, while also preserving its readability.
ARO-Net: Learning Implicit Fields from Anchored Radial Observations
We introduce anchored radial observations (ARO), a novel shape encoding for learning implicit field representation of 3D shapes that is category-agnostic and generalizable amid significant shape variations.
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data
We present a multi-task prompt learning approach for video transformers, where a shared video transformer backbone is enhanced by a small set of specialized parameters for each task.
Prediction of Scene Plausibility
Understanding the 3D world from 2D images involves more than detection and segmentation of the objects within the scene.
CLIPascene: Scene Sketching with Different Types and Levels of Abstraction
In this paper, we present a method for converting a given scene image into a sketch using different types and multiple levels of abstraction.
Neural Font Rendering
Recent advances in deep learning techniques and applications have revolutionized artistic creation and manipulation in many domains (text, images, music); however, fonts have not yet been integrated with deep learning architectures in a manner that supports their multi-scale nature.
DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches
Researchers have explored various ways to generate realistic images from freehand sketches, e. g., for objects and human faces.
Semantic Segmentation in Art Paintings
In this paper, we tackle the problem of semantic segmentation of artistic paintings, an even more challenging task because of a much larger diversity in colors, textures, and shapes and because there are no ground truth annotations available for segmentation.
CLIPasso: Semantically-Aware Object Sketching
Abstraction is at the heart of sketching due to the simple and minimal nature of line drawings.
How Low Can We Go? Pixel Annotation for Semantic Segmentation
Based on this single-image-annotation experiment, we design an experiment to quickly annotate an entire data set.
CAST: Character labeling in Animation using Self-supervision by Tracking
Using this space we can build dictionaries of characters in an animation videos, and define specialized classifiers for specific stylistic content (e. g., characters in a specific animation series) with very little user effort.
Learned Queries for Efficient Local Attention
Vision Transformers (ViT) serve as powerful vision models.
Ranked #328 on
Image Classification
on ImageNet
Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure
In this work, we present a music-driven motion synthesis framework that generates long-term sequences of human motions which are synchronized with the input beats, and jointly form a global structure that respects a specific dance genre.
Ordered Attention for Coherent Visual Storytelling
OIA models interactions between the sentence-corresponding image and important regions in other images of the sequence.
InAugment: Improving Classifiers via Internal Augmentation
Image augmentation techniques apply transformation functions such as rotation, shearing, or color distortion on an input image.
Deep Symmetric Network for Underexposed Image Enhancement With Recurrent Attentional Learning
Underexposed image enhancement is of importance in many research domains.
Neural Alignment for Face De-pixelization
Although simple, our framework synthesizes high-quality face reconstructions, demonstrating that given the statistical prior of a human face, multiple aligned pixelated frames contain sufficient information to reconstruct a high-quality approximation of the original signal.
NPRportrait 1.0: A Three-Level Benchmark for Non-Photorealistic Rendering of Portraits
Despite the recent upsurge of activity in image-based non-photorealistic rendering (NPR), and in particular portrait image stylisation, due to the advent of neural style transfer, the state of performance evaluation in this field is limited, especially compared to the norms in the computer vision and machine learning communities.
Focus-and-Expand: Training Guidance Through Gradual Manipulation of Input Features
Drawing inspiration from Parameter Continuation methods, we propose steering the training process to consider specific features in the input more than others, through gradual shifts in the input domain.
Predictive and Generative Neural Networks for Object Functionality
Given a 3D object in isolation, our functional similarity network (fSIM-NET), a variation of the triplet network, is trained to predict the functionality of the object by inferring functionality-revealing interaction contexts.
Lean Images for Geo-Localization
In this paper we consider the geo-localization task - finding the pose of a camera in a large 3D scene from a single lean image, i. e. an image with no texture.
On the Role of Geometry in Geo-Localization
We find that the network is capable of estimating the camera pose from the lean images, and it does so not by memorization but by some measure of geometric learning of the geographical area.
Image Resizing by Reconstruction from Deep Features
In this paper we perform image resizing in feature space where the deep layers of a neural network contain rich important semantic information.
Deep Portrait Image Completion and Extrapolation
We evaluate our method on public portrait image datasets, and show that it outperforms other state-of-art general image completion methods.
Graphics
GRAINS: Generative Recursive Autoencoders for INdoor Scenes
We present a generative neural network which enables us to generate plausible 3D indoor scenes in large quantities and varieties, easily and highly efficiently.
Graphics
Deep Online Video Stabilization
In this paper, we solve the video stabilization problem using a convolutional neural network (ConvNet).
Graphics
Sketch2Photo: Internet Image Montage
The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet.
