Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

pals-ttic/sjc 1 Dec 2022

We propose to apply chain rule on the learned gradients, and back-propagate the score of a diffusion model through the Jacobian of a differentiable renderer, which we instantiate to be a voxel radiance field.

182
1.46 stars / hour

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model

wyhuai/ddnm 1 Dec 2022

Most existing Image Restoration (IR) models are task-specific, which can not be generalized to different degradation operators.

Colorization Deblurring +3

127
1.18 stars / hour

ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT

extreme-bert/extreme-bert 30 Nov 2022

In this paper, we present ExtremeBERT, a toolkit for accelerating and customizing BERT pretraining.

Molecular System Prediction Sentence Classification

224
1.17 stars / hour

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

hzfinfdu/diffusion-bert 28 Nov 2022

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models.

Denoising Language Modelling +1

106
0.68 stars / hour

Images Speak in Images: A Generalist Painter for In-Context Visual Learning

baaivision/painter 5 Dec 2022

In this work, we present Painter, a generalist model which addresses these obstacles with an "image"-centric solution, that is, to redefine the output of core vision tasks as images, and specify task prompts as also images.

36
0.58 stars / hour

DAMO-YOLO : A Report on Real-Time Object Detection Design

tinyvision/damo-yolo 23 Nov 2022

In this report, we present a fast and accurate object detection method dubbed DAMO-YOLO, which achieves higher performance than the state-of-the-art YOLO series.

Neural Architecture Search object-detection +1

280
0.57 stars / hour

Mixed Neural Voxels for Fast Multi-view Video Synthesis

fengres/mixvoxels 1 Dec 2022

In this paper, we present a novel method named MixVoxels to better represent the dynamic scenes with fast training speed and competitive rendering qualities.

63
0.56 stars / hour

MIC: Masked Image Consistency for Context-Enhanced Domain Adaptation

lhoyer/mic 2 Dec 2022

MIC significantly improves the state-of-the-art performance across the different recognition tasks for synthetic-to-real, day-to-nighttime, and clear-to-adverse-weather UDA.

Image Classification object-detection +4

19
0.51 stars / hour

GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

nv-tlabs/GET3D 22 Sep 2022

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident.

2,456
0.46 stars / hour

Compressing Volumetric Radiance Fields to 1 MB

algohunt/vqrf 29 Nov 2022

Approximating radiance fields with volumetric grids is one of promising directions for improving NeRF, represented by methods like Plenoxels and DVGO, which achieve super-fast training convergence and real-time rendering.

Model Compression Neural Rendering +1

142
0.46 stars / hour