Hash3D: Training-free Acceleration for 3D Generation

Adamdad/hash3D 9 Apr 2024

The evolution of 3D generative modeling has been notably propelled by the adoption of 2D diffusion models.

Image to 3D Text to 3D

75
1.37 stars / hour

HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach

airi-institute/hairfastgan 1 Apr 2024

Our paper addresses the complex task of transferring a hairstyle from a reference image to an input photo for virtual hair try-on.

151
1.11 stars / hour

SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System

bytedance/schurvins 4 Dec 2023

To this end, we propose a novel filter-based VINS framework named SchurVINS, which could guarantee both high accuracy by building a complete residual model and low computational complexity with Schur complement.

Computational Efficiency

121
1.11 stars / hour

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

scutzzj/aniportrait 26 Mar 2024

In this study, we propose AniPortrait, a novel framework for generating high-quality animation driven by audio and a reference portrait image.

Face Reenactment

3,379
1.05 stars / hour

Cross-Attention Makes Inference Cumbersome in Text-to-Image Diffusion Models

haozheliu-st/t-gate 3 Apr 2024

This study explores the role of cross-attention during inference in text-conditional diffusion models.

181
0.95 stars / hour

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

picsart-ai-research/streamingt2v 21 Mar 2024

To overcome these limitations, we introduce StreamingT2V, an autoregressive approach for long video generation of 80, 240, 600, 1200 or more frames with smooth transitions.

Text-to-Video Generation Video Generation

572
0.91 stars / hour

VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild

jasonppy/voicecraft 25 Mar 2024

We introduce VoiceCraft, a token infilling neural codec language model, that achieves state-of-the-art performance on both speech editing and zero-shot text-to-speech (TTS) on audiobooks, internet videos, and podcasts.

Language Modelling

6,282
0.85 stars / hour

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models

graphpku/pissa 3 Apr 2024

However, LoRA approximates Delta W through the product of two matrices, A, initialized with Gaussian noise, and B, initialized with zeros, while PiSSA initializes A and B with principal singular values and vectors of the original matrix W. PiSSA can better approximate the outcomes of full-parameter fine-tuning at the beginning by changing the essential parts while freezing the "noisy" parts.

Quantization

85
0.81 stars / hour

AutoWebGLM: Bootstrap And Reinforce A Large Language Model-based Web Navigating Agent

thudm/autowebglm 4 Apr 2024

Large language models (LLMs) have fueled many intelligent agent tasks, such as web navigation -- but most existing agents perform far from satisfying in real-world webpages due to three factors: (1) the versatility of actions on webpages, (2) HTML text exceeding model processing capacity, and (3) the complexity of decision-making due to the open-domain nature of web.

Decision Making Language Modelling +1

140
0.79 stars / hour

Policy-Guided Diffusion

emptyjackson/policy-guided-diffusion 9 Apr 2024

Our approach provides an effective alternative to autoregressive offline world models, opening the door to the controllable generation of synthetic training data.

43
0.79 stars / hour