Trending Research
Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
To reproduce the success of text-to-image (T2I) generation, recent works in text-to-video (T2V) generation employ large-scale text-video dataset for fine-tuning.
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality
In this paper, we answer these questions by first defining the human-level quality based on the statistical significance of subjective measure and introducing appropriate guidelines to judge it, and then developing a TTS system called NaturalSpeech that achieves human-level quality on a benchmark dataset.
Ranked #1 on
Text-To-Speech Synthesis
on LJSpeech
PyGlove: Efficiently Exchanging ML Ideas as Code
We also perform a case study of a large codebase where PyGlove led to an 80% reduction in the number of lines of code.
Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds
Proteins power a vast array of functional processes in living cells.
OpenSpike: An OpenRAM SNN Accelerator
This paper presents a spiking neural network (SNN) accelerator made using fully open-source EDA tools, process design kit (PDK), and memory macros synthesized using OpenRAM.
L2SR: Learning to Sample and Reconstruct for Accelerated MRI
Accelerated MRI aims to find a pair of samplers and reconstructors to reduce acquisition time while maintaining the reconstruction quality.
Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models
AttendAndExcite/Attend-and-Excite
•
•
Recent text-to-image generative models have demonstrated an unparalleled ability to generate diverse and creative imagery guided by a target text prompt.
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
keyu-tian/spark
•
•
This is the first use of sparse convolution for 2D masked modeling.
Ranked #1 on
Instance Segmentation
on COCO 2017 val
Self-improving Multiplane-to-layer Images for Novel View Synthesis
SamsungLabs/MLI
•
•
We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene.
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities
automatic1111/stable-diffusion-webui
•
•
In this work, we present a conceptually simple and effective method to train a strong bilingual/multilingual multimodal representation model.
