Trending Research
Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
To reproduce the success of text-to-image (T2I) generation, recent works in text-to-video (T2V) generation employ large-scale text-video dataset for fine-tuning.
Cut and Learn for Unsupervised Object Detection and Instance Segmentation
We propose Cut-and-LEaRn (CutLER), a simple approach for training unsupervised object detection and segmentation models.
On the Expressive Power of Geometric Graph Neural Networks
chaitjo/geometric-gnn-dojo
•
•
The expressive power of Graph Neural Networks (GNNs) has been studied extensively through the Weisfeiler-Leman (WL) graph isomorphism test.
ArchiSound: Audio Generation with Diffusion
archinetai/audio-diffusion-pytorch
•
•
The recent surge in popularity of diffusion models for image generation has brought new attention to the potential of these models in other areas of media generation.
AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
By learning the latent representations of audio signals and their compositions without modeling the cross-modal relationship, AudioLDM is advantageous in both generation quality and computational efficiency.
Learning the Beauty in Songs: Neural Singing Voice Beautifier
MoonInTheRiver/DiffSinger
•
•
ACL 2022
Furthermore, we propose a latent-mapping algorithm in the latent space to convert the amateur vocal tone to the professional one.
InstructPix2Pix: Learning to Follow Image Editing Instructions
timothybrooks/instruct-pix2pix
•
•
We propose a method for editing images from human instructions: given an input image and a written instruction that tells the model what to do, our model follows these instructions to edit the image.
Parsel: A (De-)compositional Framework for Algorithmic Reasoning with Language Models
Despite recent success in large language model (LLM) reasoning, LLMs struggle with hierarchical multi-step reasoning tasks like generating complex programs.
Ranked #1 on
Code Generation
on APPS
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
microsoft/biogpt
•
•
Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain.
Ranked #1 on
Question Answering
on PubMedQA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
salesforce/lavis
•
•
The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models.
Ranked #1 on
Image Retrieval
on Flickr30k
