Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models

AttendAndExcite/Attend-and-Excite 31 Jan 2023

Recent text-to-image generative models have demonstrated an unparalleled ability to generate diverse and creative imagery guided by a target text prompt.

Generative Semantic Nursing

114
3.53 stars / hour

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

showlab/Tune-A-Video 22 Dec 2022

To reproduce the success of text-to-image (T2I) generation, recent works in text-to-video (T2V) generation employ large-scale text-video dataset for fine-tuning.

Style Transfer Text-to-Video Generation +1

434
1.81 stars / hour

BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining

microsoft/biogpt 19 Oct 2022

Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain.

Document Classification Language Modelling +3

373
1.54 stars / hour

On the Expressive Power of Geometric Graph Neural Networks

chaitjo/geometric-gnn-dojo 23 Jan 2023

The expressive power of Graph Neural Networks (GNNs) has been studied extensively through the Weisfeiler-Leman (WL) graph isomorphism test.

194
1.31 stars / hour

InstructPix2Pix: Learning to Follow Image Editing Instructions

timothybrooks/instruct-pix2pix 17 Nov 2022

We propose a method for editing images from human instructions: given an input image and a written instruction that tells the model what to do, our model follows these instructions to edit the image.

Language Modelling Text-based Image Editing +1

3,002
1.16 stars / hour

ArchiSound: Audio Generation with Diffusion

archinetai/audio-diffusion-pytorch 30 Jan 2023

The recent surge in popularity of diffusion models for image generation has brought new attention to the potential of these models in other areas of media generation.

Audio Generation Image Generation

951
1.13 stars / hour

Cut and Learn for Unsupervised Object Detection and Instance Segmentation

facebookresearch/cutler 26 Jan 2023

We propose Cut-and-LEaRn (CutLER), a simple approach for training unsupervised object detection and segmentation models.

Instance Segmentation object-detection +2

260
1.12 stars / hour

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

salesforce/lavis 30 Jan 2023

The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models.

Image Captioning Image Retrieval +6

1,707
1.11 stars / hour

What Makes Good Examples for Visual In-Context Learning?

zhangyuanhan-ai/visual_prompt_retrieval 31 Jan 2023

To overcome the problem, we propose a prompt retrieval framework to automate the selection of in-context examples.

Retrieval

33
1.08 stars / hour

AudioLDM: Text-to-Audio Generation with Latent Diffusion Models

haoheliu/audioldm_eval 29 Jan 2023

By learning the latent representations of audio signals and their compositions without modeling the cross-modal relationship, AudioLDM is advantageous in both generation quality and computational efficiency.

Audio Generation Style Transfer

55
1.08 stars / hour