Erasing Concepts from Diffusion Models

rohitgandikota/erasing 13 Mar 2023

We propose a fine-tuning method that can erase a visual concept from a pre-trained diffusion model, given only the name of the style and using negative guidance as a teacher.

Text-based Image Editing

159
0.55 stars / hour

LoRA: Low-Rank Adaptation of Large Language Models

microsoft/LoRA ICLR 2022

We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks.

Language Modelling

1,128
0.52 stars / hour

Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering

milvlg/prophet 3 Mar 2023

Knowledge-based visual question answering (VQA) requires external knowledge beyond the image to answer the question.

Language Modelling Question Answering +1

83
0.51 stars / hour

scenic

google-research/scenic NeurIPS 2021

Scenic: A Jax Library for Computer Vision Research and Beyond

Action Classification Action Recognition +2

1,952
0.48 stars / hour

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

cloneofsimo/lora 25 Aug 2022

Once the subject is embedded in the output domain of the model, the unique identifier can be used to synthesize novel photorealistic images of the subject contextualized in different scenes.

Image Generation

2,958
0.48 stars / hour

HFT: Lifting Perspective Representations via Hybrid Feature Transformation

jiayuzou2020/hft 11 Apr 2022

In order to reap the benefits and avoid the drawbacks of CBFT and CFFT, we propose a novel framework with a Hybrid Feature Transformation module (HFT).

Autonomous Driving Decision Making +1

105
0.47 stars / hour

Nerfstudio: A Modular Framework for Neural Radiance Field Development

nerfstudio-project/nerfstudio 8 Feb 2023

Neural Radiance Fields (NeRF) are a rapidly growing area of research with wide-ranging applications in computer vision, graphics, robotics, and more.

4,077
0.45 stars / hour

Image as Set of Points

ma-xu/context-cluster 2 Mar 2023

Context clusters (CoCs) view an image as a set of unorganized points and extract features via simplified clustering algorithm.

315
0.43 stars / hour

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

microsoft/DeBERTa 18 Nov 2021

We thus propose a new gradient-disentangled embedding sharing method that avoids the tug-of-war dynamics, improving both training efficiency and the quality of the pre-trained model.

Natural Language Inference Natural Language Understanding +2

1,435
0.41 stars / hour