OPT: Open Pre-trained Transformer Language Models

facebookresearch/metaseq 2 May 2022

Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning.

Hate Speech Detection Language Modelling +1

0.48 stars / hour

PennyLane: Automatic differentiation of hybrid quantum-classical computations

PennyLaneAI/pennylane 12 Nov 2018

PennyLane is a Python 3 software framework for optimization and machine learning of quantum and hybrid quantum-classical computations.

0.48 stars / hour

Thin-Plate Spline Motion Model for Image Animation

yoyo-nb/thin-plate-spline-motion-model 27 Mar 2022

Firstly, we propose thin-plate spline motion estimation to produce a more flexible optical flow, which warps the feature maps of the source image to the feature domain of the driving image.

Image Animation Motion Estimation +1

0.47 stars / hour

HeadNeRF: A Real-time NeRF-based Parametric Head Model

crishy1995/headnerf 10 Dec 2021

Different from existing related parametric models, we use the neural radiance fields as a novel 3D proxy instead of the traditional 3D textured mesh, which makes that HeadNeRF is able to generate high fidelity images.

Neural Rendering

0.41 stars / hour

GLU Variants Improve Transformer

BlinkDL/RWKV-LM 12 Feb 2020

Gated Linear Units (arXiv:1612. 08083) consist of the component-wise product of two linear projections, one of which is first passed through a sigmoid function.

0.39 stars / hour

Fine-Tuning Language Models from Human Preferences

lvwerra/trl 18 Sep 2019

Most work on reward learning has used simulated environments, but complex information about values is often expressed in natural language, and we believe reward learning for language is a key to making RL practical and safe for real-world tasks.

Language Modelling

0.34 stars / hour

Goal-Guided Neural Cellular Automata: Learning to Control Self-Organising Systems

shyamsn97/controllable-ncas 25 Apr 2022

Inspired by cellular growth and self-organization, Neural Cellular Automata (NCAs) have been capable of "growing" artificial cells into images, 3D structures, and even functional machines.

0.33 stars / hour

DeepDPM: Deep Clustering With an Unknown Number of Clusters

bgu-cs-vil/deepdpm 27 Mar 2022

Using a split/merge framework, a dynamic architecture that adapts to the changing K, and a novel loss, our proposed method outperforms existing nonparametric methods (both classical and deep ones).

Deep Nonparametric Clustering Model Selection +2

0.33 stars / hour

CLIPasso: Semantically-Aware Object Sketching

yael-vinker/CLIPasso 11 Feb 2022

Abstraction is at the heart of sketching due to the simple and minimal nature of line drawings.

0.28 stars / hour

ConvMAE: Masked Convolution Meets Masked Autoencoders

alpha-vl/convmae 8 May 2022

Masked auto-encoding for feature pretraining and multi-scale hybrid convolution-transformer architectures can further unleash the potentials of ViT, leading to state-of-the-art performances on image classification, detection and semantic segmentation.

Image Classification Object Detection +1

0.27 stars / hour