World Model on Million-Length Video And Language With RingAttention

LargeWorldModel/LWM 13 Feb 2024

This work paves the way for training on massive datasets of long video and language to develop understanding of both human knowledge and the multimodal world, and broader capabilities.

Video Understanding

5,567
6.48 stars / hour

UFO: A UI-Focused Agent for Windows OS Interaction

microsoft/UFO 8 Feb 2024

We introduce UFO, an innovative UI-Focused agent to fulfill user requests tailored to applications on Windows OS, harnessing the capabilities of GPT-Vision.

Navigate

1,806
4.65 stars / hour

Scalable Diffusion Models with Transformers

facebookresearch/DiT ICCV 2023

We explore a new class of diffusion models based on the transformer architecture.

Image Generation

3,573
4.42 stars / hour

Revisiting Feature Prediction for Learning Visual Representations from Video

facebookresearch/jepa arXiv preprint 2024

This paper explores feature prediction as a stand-alone objective for unsupervised learning from video and introduces V-JEPA, a collection of vision models trained solely using a feature prediction objective, without the use of pretrained image encoders, text, negative examples, reconstruction, or other sources of supervision.

1,438
4.13 stars / hour

Neural Network Diffusion

nus-hpc-ai-lab/neural-network-diffusion 20 Feb 2024

The autoencoder extracts latent representations of a subset of the trained network parameters.

Video Generation

194
2.94 stars / hour

FiT: Flexible Vision Transformer for Diffusion Model

whlzy/fit 19 Feb 2024

Nature is infinitely resolution-free.

Image Cropping

151
2.56 stars / hour

GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting

GaussianObject/GaussianObject 15 Feb 2024

Then we construct a Gaussian repair model based on diffusion models to supplement the omitted object information, where Gaussians are further refined.

Object

348
2.48 stars / hour

YOLO-World: Real-Time Open-Vocabulary Object Detection

ailab-cvc/yolo-world 30 Jan 2024

The You Only Look Once (YOLO) series of detectors have established themselves as efficient and practical tools.

Instance Segmentation Language Modelling +4

2,102
2.03 stars / hour

DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows

datadreamer-dev/datadreamer 16 Feb 2024

The rapid rise to prominence of these models and these unique challenges has had immediate adverse impacts on open science and on the reproducibility of work that uses them.

Synthetic Data Generation

358
1.43 stars / hour

DoRA: Weight-Decomposed Low-Rank Adaptation

catid/dora 14 Feb 2024

By employing DoRA, we enhance both the learning capacity and training stability of LoRA while avoiding any additional inference overhead.

187
1.31 stars / hour