Trending Research
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
In this work, we unify visual representation into the language feature space to advance the foundational LLM towards a unified LVLM.
Ranked #1 on
Zero-Shot Video Question Answer
on MSVD-QA
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
stability-ai/generative-models
•
•
We then explore the impact of finetuning our base model on high-quality data and train a text-to-video model that is competitive with closed-source video generation.
Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models
We present a method to create interpretable concept sliders that enable precise control over attributes in image generations from diffusion models.
Efficient LLM Inference on CPUs
intel/intel-extension-for-transformers
•
•
Large language models (LLMs) have demonstrated remarkable performance and tremendous potential across a wide range of tasks.
Exponentially Faster Language Modelling
Language models only really need to use an exponential fraction of their neurons for individual inferences.
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
yl4579/StyleTTS2
•
•
In this paper, we present StyleTTS 2, a text-to-speech (TTS) model that leverages style diffusion and adversarial training with large speech language models (SLMs) to achieve human-level TTS synthesis.
LCM-LoRA: A Universal Stable-Diffusion Acceleration Module
luosiallen/latent-consistency-model
•
•
Latent Consistency Models (LCMs) have achieved impressive performance in accelerating text-to-image generative tasks, producing high-quality images with minimal inference steps.
HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis
Furthermore, we significantly improve the naturalness and speaker similarity of synthetic speech even in zero-shot speech synthesis scenarios.
MagicDance: Realistic Human Dance Video Generation with Motions & Facial Expressions Transfer
In this work, we propose MagicDance, a diffusion-based model for 2D human motion and facial expression transfer on challenging human dance videos.
CogVLM: Visual Expert for Pretrained Language Models
thudm/cogvlm
•
•
We introduce CogVLM, a powerful open-source visual language foundation model.
Ranked #3 on
Visual Question Answering (VQA)
on CORE-MM
