Trending Research
DiffiT: Diffusion Vision Transformers for Image Generation
nvlabs/diffit
•
•
We also introduce latent DiffiT which consists of transformer model with the proposed self-attention layers, for high-resolution image generation.
Ranked #2 on
Image Generation
on ImageNet 256x256
OneLLM: One Framework to Align All Modalities with Language
csuhan/onellm
•
•
In detail, we first train an image projection module to connect a vision encoder with LLM.
Gaussian Grouping: Segment and Edit Anything in 3D Scenes
To address this issue, we propose Gaussian Grouping, which extends Gaussian Splatting to jointly reconstruct and segment anything in open-world 3D scenes.
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
facebookresearch/seamless_communication
•
•
What does it take to create the Babel Fish, a tool that can help individuals translate speech between any two languages?
Automatic Speech Recognition
Speech-to-Speech Translation
+3
RETVec: Resilient and Efficient Text Vectorizer
google-research/retvec
•
•
NeurIPS 2023
The RETVec embedding model is pre-trained using pair-wise metric learning to be robust against typos and character-level adversarial attacks.
GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
skhu101/gauhuman
•
•
We present, GauHuman, a 3D human model with Gaussian Splatting for both fast training (1 ~ 2 minutes) and real-time rendering (up to 189 FPS), compared with existing NeRF-based implicit representation modelling frameworks demanding hours of training and seconds of rendering per frame.
Improving Sample Quality of Diffusion Models Using Self-Attention Guidance
lllyasviel/fooocus
•
•
ICCV 2023
Denoising diffusion models (DDMs) have attracted attention for their exceptional generation quality and diversity.
PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimation
Single image depth estimation is a foundational task in computer vision and generative modeling.
Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models
Additionally, experiments on 18 datasets further demonstrate that Monkey surpasses existing LMMs in many tasks like Image Captioning and various Visual Question Answering formats.
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
epfllm/meditron
•
•
Large language models (LLMs) can potentially democratize access to medical knowledge.
Ranked #1 on
Multiple Choice Question Answering (MCQA)
on MedMCQA
(Dev Set (Acc-%) metric)
Conditional Text Generation
Multiple Choice Question Answering (MCQA)
