Search Results for author:
Found 6 papers, 5 papers with code
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
We introduce Cambrian-1, a family of multimodal LLMs (MLLMs) designed with a vision-centric approach.
Image Sculpting: Precise Object Editing with 3D Geometry Control
We present Image Sculpting, a new framework for editing 2D images by incorporating tools from 3D geometry and graphics.
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
These limitations keep them far from the ultimate goal of "image as a foreign language in image generation."
Learning Temporal Distribution and Spatial Correlation Towards Universal Moving Object Segmentation
In this paper, we propose a method called Learning Temporal Distribution and Spatial Correlation (LTS) that has the potential to be a general solution for universal moving object segmentation.
Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models
Conditioned diffusion models have demonstrated state-of-the-art text-to-image synthesis capacity.
Ranked #1 on
Story Continuation
on VIST
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
In particular, audio and visual front-ends are trained on large-scale unimodal datasets, then we integrate components of both front-ends into a larger multimodal framework which learns to recognize parallel audio-visual data into characters through a combination of CTC and seq2seq decoding.
Ranked #2 on
Automatic Speech Recognition (ASR)
on LRS2
Audio-Visual Speech Recognition
Automatic Speech Recognition (ASR)
+7
