Trending Research
Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance
fudan-generative-vision/champ
•
•
In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques.
SCEdit: Efficient and Controllable Image Diffusion Generation via Skip Connection Editing
modelscope/swift
•
•
CVPR 2024
Image diffusion models have been utilized in various tasks, such as text-to-image generation and controllable image synthesis.
EFM3D: A Benchmark for Measuring Progress Towards 3D Egocentric Foundation Models
The advent of wearable computers enables a new source of context for AI that is embedded in egocentric sensor data.
Ranked #1 on
3D Reconstruction
on Aria Synthetic Environments
LLaMA-Omni: Seamless Speech Interaction with Large Language Models
We build our model based on the latest Llama-3. 1-8B-Instruct model.
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
modeltc/llmc
•
•
In this paper, we present LLMC, a plug-and-play compression toolkit, to fairly and systematically explore the impact of quantization.
ControlAR: Controllable Image Generation with Autoregressive Models
Firstly, we explore control encoding for AR models and propose a lightweight control encoder to transform spatial inputs (e. g., canny edges or depth maps) into control tokens.
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
whb139426/grounded-video-llm
•
•
Video Large Language Models (Video-LLMs) have demonstrated remarkable capabilities in coarse-grained video understanding, however, they struggle with fine-grained temporal grounding.
Autoregressive Action Sequence Learning for Robotic Manipulation
mlzxy/arp
•
•
We propose the Chunking Causal Transformer (CCT), which extends the next-single-token prediction of causal transformers to support multi-token prediction in a single pass.
Ranked #1 on
Robot Manipulation
on RLBench
FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
The rapid development of generative AI is a double-edged sword, which not only facilitates content creation but also makes image manipulation easier and more difficult to detect.
QAEncoder: Towards Aligned Representation Learning in Question Answering System
Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses.
