Trending Research
LLaMA-Omni: Seamless Speech Interaction with Large Language Models
We build our model based on the latest Llama-3. 1-8B-Instruct model.
OmniGen: Unified Image Generation
In this work, we introduce OmniGen, a new diffusion model for unified image generation.
Kolmogorov-Arnold Transformer
Adamdad/kat
•
•
In this paper, we introduce the Kolmogorov-Arnold Transformer (KAT), a novel architecture that replaces MLP layers with Kolmogorov-Arnold Network (KAN) layers to enhance the expressiveness and performance of the model.
PuLID: Pure and Lightning ID Customization via Contrastive Alignment
We propose Pure and Lightning ID customization (PuLID), a novel tuning-free ID customization method for text-to-image generation.
Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization
In many modern LLM applications, such as retrieval augmented generation, prompts have become programs themselves.
Breaking reCAPTCHAv2
aplesner/Breaking-reCAPTCHAv2
•
•
Our work examines the efficacy of employing advanced machine learning methods to solve captchas from Google's reCAPTCHAv2 system.
GeoCalib: Learning Single-image Calibration with Geometric Optimization
cvg/geocalib
•
•
This single-image calibration can benefit various downstream applications like image editing and 3D mapping.
OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs
zjunlp/onegen
•
•
This paper introduces a novel and efficient One-pass Generation and retrieval framework (OneGen), designed to improve LLMs' performance on tasks that require both generation and retrieval.
Wings: Learning Multimodal LLMs without Text-only Forgetting
aidc-ai/ovis
•
•
Initially, image and text inputs are aligned with visual learners operating alongside the main attention, balancing focus on visual elements.
