Trending Research
Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
bytedance/flux
•
•
The inter-device communication of a MoE layer can occupy 47% time of the entire model execution with popular models and frameworks.
Self-rewarding correction for mathematical reasoning
volcengine/verl
•
•
We study self-rewarding reasoning large language models (LLMs), which can simultaneously generate step-by-step reasoning and evaluate the correctness of their outputs during the inference time-without external feedback.
Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs).
Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Models
We present Attentive Reasoning Queries (ARQs), a novel structured reasoning approach that significantly improves instruction-following in Large Language Models through domain-specialized reasoning blueprints.
LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL
tidedra/lmm-r1
•
•
Enhancing reasoning in Large Multimodal Models (LMMs) faces unique challenges from the complex interplay between visual perception and logical reasoning, particularly in compact 3B-parameter architectures where architectural constraints limit reasoning capacity and modality alignment.
ELIZA Reanimated: The world's first chatbot restored on the world's first time sharing system
The entire stack is open source, so that any user of a unix-like OS can run the world's first chatbot on the world's first time-sharing system.
HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation
To effectively learn the HealthGPT, we devise a comprehensive medical domain-specific comprehension and generation dataset called VL-Health.
2 OLMo 2 Furious
Our modified model architecture and training recipe achieve both better training stability and improved per-token efficiency.
GENERator: A Long-Context Generative Genomic Foundation Model
Recent developments in genomic language models have underscored the potential of LLMs in deciphering DNA sequences.
VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control
Video inpainting, which aims to restore corrupted video content, has experienced substantial progress.
