Trending Research
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
shi-labs/cumo
•
•
Recent advancements in Multimodal Large Language Models (LLMs) have focused primarily on scaling by increasing text-image pair data and enhancing LLMs to improve performance on multimodal tasks.
Ranked #1 on
Visual Question Answering
on MMBench
(GPT-3.5 score metric)
WavCraft: Audio Editing and Generation with Large Language Models
We introduce WavCraft, a collective system that leverages large language models (LLMs) to connect diverse task-specific models for audio content creation and editing.
How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites
Compared to both open-source and proprietary models, InternVL 1. 5 shows competitive performance, achieving state-of-the-art results in 8 of 18 benchmarks.
Ranked #6 on
Visual Question Answering
on MM-Vet
VILA: On Pre-training for Visual Language Models
efficient-large-model/vila
•
•
Visual language models (VLMs) rapidly progressed with the recent success of large language models.
Ranked #24 on
Visual Question Answering
on MM-Vet
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
Proprietary LMs such as GPT-4 are often employed to assess the quality of responses from various LMs.
Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation
nust-machine-intelligence-laboratory/hvc
•
•
To achieve this objective, we present a unified self-supervised approach to learn visual representations of static-dynamic feature similarity.
Make Your LLM Fully Utilize the Context
While many contemporary large language models (LLMs) can process lengthy input, they still struggle to fully utilize information within the long context, known as the lost-in-the-middle challenge.
AIOS: LLM Agent Operating System
Inspired by these challenges, this paper presents AIOS, an LLM agent operating system, which embeds large language model into operating systems (OS) as the brain of the OS, enabling an operating system "with soul" -- an important step towards AGI.
QLoRA: Efficient Finetuning of Quantized LLMs
internlm/xtuner
•
•
NeurIPS 2023
Our best model family, which we name Guanaco, outperforms all previous openly released models on the Vicuna benchmark, reaching 99. 3% of the performance level of ChatGPT while only requiring 24 hours of finetuning on a single GPU.
AlphaMath Almost Zero: process Supervision without process
We proceed to train a step-level value model designed to improve the LLM's inference process in mathematical domains.
