LLaMA-Omni: Seamless Speech Interaction with Large Language Models

ictnlp/llama-omni 10 Sep 2024

We build our model based on the latest Llama-3. 1-8B-Instruct model.

Decoder

783
6.95 stars / hour

PaperQA: Retrieval-Augmented Generative Agent for Scientific Research

whitead/paper-qa 8 Dec 2023

We present PaperQA, a RAG agent for answering questions over the scientific literature.

Information Retrieval Question Answering +2

5,206
2.43 stars / hour

Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming

gpt-omni/mini-omni 29 Aug 2024

We also introduce the VoiceAssistant-400K dataset to fine-tune models optimized for speech output.

Speech Synthesis

2,361
2.02 stars / hour

MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery

qhjqhj00/memorag 9 Sep 2024

Retrieval-Augmented Generation (RAG) leverages retrieval tools to access external databases, thereby enhancing the generation quality of large language models (LLMs) through optimized context.

Memorization Question Answering +2

298
2.00 stars / hour

GeoCalib: Learning Single-image Calibration with Geometric Optimization

cvg/geocalib 10 Sep 2024

This single-image calibration can benefit various downstream applications like image editing and 3D mapping.

3D geometry Visual Localization

109
1.95 stars / hour

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

openbmb/minicpm 9 Apr 2024

For data scaling, we introduce a Warmup-Stable-Decay (WSD) learning rate scheduler (LRS), conducive to continuous training and domain adaptation.

Domain Adaptation

6,758
1.72 stars / hour

SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning

lamm-mit/SciAgentsDiscovery 9 Sep 2024

A key challenge in artificial intelligence is the creation of systems capable of autonomously advancing scientific understanding by exploring novel domains, identifying complex patterns, and uncovering previously unseen connections in vast scientific data.

Knowledge Graphs scientific discovery

115
1.68 stars / hour

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers

NoviScl/AI-Researcher 6 Sep 2024

Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas.

Experimental Design scientific discovery

154
1.65 stars / hour

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

THUDM/LongCite 4 Sep 2024

Though current long-context large language models (LLMs) have demonstrated impressive capacities in answering user questions based on extensive text, the lack of citations in their responses makes user verification difficult, leading to concerns about their trustworthiness due to their potential hallucinations.

Question Answering Sentence

212
1.51 stars / hour

iText2KG: Incremental Knowledge Graphs Construction Using Large Language Models

AuvaLab/itext2kg 5 Sep 2024

Our method demonstrates superior performance compared to baseline methods across three scenarios: converting scientific papers to graphs, websites to graphs, and CVs to graphs.

Few-Shot Learning Information Retrieval +5

284
1.34 stars / hour