Agents: An Open-source Framework for Autonomous Language Agents

aiwaves-cn/agents 14 Sep 2023

Recent advances on large language models (LLMs) enable researchers and developers to build autonomous language agents that can automatically solve various tasks and interact with environments, humans, and other agents using natural language interfaces.

6.55 stars / hour

The Rise and Potential of Large Language Model Based Agents: A Survey

woooodyy/llm-agent-paper-list 14 Sep 2023

Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks.

Language Modelling Large Language Model

5.23 stars / hour

NExT-GPT: Any-to-Any Multimodal LLM

NExT-GPT/NExT-GPT 11 Sep 2023

While recently Multimodal Large Language Models (MM-LLMs) have made exciting strides, they mostly fall prey to the limitation of only input-side multimodal understanding, without the ability to produce content in multiple modalities.

3.93 stars / hour

ProPainter: Improving Propagation and Transformer for Video Inpainting

sczhou/propainter 7 Sep 2023

We also propose a mask-guided sparse video Transformer, which achieves high efficiency by discarding unnecessary and redundant tokens.

Optical Flow Estimation Video Inpainting

2.64 stars / hour

OverFlow: Putting flows on top of neural transducers for better TTS

coqui-ai/TTS 13 Nov 2022

Neural HMMs are a type of neural transducer recently proposed for sequence-to-sequence modelling in text-to-speech.

Ranked #11 on Text-To-Speech Synthesis on LJSpeech (using extra training data)

Normalising Flows Speech Synthesis +1

2.01 stars / hour

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors in Agents

openbmb/agentverse 21 Aug 2023

Autonomous agents empowered by Large Language Models (LLMs) have undergone significant improvements, enabling them to generalize across a broad spectrum of tasks.

1.91 stars / hour

Nougat: Neural Optical Understanding for Academic Documents

facebookresearch/nougat 25 Aug 2023

Scientific knowledge is predominantly stored in books and scientific journals, often in the form of PDFs.

Optical Character Recognition (OCR)

1.44 stars / hour

Communicative Agents for Software Development

openbmb/chatdev 16 Jul 2023

At the core of this paradigm lies ChatDev, a virtual chat-powered software development company that mirrors the established waterfall model, meticulously dividing the development process into four distinct chronological stages: designing, coding, testing, and documenting.

Decision Making

1.39 stars / hour

InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation

gnobitab/instaflow 12 Sep 2023

Leveraging our new pipeline, we create, to the best of our knowledge, the first one-step diffusion-based text-to-image generator with SD-level image quality, achieving an FID (Frechet Inception Distance) of $23. 3$ on MS COCO 2017-5k, surpassing the previous state-of-the-art technique, progressive distillation, by a significant margin ($37. 2$ $\rightarrow$ $23. 3$ in FID).

1.23 stars / hour