UniMem: Towards a Unified View of Long-Context Large Language Models

no code implementations • 5 Feb 2024 • Junjie Fang, Likai Tang, Hongzhe Bi, Yujia Qin, Si Sun, Zhenyu Li, Haolun Li, Yongjian Li, Xin Cong, Yukun Yan, Xiaodong Shi, Sen Song, Yankai Lin, Zhiyuan Liu, Maosong Sun

Although there exist various methods devoted to enhancing the long-context processing ability of large language models (LLMs), they are developed in an isolated manner and lack systematic analysis and integration of their strengths, hindering further developments.

Management

Brain-Like Replay Naturally Emerges in Reinforcement Learning Agents

no code implementations • 2 Feb 2024 • Jiyi Wang, Likai Tang, Huimiao Chen, Sen Song

Can replay, as a widely observed neural activity pattern in brain regions, particularly in the hippocampus and neocortex, emerge in an artificial agent?

Hippocampus reinforcement-learning