no code implementations • 20 Nov 2024 • Zhicong Li, Jiahao Wang, Zhishu Jiang, Hangyu Mao, Zhongxia Chen, Jiazhen Du, Yuanxing Zhang, Fuzheng Zhang, Di Zhang, Yong liu
In this paper, we introduce DMQR-RAG, a Diverse Multi-Query Rewriting framework designed to improve the performance of both document retrieval and final responses in RAG.
no code implementations • 4 Oct 2024 • Ruifeng Ren, Zhicong Li, Yong liu
In this context, Mamba has gradually attracted attention due to its constant-level size during inference and existing empirical results have shown that it can perform comparably to Transformers in sequence modeling while offering significant savings.
1 code implementation • 17 Oct 2023 • Wei Yao, Zhanke Zhou, Zhicong Li, Bo Han, Yong liu
To mitigate such bias while achieving comparable accuracy, a promising approach is to introduce surrogate functions of the concerned fairness definition and solve a constrained optimization problem.
1 code implementation • CVPR 2023 • Pengwei Tang, Wei Yao, Zhicong Li, Yong liu
We randomly initialize a dense neural network and find appropriate binary masks for the weights to obtain fair sparse subnetworks without any weight training.