no code implementations • 3 Jul 2024 • Yipin Guo, Yilin Lang, Qinyuan Ren
Compared to the strong 3-bit quantization baseline, GPTQT further reduces perplexity by 4. 01 on opt-66B and increases speed by 1. 24 times on opt-30b.
no code implementations • 3 Jul 2024 • Yipin Guo, Zihao Li, Yilin Lang, Qinyuan Ren
Remarkably, it secures up to a 4. 95% increase in accuracy on the CIFAR100 compared to its directly trained counterparts, even surpassing the performance of multiplicative NNs.
no code implementations • 3 Jul 2024 • Yipin Guo, Yilin Lang, Qinyuan Ren
To address the challenges of sensor fusion and safety risk prediction, contemporary closed-loop autonomous driving neural networks leveraging imitation learning typically require a substantial volume of parameters and computational resources to run neural networks.
no code implementations • 29 Aug 2023 • Xinyi Chen, Jibin Wu, Huajin Tang, Qinyuan Ren, Kay Chen Tan
The human brain exhibits remarkable abilities in integrating temporally distant sensory inputs for decision-making.