Search Results for author: Qinyuan Ren

Found 4 papers, 0 papers with code

GPTQT: Quantize Large Language Models Twice to Push the Efficiency

no code implementations3 Jul 2024 Yipin Guo, Yilin Lang, Qinyuan Ren

Compared to the strong 3-bit quantization baseline, GPTQT further reduces perplexity by 4. 01 on opt-66B and increases speed by 1. 24 times on opt-30b.

Quantization

ShiftAddAug: Augment Multiplication-Free Tiny Neural Network with Hybrid Computation

no code implementations3 Jul 2024 Yipin Guo, Zihao Li, Yilin Lang, Qinyuan Ren

Remarkably, it secures up to a 4. 95% increase in accuracy on the CIFAR100 compared to its directly trained counterparts, even surpassing the performance of multiplicative NNs.

image-classification Image Classification +2

Efficient Fusion and Task Guided Embedding for End-to-end Autonomous Driving

no code implementations3 Jul 2024 Yipin Guo, Yilin Lang, Qinyuan Ren

To address the challenges of sensor fusion and safety risk prediction, contemporary closed-loop autonomous driving neural networks leveraging imitation learning typically require a substantial volume of parameters and computational resources to run neural networks.

Autonomous Driving Decoder +2

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding

no code implementations29 Aug 2023 Xinyi Chen, Jibin Wu, Huajin Tang, Qinyuan Ren, Kay Chen Tan

The human brain exhibits remarkable abilities in integrating temporally distant sensory inputs for decision-making.

Decision Making

Cannot find the paper you are looking for? You can Submit a new open access paper.