Search Results for author: Zhuoran Song

Found 7 papers, 2 papers with code

Accelerating 3D Gaussian Splatting with Neural Sorting and Axis-Oriented Rasterization

no code implementations8 Jun 2025 Zhican Wang, Guanghui He, Dantong Liu, Lingjun Gao, Shell Xu Hu, Chen Zhang, Zhuoran Song, Nicholas Lane, Wayne Luk, Hongxiang Fan

3D Gaussian Splatting (3DGS) has recently gained significant attention for high-quality and efficient view synthesis, making it widely adopted in fields such as AR/VR, robotics, and autonomous driving.

3DGS Autonomous Driving +1

Accelerating Prefilling for Long-Context LLMs via Sparse Pattern Sharing

no code implementations26 May 2025 Dan Peng, Zhihui Fu, Zewen Ye, Zhuoran Song, Jun Wang

Sparse attention methods exploit the inherent sparsity in attention to speed up the prefilling phase of long-context inference, mitigating the quadratic complexity of full attention computation.

Scaling Laws for Speculative Decoding

no code implementations8 May 2025 Siyuan Yan, Mo Zhu, Guo-qing Jiang, Jianfei Wang, Jiaxing Chen, Wentai Zhang, Xiang Liao, Xiao Cui, Chen Zhang, Zhuoran Song, Ran Zhu

The escalating demand for efficient decoding in large language models (LLMs) is particularly critical for reasoning-intensive architectures like OpenAI-o3 and DeepSeek-R1, which depend on extended chain-of-thought reasoning.

DNN Training Acceleration via Exploring GPGPU Friendly Sparsity

no code implementations11 Mar 2022 Zhuoran Song, Yihong Xu, Han Li, Naifeng Jing, Xiaoyao Liang, Li Jiang

The training phases of Deep neural network~(DNN) consumes enormous processing time and energy.

CP-ViT: Cascade Vision Transformer Pruning via Progressive Sparsity Prediction

1 code implementation9 Mar 2022 Zhuoran Song, Yihong Xu, Zhezhi He, Li Jiang, Naifeng Jing, Xiaoyao Liang

We explore the sparsity in ViT and observe that informative patches and heads are sufficient for accurate image recognition.

Invocation-driven Neural Approximate Computing with a Multiclass-Classifier and Multiple Approximators

1 code implementation19 Oct 2018 Haiyue Song, Chengwen Xu, Qiang Xu, Zhuoran Song, Naifeng Jing, Xiaoyao Liang, Li Jiang

We thus propose a novel approximate computing architecture with a Multiclass-Classifier and Multiple Approximators (MCMA).

Approximate Random Dropout

no code implementations23 May 2018 Zhuoran Song, Ru Wang, Dongyu Ru, Hongru Huang, Zhenghao Peng, Jing Ke, Xiaoyao Liang, Li Jiang

In this paper, we propose the Approximate Random Dropout that replaces the conventional random dropout of neurons and synapses with a regular and predefined patterns to eliminate the unnecessary computation and data access.

Cannot find the paper you are looking for? You can Submit a new open access paper.