Search Results for author: Jinzhang Peng

Found 9 papers, 1 papers with code

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing

no code implementations16 Dec 2024 Zekai Li, Jintu Zheng, Ji Liu, Han Liu, Haowei Zhu, Zeping Li, Fuwei Yang, Haiduo Huang, Jinzhang Peng, Dong Li, Lu Tian, Emad Barsoum

To address these issues, we propose a fine-grained token-wise pruning approach for the LLMs, which presents a learnable router to adaptively identify the less important tokens and skip them across model blocks to reduce computational cost during inference.

Fast Occupancy Network

no code implementations10 Dec 2024 Mingjie Lu, Yuanxian Huang, Ji Liu, Xingliang Huang, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum

To address this problem, we make an analysis of the bottleneck of Occupancy Network inference cost, and present a simple and fast Occupancy Network model, which adopts a deformable 2D convolutional layer to lift BEV feature to 3D voxel feature and presents an efficient voxel feature pyramid network (FPN) module to improve performance with few computational cost.

Autonomous Driving

Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference

no code implementations19 Jun 2024 Zeping Li, Xinlong Yang, Ziheng Gao, Ji Liu, Guanchen Li, Zhuang Liu, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum

On MT-Bench, Amphista delivers up to 2. 75$\times$ speedup over vanilla autoregressive decoding and 1. 40$\times$ over Medusa on Vicuna 33B in wall-clock time.

Sparse Laneformer

no code implementations11 Apr 2024 Ji Liu, Zifeng Zhang, Mingjie Lu, Hongyang Wei, Dong Li, Yile Xie, Jinzhang Peng, Lu Tian, Ashish Sirasao, Emad Barsoum

We analyze that dense anchors are not necessary for lane detection, and propose a transformer-based lane detection framework based on a sparse anchor mechanism.

Autonomous Driving Lane Detection

Separated RoadTopoFormer

no code implementations4 Jul 2023 Mingjie Lu, Yuanxian Huang, Ji Liu, Jinzhang Peng, Lu Tian, Ashish Sirasao

Previous works such as map learning and BEV lane detection neglect the connection relationship between lane instances, and traffic elements detection tasks usually neglect the relationship with lane lines.

3D Lane Detection Autonomous Driving

Cross-Dataset Collaborative Learning for Semantic Segmentation in Autonomous Driving

no code implementations21 Mar 2021 Li Wang, Dong Li, Han Liu, Jinzhang Peng, Lu Tian, Yi Shan

Our goal is to train a unified model for improving the performance in each dataset by leveraging information from all the datasets.

3D Semantic Segmentation Autonomous Driving +3

Cannot find the paper you are looking for? You can Submit a new open access paper.