Search Results for author:
Found 2 papers, 0 papers with code
ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
Additionally, it introduces a dynamic token tree generation algorithm to balance the computation and parallelism of the verification phase in real-time and maximize the overall efficiency across different batch sizes, sequence lengths, and tasks, etc.
Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization
Memory-aware network scheduling is becoming increasingly important for deep neural network (DNN) inference on resource-constrained devices.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
