Search Results for author:
Found 5 papers, 0 papers with code
On Speculative Decoding for Multimodal Large Language Models
We show that a language-only model can serve as a good draft model for speculative decoding with LLaVA 7B, bypassing the need for image tokens and their associated processing components from the draft model.
Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
In this paper, we propose a simple draft model training framework for direct alignment to chat-capable target models.
Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement
We empirically evaluate RSD with Llama 2 and OPT models, showing that RSD outperforms the baseline methods, consistently for fixed draft sequence length and in most cases for fixed computational budgets at LLM.
Motion Informed Needle Segmentation in Ultrasound Images
Third, to our knowledge we are the first to implement a learnable filter to incorporate non-linear needle motion for improving needle segmentation.
Composite Adaptive Control for Time-varying Systems with Dual Adaptation
This paper proposes a composite adaptive control architecture using dual adaptation scheme for dynamical systems comprising time-varying uncertain parameters.
