Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation

1 code implementation • 21 Feb 2024 • Phuc Phan, Hieu Tran, Long Phan

We propose a straightforward approach called Distillation Contrastive Decoding (DCD) to enhance the reasoning capabilities of Large Language Models (LLMs) during inference.

Arithmetic Reasoning GSM8K +3