INT2.1: Towards Fine-Tunable Quantized Large Language Models with Error Correction through Low-Rank Adaptation

1 code implementation • 13 Jun 2023 • Yuji Chai, John Gkountouras, Glenn G. Ko, David Brooks, Gu-Yeon Wei

We introduce a method that dramatically reduces fine-tuning VRAM requirements and rectifies quantization errors in quantized Large Language Models.

Language Modelling Large Language Model +1

VISION DIFFMASK: Faithful Interpretation of Vision Transformers with Differentiable Patch Masking

1 code implementation • 13 Apr 2023 • Angelos Nalmpantis, Apostolos Panagiotopoulos, John Gkountouras, Konstantinos Papakostas, Wilker Aziz

The lack of interpretability of the Vision Transformer may hinder its use in critical real-world applications despite its effectiveness.