Search Results for author: Petros Karypis

Found 4 papers, 1 papers with code

Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization

1 code implementation17 Apr 2024 Costas Mavromatis, Petros Karypis, George Karypis

PackLLM performs model fusion by solving an optimization problem for determining each LLM's importance, so that perplexity over the input prompt is minimized.

SemPool: Simple, robust, and interpretable KG pooling for enhancing language models

no code implementations3 Feb 2024 Costas Mavromatis, Petros Karypis, George Karypis

Our method, termed SemPool, represents KG facts with pre-trained LMs, learns to aggregate their semantic information, and fuses it at different layers of the LM.

Question Answering

Extending Input Contexts of Language Models through Training on Segmented Sequences

no code implementations23 Oct 2023 Petros Karypis, Julian McAuley, George Karypis

Our method benefits both models trained with absolute positional embeddings, by extending their input contexts, as well as popular relative positional embedding methods showing a reduced perplexity on sequences longer than they were trained on.

Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models

no code implementations4 Oct 2023 An Yan, Yu Wang, Yiwu Zhong, Zexue He, Petros Karypis, Zihan Wang, chengyu dong, Amilcare Gentili, Chun-Nan Hsu, Jingbo Shang, Julian McAuley

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients.

Image Classification Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.