Search Results for author: Mantas Lukoševičius

Found 13 papers, 7 papers with code

Extracting Sentence Embeddings from Pretrained Transformer Models

no code implementations15 Aug 2024 Lukas Stankevičius, Mantas Lukoševičius

We also evaluate our representation-shaping techniques on other static models, including random token representations.

Clustering Retrieval-augmented Generation +6

Inference acceleration for large language models using "stairs" assisted greedy generation

no code implementations29 Jul 2024 Domas Grigaliūnas, Mantas Lukoševičius

It is a modified assisted generation methodology that makes use of a smaller model's fast generation, large model's batch prediction, and "stairs" validation in order to achieve a speed up in prediction generation.

Prediction Text Generation

Sentiment Analysis of Lithuanian Online Reviews Using Large Language Models

no code implementations29 Jul 2024 Brigita Vileikytė, Mantas Lukoševičius, Lukas Stankevičius

Despite this, the task remains challenging because of the inherent complexity of languages and the subjective nature of sentiments.

Sentiment Analysis

Optimizing Large Language Models for OpenAPI Code Completion

2 code implementations24 May 2024 Bohdan Petryshyn, Mantas Lukoševičius

This study evaluates the OpenAPI completion performance of GitHub Copilot, a prevalent commercial code completion tool, and proposes a set of task-specific optimizations leveraging Meta's open-source model Code Llama.

Code Generation OpenAPI code completion +1

Task-Synchronized Recurrent Neural Networks

1 code implementation11 Apr 2022 Mantas Lukoševičius, Arnas Uselis

We propose an elegant straightforward alternative approach where instead the RNN is in effect resampled in time to match the time of the data or the task at hand.

Towards Lithuanian grammatical error correction

1 code implementation18 Mar 2022 Lukas Stankevičius, Mantas Lukoševičius

Everyone wants to write beautiful and correct text, yet the lack of language skills, experience, or hasty typing can result in errors.

Grammatical Error Correction

Automated age-related macular degeneration area estimation -- first results

no code implementations5 Jul 2021 Rokas Pečiulis, Mantas Lukoševičius, Algimantas Kriščiukaitis, Robertas Petrolis, Dovilė Buteikienė

This work aims to research an automatic method for detecting Age-related Macular Degeneration (AMD) lesions in RGB eye fundus images.

Diagnostic

Generating abstractive summaries of Lithuanian news articles using a transformer model

1 code implementation23 Apr 2021 Lukas Stankevičius, Mantas Lukoševičius

In this work, we train the first monolingual Lithuanian transformer model on a relatively large corpus of Lithuanian news articles and compare various output decoding algorithms for abstractive news summarization.

Articles News Summarization

Efficient implementations of echo state network cross-validation

1 code implementation19 Jun 2020 Mantas Lukoševičius, Arnas Uselis

The second level of optimization also makes the (ii) part remain constant irrespective of large $k$, as long as the dimension of the output is low.

One-Shot Learning Time Series +1

Localized convolutional neural networks for geospatial wind forecasting

1 code implementation12 May 2020 Arnas Uselis, Mantas Lukoševičius, Lukas Stasytis

They can be added to any convolutional layers, easily end-to-end trained, introduce minimal additional complexity, and let CNNs retain most of their benefits to the extent that they are needed.

Translation

Testing pre-trained Transformer models for Lithuanian news clustering

no code implementations3 Apr 2020 Lukas Stankevičius, Mantas Lukoševičius

A recent introduction of Transformer deep learning architecture made breakthroughs in various natural language processing tasks.

Clustering XLM-R

Efficient Cross-Validation of Echo State Networks

1 code implementation22 Aug 2019 Mantas Lukoševičius, Arnas Uselis

Thus in many situations $k$-fold cross-validation of ESNs can be done for virtually the same time complexity as a simple single split validation.

One-Shot Learning Time Series +1

Cannot find the paper you are looking for? You can Submit a new open access paper.