Search Results for author: Pedro Henrique Martins

Found 9 papers, 5 papers with code

\infty-former: Infinite Memory Transformer

1 code implementation ACL 2022 Pedro Henrique Martins, Zita Marinho, Andre Martins

Transformers are unable to model long-term memories effectively, since the amount of computation they need to perform grows with the context length.

Dialogue Generation Language Modelling

Chunk-based Nearest Neighbor Machine Translation

no code implementations24 May 2022 Pedro Henrique Martins, Zita Marinho, André F. T. Martins

Experiments on machine translation in two settings, static domain adaptation and ``on-the-fly'' adaptation, show that the chunk-based $k$NN-MT model leads to a significant speed-up (up to 4 times) with only a small drop in translation quality.

Domain Adaptation Language Modelling +2

Efficient Machine Translation Domain Adaptation

1 code implementation SpaNLP (ACL) 2022 Pedro Henrique Martins, Zita Marinho, André F. T. Martins

On the other hand, semi-parametric models have been shown to successfully perform domain adaptation by retrieving examples from an in-domain datastore (Khandelwal et al., 2021).

Domain Adaptation Language Modelling +2

$\infty$-former: Infinite Memory Transformer

1 code implementation1 Sep 2021 Pedro Henrique Martins, Zita Marinho, André F. T. Martins

Transformers are unable to model long-term memories effectively, since the amount of computation they need to perform grows with the context length.

Dialogue Generation Language Modelling

Sparse Text Generation

1 code implementation EMNLP 2020 Pedro Henrique Martins, Zita Marinho, André F. T. Martins

Current state-of-the-art text generators build on powerful language models such as GPT-2, achieving impressive performance.

Dialogue Generation Language Modelling +1

Sparse and Structured Visual Attention

1 code implementation13 Feb 2020 Pedro Henrique Martins, Vlad Niculae, Zita Marinho, André Martins

Visual attention mechanisms are widely used in multimodal tasks, as visual question answering (VQA).

Image Captioning Question Answering +2

Joint Learning of Named Entity Recognition and Entity Linking

no code implementations ACL 2019 Pedro Henrique Martins, Zita Marinho, André F. T. Martins

Named entity recognition (NER) and entity linking (EL) are two fundamentally related tasks, since in order to perform EL, first the mentions to entities have to be detected.

Entity Linking Multi-Task Learning +3

A deep learning approach for understanding natural language commands for mobile service robots

no code implementations9 Jul 2018 Pedro Henrique Martins, Luís Custódio, Rodrigo Ventura

Using natural language to give instructions to robots is challenging, since natural language understanding is still largely an open problem.

Action Detection Intent Detection +2

Cannot find the paper you are looking for? You can Submit a new open access paper.