YerevaNN’s Systems for WMT20 Biomedical Translation Task: The Effect of Fixing Misaligned Sentence Pairs

no code implementations • WMT (EMNLP) 2020 • Karen Hambardzumyan, Hovhannes Tamoyan, Hrant Khachatrian

This report describes YerevaNN’s neural machine translation systems and data processing pipelines developed for WMT20 biomedical translation task.

Machine Translation Sentence +1

LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models

1 code implementation • 10 Apr 2024 • Igor Tufanov, Karen Hambardzumyan, Javier Ferrando, Elena Voita

We present the LM Transparency Tool (LM-TT), an open-source interactive toolkit for analyzing the internal workings of Transformer-based language models.

Decision Making

Scaling Laws for Generative Mixed-Modal Language Models

no code implementations • 10 Jan 2023 • Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

To better understand the scaling properties of such mixed-modal models, we conducted over 250 experiments using seven different modalities and model sizes ranging from 8 million to 30 billion, trained on 5-100 billion tokens.

BARTSmiles: Generative Masked Language Models for Molecular Representations

1 code implementation • 29 Nov 2022 • Gayane Chilingaryan, Hovhannes Tamoyan, Ani Tevosyan, Nelly Babayan, Lusine Khondkaryan, Karen Hambardzumyan, Zaven Navoyan, Hrant Khachatrian, Armen Aghajanyan

We then quantitatively show that when applied to the molecular domain, the BART objective learns representations that implicitly encode our downstream tasks of interest.

WARP: Word-level Adversarial ReProgramming

1 code implementation • ACL 2021 • Karen Hambardzumyan, Hrant Khachatrian, Jonathan May

Transfer learning from pretrained language models recently became the dominant approach for solving many NLP tasks.

Language Modelling Transfer Learning +1

BioRelEx 1.0: Biological Relation Extraction Benchmark

1 code implementation • WS 2019 • Hrant Khachatrian, Lilit Nersisyan, Karen Hambardzumyan, Tigran Galstyan, Anna Hakobyan, Arsen Arakelyan, Andrey Rzhetsky, Aram Galstyan

Automatic extraction of relations and interactions between biological entities from scientific literature remains an extremely challenging problem in biomedical information extraction and natural language processing in general.

Relation Relation Extraction

Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks

1 code implementation • CONLL 2018 • Gor Arakelyan, Karen Hambardzumyan, Hrant Khachatrian

This paper describes our submission to CoNLL 2018 UD Shared Task.

Dependency Parsing Lemmatization +3

Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report

1 code implementation • 9 Feb 2018 • Martin Mirakyan, Karen Hambardzumyan, Hrant Khachatrian

We have tried to reproduce the results of the paper "Natural Language Inference over Interaction Space" submitted to ICLR 2018 conference as part of the ICLR 2018 Reproducibility Challenge.

Model Selection Natural Language Inference

Technical Report on the CleverHans v2.1.0 Adversarial Examples Library

13 code implementations • 3 Oct 2016 • Nicolas Papernot, Fartash Faghri, Nicholas Carlini, Ian Goodfellow, Reuben Feinman, Alexey Kurakin, Cihang Xie, Yash Sharma, Tom Brown, Aurko Roy, Alexander Matyasko, Vahid Behzadan, Karen Hambardzumyan, Zhishuai Zhang, Yi-Lin Juang, Zhi Li, Ryan Sheatsley, Abhibhav Garg, Jonathan Uesato, Willi Gierke, Yinpeng Dong, David Berthelot, Paul Hendricks, Jonas Rauber, Rujun Long, Patrick McDaniel

An adversarial example library for constructing attacks, building defenses, and benchmarking both

Adversarial Attack Adversarial Defense +1