ELMo

Introduced by Peters et al. in Deep contextualized word representations

Embeddings from Language Models, or ELMo, is a type of deep contextualized word representation that models both (1) complex characteristics of word use (e.g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i.e., to model polysemy). Word vectors are learned functions of the internal states of a deep bidirectional language model (biLM), which is pre-trained on a large text corpus.

A biLM combines both a forward and backward LM. ELMo jointly maximizes the log likelihood of the forward and backward directions. To add ELMo to a supervised model, we freeze the weights of the biLM and then concatenate the ELMo vector $\textbf{ELMO}^{task}_k$ with $\textbf{x}_k$ and pass the ELMO enhanced representation $[\textbf{x}_k; \textbf{ELMO}^{task}_k]$ into the task RNN. Here $\textbf{x}_k$ is a context-independent token representation for each token position.

Image Source: here

Source: Deep contextualized word representations

Latest Papers

PAPER DATE
Improving Compositional Generalization in Semantic Parsing
| Inbar OrenJonathan HerzigNitish GuptaMatt GardnerJonathan Berant
2020-10-12
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations
Shauli RavfogelYanai ElazarJacob GoldbergerYoav Goldberg
2020-10-11
Masked ELMo: An evolution of ELMo towards fully contextual RNN language models
Gregory SenayEmmanuelle Salin
2020-10-08
ELMo and BERT in semantic change detection for Russian
Julia RodinaYuliya TrofimovaAndrey KutuzovEkaterina Artemova
2020-10-07
Metaphor Detection using Deep Contextualized Word Embeddings
Shashwat AggarwalRamesh Singh
2020-09-26
FarsTail: A Persian Natural Language Inference Dataset
| Hossein AmirkhaniMohammad Azari JafariAzadeh AmirakZohreh PourjafariSoroush Faridan JahromiZeinab Kouhkan
2020-09-18
Multi-modal embeddings using multi-task learning for emotion recognition
Aparna KhareSrinivas ParthasarathyShiva Sundaram
2020-09-10
Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading
Sasi Kiran GaddipatiDeebul NairPaul G. Plöger
2020-09-02
MICE: Mining Idioms with Contextual Embeddings
Tadej ŠkvorcPolona GantarMarko Robnik-Šikonja
2020-08-13
Assessing Demographic Bias in Named Entity Recognition
Shubhanshu MishraSijun HeLuca Belli
2020-08-08
Towards Debiasing Sentence Representations
Paul Pu LiangIrene Mengze LiEmily ZhengYao Chong LimRuslan SalakhutdinovLouis-Philippe Morency
2020-07-16
Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings
Rishi BommasaniKelly DavisClaire Cardie
2020-07-01
Towards Debiasing Sentence Representations
Paul Pu LiangIrene Mengze LiEmily ZhengYao Chong LimRuslan SalakhutdinovLouis-Philippe Morency
2020-07-01
Clinical Concept Linking with Contextualized Neural Representations
Elliot SchumacherAndriy MulyarMark Dredze
2020-07-01
Why is penguin more similar to polar bear than to sea gull? Analyzing conceptual knowledge in distributional models
Pia Sommerauer
2020-07-01
Interpreting Hierarchical Linguistic Interactions in DNNs
Die ZhangHuilin ZhouXiaoyi BaoDa HuoRuizhao ChenXu ChengHao ZhangMengyue WuQuanshi Zhang
2020-06-29
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages
Pedro Javier Ortiz SuárezLaurent RomaryBenoît Sagot
2020-06-11
A Comparative Study of Lexical Substitution Approaches based on Neural Language Models
Nikolay ArefyevBoris SheludkoAlexander PodolskiyAlexander Panchenko
2020-05-29
On Incorporating Structural Information to improve Dialogue Response Generation
| Nikita MoghePriyesh VijayanBalaraman RavindranMitesh M. Khapra
2020-05-28
MASK: A flexible framework to facilitate de-identification of clinical texts
Nikola MilosevicGangamma KalappaHesam DadafarinMahmoud AzimaeeGoran Nenadic
2020-05-24
On the Robustness of Language Encoders against Grammatical Errors
Fan YinQuanyu LongTao MengKai-Wei Chang
2020-05-12
LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation
Gustavo AguilarSudipta KarThamar Solorio
2020-05-09
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words
Josef KlafkaAllyson Ettinger
2020-05-04
Analyzing ELMo and DistilBERT on Socio-political News Classification
Berfu B{\"u}y{\"u}k{\"o}zAli H{\"u}rriyeto{\u{g}}luArzucan {\"O}zg{\"u}r
2020-05-01
French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus
Murielle Popa-FabrePedro Javier Ortiz Su{\'a}rezBeno{\^\i}t Sagot{\'E}ric de la Clergerie
2020-05-01
``A Passage to India'': Pre-trained Word Embeddings for Indian Languages
Saurav KumarSaunack KumarDiptesh KanojiaPushpak Bhattacharyya
2020-05-01
MTSI-BERT: A Session-aware Knowledge-based Conversational Agent
| Matteo Antonio SeneseGiuseppe RizzoMauro DragoniMaurizio Morisio
2020-05-01
Facilitating Corpus Usage: Making Icelandic Corpora More Accessible for Researchers and Language Users
Stein{\th}{\'o}r Steingr{\'\i}mssonStarka{\dh}ur BarkarsonGunnar Thor {\"O}rn{\'o}lfsson
2020-05-01
High Quality ELMo Embeddings for Seven Less-Resourced Languages
Matej Ul{\v{c}}arMarko Robnik-{\v{S}}ikonja
2020-05-01
Is Language Modeling Enough? Evaluating Effective Embedding Combinations
Rudolf SchneiderTom OberhauserPaul GrundmannFelix Alex GerserAlex LoesererSteffen Staab
2020-05-01
AIA-BDE: A Corpus of FAQs in Portuguese and their Variations
Hugo Gon{\c{c}}alo OliveiraJo{\~a}o FerreiraJos{\'e} SantosPedro FialhoRicardo RodriguesLuisa CoheurAna Alves
2020-05-01
One Classifier for All Ambiguous Words: Overcoming Data Sparsity by Utilizing Sense Correlations Across Words
Prafulla Kumar ChoubeyRuihong Huang
2020-05-01
KLEJ: Comprehensive Benchmark for Polish Language Understanding
| Piotr RybakRobert MroczkowskiJanusz TraczIreneusz Gawlik
2020-05-01
Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection
Momchil HardalovIvan KoychevPreslav Nakov
2020-04-30
Interpretable Entity Representations through Large-Scale Typing
Yasumasa OnoeGreg Durrett
2020-04-30
Do Neural Language Models Show Preferences for Syntactic Formalisms?
Artur KulmizevVinit RavishankarMostafa AbdouJoakim Nivre
2020-04-29
Asking without Telling: Exploring Latent Ontologies in Contextual Representations
Julian MichaelJan A. BothaIan Tenney
2020-04-29
SCELMo: Source Code Embeddings from Language Models
Rafael - Michael KarampatsisCharles Sutton
2020-04-28
DomBERT: Domain-oriented Language Model for Aspect-based Sentiment Analysis
Hu XuBing LiuLei ShuPhilip S. Yu
2020-04-28
Learning to Classify Intents and Slot Labels Given a Handful of Examples
Jason KroneYi ZhangMona Diab
2020-04-22
Improving Disfluency Detection by Self-Training a Self-Attentive Model
| Paria Jamshid LouMark Johnson
2020-04-11
A Survey on Contextual Embeddings
| Qi LiuMatt J. KusnerPhil Blunsom
2020-03-16
Parsing Early Modern English for Linguistic Search
Seth KulickNeville Ryant
2020-02-24
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations
Anonymous
2020-01-01
Tha3aroon at NSURL-2019 Task 8: Semantic Question Similarity in Arabic
| Ali FadelIbraheem TuffahaMahmoud Al-Ayyoub
2019-12-28
Towards Robust Toxic Content Classification
Keita KuritaAnna BelovaAntonios Anastasopoulos
2019-12-14
A Comparative Study of Pretrained Language Models on Thai Social Text Categorization
Thanapapas HorsuwanKasidis KanwatcharaPeerapon VateekulBoonserm Kijsirikul
2019-12-03
High Quality ELMo Embeddings for Seven Less-Resourced Languages
Matej UlčarMarko Robnik-Šikonja
2019-11-22
Incremental Sense Weight Training for the Interpretation of Contextualized Word Embeddings
Xinyi JiangZhengzhe YangJinho D. Choi
2019-11-05
On Sentence Representations for Propaganda Detection: From Handcrafted Features to Word Embeddings
Andr{\'e} Ferreira CruzGil RochaHenrique Lopes Cardoso
2019-11-01
Named Entity Recognition - Is There a Glass Ceiling?
Tomasz StanislawekAnna Wr{\'o}blewskaAlicja W{\'o}jcickaDaniel ZiembickiPrzemyslaw Biecek
2019-11-01
The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization
Simeng SunAni Nenkova
2019-11-01
Unsupervised Labeled Parsing with Deep Inside-Outside Recursive Autoencoders
Andrew DrozdovPatrick VergaYi-Pei ChenMohit IyyerAndrew McCallum
2019-11-01
What Does This Word Mean? Explaining Contextualized Embeddings with Natural Language Definition
Ting-Yun ChangYun-Nung Chen
2019-11-01
[email protected]: Propaganda Detection from News Articles using Transfer Learning
Kartik AggarwalAnubhav Sadana
2019-11-01
Reevaluating Argument Component Extraction in Low Resource Settings
Anirudh JoshiTimothy BaldwinRichard SinnottCecile Paris
2019-11-01
Sentence Embeddings for Russian NLU
Dmitry PopovAlexander PugachevPolina SvyatokumElizaveta SvitankoEkaterina Artemova
2019-10-29
Evolution of transfer learning in natural language processing
Aditya MaltePratik Ratadiya
2019-10-16
Named Entity Recognition -- Is there a glass ceiling?
| Tomasz StanislawekAnna WróblewskaAlicja WójcickaDaniel ZiembickiPrzemyslaw Biecek
2019-10-06
Data-Efficient Goal-Oriented Conversation with Dialogue Knowledge Transfer Networks
Igor ShalyminovSungjin LeeArash EshghiOliver Lemon
2019-10-03
Specializing Word Embeddings (for Parsing) by Information Bottleneck
Xiang Lisa LiJason Eisner
2019-10-01
Extreme Language Model Compression with Optimal Subwords and Shared Projections
Sanqiang ZhaoRaghav GuptaYang SongDenny Zhou
2019-09-25
Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings
| Gregor WiedemannSteffen RemusAvi ChawlaChris Biemann
2019-09-23
Subword ELMo
| Jiangtong LiHai ZhaoZuchao LiWei BiXiaojiang Liu
2019-09-18
UER: An Open-Source Toolkit for Pre-training Models
| Zhe ZhaoHui ChenJinbin ZhangXin ZhaoTao LiuWei LuXi ChenHaotang DengQi JuXiaoyong Du
2019-09-12
Retrofitting Contextualized Word Embeddings with Paraphrases
Weijia ShiMuhao ChenPei ZhouKai-Wei Chang
2019-09-12
From English to Code-Switching: Transfer Learning with Strong Morphological Clues
Gustavo AguilarThamar Solorio
2019-09-11
Multimodal Embeddings from Language Models
| Shao-Yen TsengPanayiotis GeorgiouShrikanth Narayanan
2019-09-10
Designing and Interpreting Probes with Control Tasks
| John HewittPercy Liang
2019-09-08
To lemmatize or not to lemmatize: how word normalisation affects ELMo performance in word sense disambiguation
Andrey KutuzovElizaveta Kuzmenko
2019-09-06
Semantics-aware BERT for Language Understanding
| Zhuosheng ZhangYuwei WuHai ZhaoZuchao LiShuailiang ZhangXi ZhouXiang Zhou
2019-09-05
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings
Kawin Ethayarajh
2019-09-02
Multilingual Probing of Deep Pre-Trained Contextual Encoders
Vinit RavishankarMemduh G{\"o}k{\i}rmakLilja {\O}vrelidErik Velldal
2019-09-01
Neural Feature Extraction for Contextual Emotion Detection
Elham MohammadiHessam AminiLeila Kosseim
2019-09-01
Evaluation of vector embedding models in clustering of text documents
Tomasz WalkowiakMateusz Gniewkowski
2019-09-01
Predicting Sentiment of Polish Language Short Texts
Aleks WawererJulita Sobiczewska
2019-09-01
Evaluation of Stacked Embeddings for Bulgarian on the Downstream Tasks POS and NERC
Iva Marinova
2019-09-01
Quasi Bidirectional Encoder Representations from Transformers for Word Sense Disambiguation
Michele BevilacquaRoberto Navigli
2019-09-01
Sparse Victory -- A Large Scale Systematic Comparison of count-based and prediction-based vectorizers for text classification
Rupak ChakrabortyAshima ElhenceKapil Arora
2019-09-01
Semantic Role Labeling with Pretrained Language Models for Known and Unknown Predicates
Daniil LarionovArtem ShelmanovElena ChistovaIvan Smirnov
2019-09-01
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations
| Mingda ChenZewei ChuKevin Gimpel
2019-08-31
Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER
Phillip KeungYichao LuVikas Bhardwaj
2019-08-31
Shallow Syntax in Deep Water
Swabha SwayamdiptaMatthew PetersBrendan RoofChris DyerNoah A. Smith
2019-08-29
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression
Genta Indra WinataAndrea MadottoJamin ShinElham J. BareziPascale Fung
2019-08-27
Detecting Toxicity in News Articles: Application to Bulgarian
| Yoan DinkovIvan KoychevPreslav Nakov
2019-08-26
BERT for Coreference Resolution: Baselines and Analysis
| Mandar JoshiOmer LevyDaniel S. WeldLuke Zettlemoyer
2019-08-24
Adversarial Domain Adaptation for Machine Reading Comprehension
Huazheng WangZhe GanXiaodong LiuJingjing LiuJianfeng GaoHongning Wang
2019-08-24
Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing
Milan StrakaJana StrakováJan Hajič
2019-08-20
Neural Architectures for Nested NER through Linearization
| Jana StrakováMilan StrakaJan Hajič
2019-08-19
Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding
| Oren BarkanNoam RazinItzik MalkielOri KatzAvi CaciularuNoam Koenigstein
2019-08-14
BioFLAIR: Pretrained Pooled Contextualized Embeddings for Biomedical Sequence Labeling Tasks
| Shreyas SharmaRon Daniel Jr
2019-08-13
Beyond English-Only Reading Comprehension: Experiments in Zero-Shot Multilingual Transfer for Bulgarian
| Momchil HardalovIvan KoychevPreslav Nakov
2019-08-05
Detection of Adverse Drug Reaction Mentions in Tweets Using ELMo
Sarah Sarabadani
2019-08-01
The Role of Protected Class Word Lists in Bias Identification of Contextualized Word Representations
Jo{\~a}o SedocLyle Ungar
2019-08-01
SOURCE: SOURce-Conditional Elmo-style Model for Machine Translation Quality Estimation
Junpei ZhouZhisong ZhangZecong Hu
2019-08-01
Neural Mention Detection
| Juntao YuBernd BohnetMassimo Poesio
2019-07-29
Syntax-aware Neural Semantic Role Labeling
| Qingrong XiaZhenghua LiMin ZhangMeishan ZhangGuohong FuRui WangLuo Si
2019-07-22
Can Unconditional Language Models Recover Arbitrary Sentences?
Nishant SubramaniSamuel R. BowmanKyunghyun Cho
2019-07-10
Improving Chemical Named Entity Recognition in Patents with Contextualized Word Embeddings
Zenan ZhaiDat Quoc NguyenSaber A. AkhondiCamilo ThorneChristian DruckenbrodtTrevor CohnMichelle GregoryKarin Verspoor
2019-07-05
Latent Variable Sentiment Grammar
| Liwen ZhangKewei TuYue Zhang
2019-06-29
Relating Simple Sentence Representations in Deep Neural Networks and the Brain
Sharmistha JatHao TangPartha TalukdarTom Mitchell
2019-06-27
Transfer Learning for Causal Sentence Detection
Manolis KyriakakisIon AndroutsopoulosJoan Ginés i AmetlléArtur Saudabayev
2019-06-18
Context is Key: Grammatical Error Detection with Contextual Word Representations
Samuel BellHelen YannakoudakisMarek Rei
2019-06-15
A Comparison of Word-based and Context-based Representations for Classification Problems in Health Informatics
Aditya JoshiSarvnaz KarimiRoss SparksCecile ParisC Raina MacIntyre
2019-06-13
Large-Scale Multi-Label Text Classification on EU Legislation
| Ilias ChalkidisManos FergadiotisProdromos MalakasiotisIon Androutsopoulos
2019-06-05
A Structural Probe for Finding Syntax in Word Representations
John HewittChristopher D. Manning
2019-06-01
Opinion Mining with Deep Contextualized Embeddings
Wen-Bin HanKNoriko o
2019-06-01
CLaC Lab at SemEval-2019 Task 3: Contextual Emotion Detection Using a Combination of Neural Networks and SVM
Elham MohammadiHessam AminiLeila Kosseim
2019-06-01
CX-ST-RNM at SemEval-2019 Task 3: Fusion of Recurrent Neural Networks Based on Contextualized and Static Word Representations for Contextual Emotion Detection
Micha{\l} Pere{\l}kiewicz
2019-06-01
NL-FIIT at SemEval-2019 Task 3: Emotion Detection From Conversational Triplets Using Hierarchical Encoders
Michal FarkasPeter Lacko
2019-06-01
YUN-HPCC at SemEval-2019 Task 3: Multi-Step Ensemble Neural Network for Sentiment Analysis in Textual Conversation
Dawei LiJin WangXuejie Zhang
2019-06-01
STUFIIT at SemEval-2019 Task 5: Multilingual Hate Speech Detection on Twitter with MUSE and ELMo Embeddings
Michal Bojkovsk{\'y}Mat{\'u}{\v{s}} Pikuliak
2019-06-01
Fermi at SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media using Sentence Embeddings
Vijayasaradhi IndurthiBakhtiyar SyedManish ShrivastavaManish GuptaVasudeva Varma
2019-06-01
Team Bertha von Suttner at SemEval-2019 Task 4: Hyperpartisan News Detection using ELMo Sentence Representation Convolutional Network
Ye JiangJohann PetrakXingyi SongKalina BontchevaDiana Maynard
2019-06-01
UNH at SemEval-2019 Task 12: Toponym Resolution in Scientific Papers
Matthew MagnussonLaura Dietz
2019-06-01
How Well Do Embedding Models Capture Non-compositionality? A View from Multiword Expressions
NNavnita akumarTimothy BaldwinBahar Salehi
2019-06-01
CLP at SemEval-2019 Task 3: Multi-Encoder in Hierarchical Attention Networks for Contextual Emotion Detection
Changjie LiYun Xing
2019-06-01
Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)
| Mariya TonevaLeila Wehbe
2019-05-28
Evaluation of basic modules for isolated spelling error correction in Polish texts
Szymon Rutkowski
2019-05-26
Learning to Denoise Distantly-Labeled Data for Entity Typing
| Yasumasa OnoeGreg Durrett
2019-05-04
Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling
Samuel R. BowmanEllie PavlickEdouard GraveBenjamin Van DurmeAlex WangJan HulaPatrick XiaRaghavendra PappagariR. Thomas McCoyRoma PatelNajoung KimIan TenneyYinghui HuangKatherin YuShuning JinBerlin Chen
2019-05-01
Who Blames Whom in a Crisis? Detecting Blame Ties from News Articles Using Neural Networks
| Shuailong LiangOlivia NicolYue Zhang
2019-04-24
An Evaluation of Transfer Learning for Classifying Sales Engagement Emails at Large Scale
Yong LiuPavel DmitrievYifei HuangAndrew BrooksLi Dong
2019-04-19
Improving Human Text Comprehension through Semi-Markov CRF-based Neural Section Title Generation
Sebastian GehrmannSteven LayneFranck Dernoncourt
2019-04-15
Publicly Available Clinical BERT Embeddings
| Emily AlsentzerJohn R. MurphyWillie BoagWei-Hung WengDi JinTristan NaumannMatthew B. A. McDermott
2019-04-06
CLEARumor at SemEval-2019 Task 7: ConvoLving ELMo Against Rumors
| Ipek BarisLukas SchmelzeisenSteffen Staab
2019-04-05
NL-FIIT at SemEval-2019 Task 9: Neural Model Ensemble for Suggestion Mining
| Samuel PecarMarian SimkoMaria Bielikova
2019-04-05
Alternative Weighting Schemes for ELMo Embeddings
| Nils ReimersIryna Gurevych
2019-04-05
Gender Bias in Contextualized Word Embeddings
Jieyu ZhaoTianlu WangMark YatskarRyan CotterellVicente OrdonezKai-Wei Chang
2019-04-05
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
| Xiaochuang HanJacob Eisenstein
2019-04-04
Probing Biomedical Embeddings from Language Models
| Qiao JinBhuwan DhingraWilliam W. CohenXinghua Lu
2019-04-03
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks
| Raphael TangYao LuLinqing LiuLili MouOlga VechtomovaJimmy Lin
2019-03-28
Linguistic Knowledge and Transferability of Contextual Representations
Nelson F. LiuMatt GardnerYonatan BelinkovMatthew E. PetersNoah A. Smith
2019-03-21
Efficient Contextual Representation Learning Without Softmax Layer
Liunian Harold LiPatrick H. ChenCho-Jui HsiehKai-Wei Chang
2019-02-28
Enhancing Clinical Concept Extraction with Contextual Embeddings
Yuqi SiJingqi WangHua XuKirk Roberts
2019-02-22
ntuer at SemEval-2019 Task 3: Emotion Classification with Word and Sentence Representations in RCNN
| Peixiang ZhongChunyan Miao
2019-02-21
Passage Re-ranking with BERT
| Rodrigo NogueiraKyunghyun Cho
2019-01-13
Team EP at TAC 2018: Automating data extraction in systematic reviews of environmental agents
Artur NowakPaweł Kunstman
2019-01-07
Multilingual Constituency Parsing with Self-Attention and Pre-Training
| Nikita KitaevSteven CaoDan Klein
2018-12-31
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
| Alex WangJan HulaPatrick XiaRaghavendra PappagariR. Thomas McCoyRoma PatelNajoung KimIan TenneyYinghui HuangKatherin YuShuning JinBerlin ChenBenjamin Van DurmeEdouard GraveEllie PavlickSamuel R. Bowman
2018-12-28
GLoMo: Unsupervised Learning of Transferable Relational Graphs
Zhilin YangJake ZhaoBhuwan DhingraKaiming HeWilliam W. CohenRuslan R. SalakhutdinovYann Lecun
2018-12-01
Natural language understanding for task oriented dialog in the biomedical domain in a low resources context
Antoine NeurazLeonardo Campillos LlanosAnita BurgunSophie Rosset
2018-11-23
Extractive Summary as Discrete Latent Variables
Aran Komatsuzaki
2018-11-14
Syntax Helps ELMo Understand Semantics: Is Syntax Still Relevant in a Deep Neural Architecture for SRL?
Emma StrubellAndrew McCallum
2018-11-12
Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks
| Jason PhangThibault FévrySamuel R. Bowman
2018-11-02
Language Modeling Teaches You More than Translation Does: Lessons Learned Through Auxiliary Syntactic Task Analysis
Kelly ZhangSamuel Bowman
2018-11-01
Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog
| Sebastian SchusterSonal GuptaRushin ShahMike Lewis
2018-10-31
Magnitude: A Fast, Efficient Universal Vector Embedding Utility Package
| Ajay PatelAlexander SandsChris Callison-BurchMarianna Apidianaki
2018-10-26
Spot the Odd Man Out: Exploring the Associative Power of Lexical Resources
Gabriel StanovskyMark Hopkins
2018-10-01
SEx BiST: A Multi-Source Trainable Parser with Deep Contextualized Lexical Representations
KyungTae LimCheoneum ParkChangki LeeThierry Poibeau
2018-10-01
ELMoLex: Connecting ELMo and Lexicon Features for Dependency Parsing
Ganesh JawaharBenjamin MullerAmal FethiLouis Martin{\'E}ric Villemonte de la ClergerieBeno{\^\i}t SagotDjam{\'e} Seddah
2018-10-01
NL-FIIT at IEST-2018: Emotion Recognition utilizing Neural Networks and Multi-level Preprocessing
| Samuel PecarMichal FarkasMarian SimkoPeter LackoMaria Bielikova
2018-10-01
Disney at IEST 2018: Predicting Emotions using an Ensemble
Wojciech WitonPierre ColomboAshutosh ModiMubbasir Kapadia
2018-10-01
In-domain Context-aware Token Embeddings Improve Biomedical Named Entity Recognition
Golnar SheikhshabbafghiInanc BirolAnoop Sarkar
2018-10-01
Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis
Kelly W. ZhangSamuel R. Bowman
2018-09-26
Deep contextualized word representations for detecting sarcasm and irony
Suzana IlićEdison Marrese-TaylorJorge A. BalazsYutaka Matsuo
2018-09-26
Incorporating Syntactic and Semantic Information in Word Embeddings using Graph Convolutional Networks
Shikhar VashishthManik BhandariPrateek YadavPiyush RaiChiranjib BhattacharyyaPartha Talukdar
2018-09-12
Towards Semi-Supervised Learning for Deep Semantic Role Labeling
Sanket Vaibhav MehtaJay Yoon LeeJaime Carbonell
2018-08-28
IIIDYT at IEST 2018: Implicit Emotion Classification With Deep Contextualized Word Representations
| Jorge A. BalazsEdison Marrese-TaylorYutaka Matsuo
2018-08-27
Revisiting the Importance of Encoding Logic Rules in Sentiment Classification
| Kalpesh KrishnaPreethi JyothiMohit Iyyer
2018-08-23
Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection
Chongyang TaoWei WuCan XuYansong FengDongyan ZhaoRui Yan
2018-08-22
GLoMo: Unsupervisedly Learned Relational Graphs as Transferable Representations
| Zhilin YangJake ZhaoBhuwan DhingraKaiming HeWilliam W. CohenRuslan SalakhutdinovYann LeCun
2018-06-14
Deep contextualized word representations
| Matthew E. PetersMark NeumannMohit IyyerMatt GardnerChristopher ClarkKenton LeeLuke Zettlemoyer
2018-02-15

Categories