Text-to-Code Generation with Modality-relative Pre-training

no code implementations • 8 Feb 2024 • Fenia Christopoulou, Guchun Zhang, Gerasimos Lampouras

Large pre-trained language models have recently been expanded and applied to programming language tasks with great success, often through further pre-training of a strictly-natural language model--where training sequences typically contain both natural and (linearised) programming language.

Code Generation Language Modelling +2

EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching

no code implementations • 22 Oct 2022 • Chenxi Whitehouse, Fenia Christopoulou, Ignacio Iacobacci

We use Wikidata and English Wikipedia to construct an entity-centric CS corpus by switching entities to their counterparts in other languages.

Data Augmentation Retrieval +3

Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU

1 code implementation • 22 Oct 2022 • Fenia Christopoulou, Gerasimos Lampouras, Ignacio Iacobacci

Curriculum Learning (CL) is a technique of training models via ranking examples in a typically increasing difficulty trend with the aim of accelerating convergence and improving generalisability.

Natural Language Understanding Zero-Shot Cross-Lingual Transfer

PanGu-Coder: Program Synthesis with Function-Level Language Modeling

1 code implementation • 22 Jul 2022 • Fenia Christopoulou, Gerasimos Lampouras, Milan Gritta, Guchun Zhang, Yinpeng Guo, Zhongqi Li, Qi Zhang, Meng Xiao, Bo Shen, Lin Li, Hao Yu, Li Yan, Pingyi Zhou, Xin Wang, Yuchi Ma, Ignacio Iacobacci, Yasheng Wang, Guangtai Liang, Jiansheng Wei, Xin Jiang, Qianxiang Wang, Qun Liu

We present PanGu-Coder, a pretrained decoder-only language model adopting the PanGu-Alpha architecture for text-to-code generation, i. e. the synthesis of programming language solutions given a natural language problem description.

Code Generation Language Modelling +2

Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priors

no code implementations • NAACL 2021 • Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou

We propose a multi-task, probabilistic approach to facilitate distantly supervised relation extraction by bringing closer the representations of sentences that contain the same Knowledge Base pairs.

Multi-Task Learning Relation +2

Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs

1 code implementation • IJCNLP 2019 • Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou

We thus propose an edge-oriented graph neural model for document-level relation extraction.

Document-level Relation Extraction Relation +1

Inter-sentence Relation Extraction with Document-level Graph Convolutional Neural Network

no code implementations • ACL 2019 • Sunil Kumar Sahu, Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou

Inter-sentence relation extraction deals with a number of complex semantic relationships in documents, which require local, non-local, syntactic and semantic dependencies.

Relation Relation Extraction +1

A Walk-based Model on Entity Graphs for Relation Extraction

1 code implementation • ACL 2018 • Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou

We present a novel graph-based neural network model for relation extraction.

Position Relation +2

Tweester at SemEval-2016 Task 4: Sentiment Analysis in Twitter Using Semantic-Affective Model Adaptation

no code implementations • SEMEVAL 2016 • Elisavet Palogiannidi, Athanasia Kolovou, Fenia Christopoulou, Filippos Kokkinos, Elias Iosif, Mal, Nikolaos rakis, Haris Papageorgiou, Shrikanth Narayanan, Alex Potamianos, ros

Opinion Mining Twitter Sentiment Analysis +1