no code implementations • Findings (ACL) 2022 • Deborah Ferreira, Mokanarangan Thayaparan, Marco Valentino, Julia Rozanova, Andre Freitas
The application of Natural Language Inference (NLI) methods over large textual corpora can facilitate scientific discovery, reducing the gap between current research and the available large-scale scientific knowledge.
1 code implementation • 27 Aug 2023 • Leonardo Ranaldi, Giulia Pucci, Andre Freitas
This disparity is demanded in further fine-tuning and affecting the cross-lingual abilities of LLMs.
no code implementations • 7 Aug 2023 • Yingji Zhang, Danilo S. Carvalho, Ian Pratt-Hartmann, Andre Freitas
They employ the T5 model to directly generate the tree, which can explain how the answer is inferred.
1 code implementation • 19 Jul 2023 • Jordan Meadows, Marco Valentino, Andre Freitas
In addition, we analyse 1. 7K equations, and over 200 derivations, to highlight common reasoning errors such as the inclusion of incorrect, irrelevant, and redundant equations.
no code implementations • 28 May 2023 • Magdalena Wysocka, Oskar Wysocki, Maxime Delmas, Vincent Mutel, Andre Freitas
The results show that while LLMs are currently not fit for purpose to be used as biomedical factual knowledge bases, there is a promising emerging property in the direction of factuality as the models become domain specialised, scale-up in size and level of human feedback.
no code implementations • 21 May 2023 • Jordan Meadows, Marco Valentino, Damien Teney, Andre Freitas
Whether Transformers can learn to apply symbolic rules and generalise to out-of-distribution examples is an open research question.
no code implementations • 19 May 2023 • Xiaowei Huang, Wenjie Ruan, Wei Huang, Gaojie Jin, Yi Dong, Changshun Wu, Saddek Bensalem, Ronghui Mu, Yi Qi, Xingyu Zhao, Kaiwen Cai, Yanghao Zhang, Sihao Wu, Peipei Xu, Dengyu Wu, Andre Freitas, Mustafa A. Mustafa
Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains.
no code implementations • 15 May 2023 • Julia Rozanova, Marco Valentino, Andre Freitas
Rigorous evaluation of the causal effects of semantic features on language model predictions can be hard to achieve for natural language reasoning problems.
no code implementations • 20 Apr 2023 • Julia Rozanova, Marco Valentino, Lucas Cordeiro, Andre Freitas
Probing strategies have been shown to detect the presence of various linguistic features in large language models; in particular, semantic features intermediate to the "natural logic" fragment of the Natural Language Inference task (NLI).
Natural Language Inference
Vocal Bursts Intensity Prediction
no code implementations • 6 Mar 2023 • Hanadi Mardah, Oskar Wysocki, Markel Vigo, Andre Freitas
Therefore, AGs were considered to deliver a more critical approach to argument interpretation, especially with unfamiliar topics.
no code implementations • 9 Feb 2023 • Mauricio Jacobo-Romero, Danilo S. Carvalho, Andre Freitas
In this work, we examined Business Process (BP) production as a signal; this novel approach explores a BP workflow as a linear time-invariant (LTI) system.
no code implementations • 22 Sep 2022 • Danilo S. Carvalho, Giangiacomo Mercatali, Yingji Zhang, Andre Freitas
Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing.
no code implementations • 20 Jun 2022 • Alex Bogatu, Magdalena Wysocka, Oskar Wysocki, Holly Butterworth, Donal Landers, Elaine Kilgour, Andre Freitas
Cytokine release syndrome (CRS), also known as cytokine storm, is one of the most consequential adverse effects of chimeric antigen receptor therapies that have shown promising results in cancer treatment.
no code implementations • 30 May 2022 • Jordan Meadows, Andre Freitas
Informal mathematical text underpins real-world quantitative reasoning and communication.
no code implementations • Findings (ACL) 2022 • Edoardo Manino, Julia Rozanova, Danilo Carvalho, Andre Freitas, Lucas Cordeiro
Metamorphic testing has recently been used to check the safety of neural NLP models.
no code implementations • 25 Jan 2022 • Mael Jullien, Marco Valentino, Andre Freitas
With the methodological support of probing (or diagnostic classification), recent studies have demonstrated that Transformers encode syntactic and semantic information to some extent.
1 code implementation • LREC 2022 • Jordan Meadows, Zili Zhou, Andre Freitas
In order for language models to aid physics research, they must first encode representations of mathematical and natural language discourse which lead to coherent explanations, with correct ordering and relevance of statements.
1 code implementation • 15 Dec 2021 • Julia Rozanova, Deborah Ferreira, Marco Valentino, Mokanrarangan Thayaparan, Andre Freitas
In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity and concept inclusion.
no code implementations • 20 Sep 2021 • Philip Osborne, Heido Nõmm, Andre Freitas
Reinforcement Learning has shown success in a number of complex virtual environments.
1 code implementation • 17 Sep 2021 • Julia Rozanova, Deborah Ferreira, Krishna Dubba, Weiwei Cheng, Dell Zhang, Andre Freitas
Even though BERT and similar pre-trained language models have excelled in several NLP tasks, their use has not been widely explored for the UI grounding domain.
no code implementations • 16 Jul 2021 • Oskar Wysocki, Malina Florea, Donal Landers, Andre Freitas
This paper proposes a novel statistical corpus analysis framework targeted towards the interpretation of Natural Language Processing (NLP) architectural patterns at scale.
no code implementations • IWCS (ACL) 2021 • Zili Zhou, Marco Valentino, Donal Landers, Andre Freitas
This paper describes N-XKT (Neural encoding based on eXplanatory Knowledge Transfer), a novel method for the automatic transfer of explanatory knowledge through neural encoding mechanisms.
1 code implementation • IWCS (ACL) 2021 • Guy Marshall, Mokanarangan Thayaparan, Philip Osborne, Andre Freitas
This paper explores the topic of transportability, as a sub-area of generalisability.
no code implementations • 30 Apr 2021 • Guy Clarke Marshall, Caroline Jay, Andre Freitas
Perhaps because of this, diagrams, as "icons of relation", are a prevalent medium for signifying complex models.
no code implementations • 30 Apr 2021 • Guy Clarke Marshall, Caroline Jay, Andre Freitas
We analyse a corpus of diagrams found in scholarly computational linguistics conference proceedings (ACL 2017), and find inclusion of a system diagram to be correlated with higher numbers of citations after 3 years.
no code implementations • 30 Apr 2021 • Guy Clarke Marshall, Caroline Jay, Andre Freitas
Using a corpus-based approach, we argue that the heterogeneous diagrammatic notations used for neural network systems has implications for signification in this domain.
no code implementations • 20 Nov 2020 • Alex Bogatu, Norman W. Paton, Mark Douthwaite, Stuart Davie, Andre Freitas
In this paper, we set out to devise an entity resolution method that builds on the robustness conferred by deep autoencoders to reduce human-involvement costs.
no code implementations • EMNLP (Eval4NLP) 2021 • Oskar Wysocki, Malina Florea, Andre Freitas
SemEval is the primary venue in the NLP community for the proposal of new challenges and for the systematic empirical evaluation of NLP systems.
1 code implementation • LREC 2020 • Deborah Ferreira, Andre Freitas
Mathematical text is written using a combination of words and mathematical expressions.
no code implementations • 15 Jan 2020 • Dell Zhang, Andre Freitas, DaCheng Tao, Dawn Song
This is the Proceedings of the AAAI-20 Workshop on Intelligent Process Automation (IPA-20) which took place in New York, NY, USA on February 7th 2020.
no code implementations • WS 2019 • Mokanarangan Thayaparan, Marco Valentino, Viktor Schlegel, Andre Freitas
Recent advances in reading comprehension have resulted in models that surpass human performance when the answer is contained in a single, continuous passage of text.
1 code implementation • 26 Sep 2019 • Christina Niklaus, Matthias Cetto, Andre Freitas, Siegfried Handschuh
We introduce DisSim, a discourse-aware sentence splitting framework for English and German whose goal is to transform syntactically complex sentences into an intermediate representation that presents a simple and more regular structure which is easier to process for downstream semantic applications.
no code implementations • WS 2019 • Christina Niklaus, Andre Freitas, Siegfried Handschuh
We compiled a new sentence splitting corpus that is composed of 203K pairs of aligned complex source and simplified target sentences.
1 code implementation • ACL 2019 • Christina Niklaus, Matthias Cetto, Andre Freitas, Siegfried Handschuh
We present an approach for recursively splitting and rephrasing complex English sentences into a novel semantic hierarchy of simplified sentences, with each of them presenting a more regular structure that may facilitate a wide variety of artificial intelligence tasks, such as machine translation (MT) or information extraction (IE).
no code implementations • 16 May 2018 • Siamak Barzegar, Juliano Efson Sales, Andre Freitas, Siegfried Handschuh, Brian Davis
This demonstration presents an infrastructure for computing multilingual semantic relatedness and correlation for twelve natural languages by using three distributional semantic models (DSMs).
no code implementations • 16 May 2018 • Siamak Barzegar, Andre Freitas, Siegfried Handschuh, Brian Davis
Different semantic interpretation tasks such as text entailment and question answering require the classification of semantic relations between terms or entities within text.
no code implementations • 16 May 2018 • Andre Freitas, Siamak Barzegar, Juliano Efson Sales, Siegfried Handschuh, Brian Davis
The results also show that the benefit of using the most informative corpus outweighs the possible errors introduced by the machine translation.