no code implementations • 28 Mar 2024 • Niall Taylor, Andrey Kormilitzin, Isabelle Lorge, Alejo Nevado-Holgado, Dan W Joyce
The ability to efficiently recommend a relevant team by ingesting potentially voluminous clinical notes could help services both reduce referral waiting times and with the right technology, improve the evidence available to justify triage decisions.
no code implementations • 28 Mar 2024 • Niall Taylor, Dan Schofield, Andrey Kormilitzin, Dan W Joyce, Alejo Nevado-Holgado
Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text.
no code implementations • 16 Feb 2024 • Niall Taylor, Upamanyu Ghose, Omid Rohanian, Mohammadmahdi Nouriborji, Andrey Kormilitzin, David Clifton, Alejo Nevado-Holgado
The entry of large language models (LLMs) into research and commercial spaces has led to a trend of ever-larger models, with initial promises of generalisability, followed by a widespread desire to downsize and create specialised models without the need for complete fine-tuning, using Parameter Efficient Fine-tuning (PEFT) methods.
1 code implementation • 12 Feb 2024 • Isabelle Lorge, Dan W. Joyce, Niall Taylor, Alejo Nevado-Holgado, Andrea Cipriani, Andrey Kormilitzin
Difficult-to-treat depression (DTD) has been proposed as a broader and more clinically comprehensive perspective on a person's depressive disorder where despite treatment, they continue to experience significant burden.
1 code implementation • 20 Nov 2023 • Asmita Poddar, Vladimir Uzun, Elizabeth Tunbridge, Wilfried Haerty, Alejo Nevado-Holgado
Splice sites play a crucial role in gene expression, and accurate prediction of these sites in DNA sequences is essential for diagnosing and treating genetic disorders.
no code implementations • 29 Jul 2022 • Alejo Nevado-Holgado, Colin Espie, Maria Liakata, Alasdair Henry, Jenny Gu, Niall Taylor, Kate Saunders, Tom Walker, Chris Miller
In collaboration with Big Health, the therapeutics company that created and utilizes Sleepio, we have analysed data from a random sample of 401, 174 sleep diaries and built a neural network to model sleep behaviour and sleep quality of each individual in a personalised manner.
1 code implementation • 11 May 2022 • Niall Taylor, Yi Zhang, Dan Joyce, Alejo Nevado-Holgado, Andrey Kormilitzin
Prompt learning is a new paradigm in the Natural Language Processing (NLP) field which has shown impressive performance on a number of natural language tasks with common benchmarking text datasets in full, few-shot, and zero-shot train-evaluation setups.
no code implementations • 15 Nov 2021 • Niall Taylor, Lei Sha, Dan W Joyce, Thomas Lukasiewicz, Alejo Nevado-Holgado, Andrey Kormilitzin
In this work, we apply InfoCal, the current state-of-the-art model that produces extractive rationales for its predictions, to the task of predicting hospital readmission using hospital discharge notes.
no code implementations • 23 Oct 2020 • Yurika Sakai, Andrey Kormilitzin, Qiang Liu, Alejo Nevado-Holgado
The most successful methods such as ReLU transfer functions, batch normalization, Xavier initialization, dropout, learning rate decay, or dynamic optimizers, have become standards in the field due, particularly, to their ability to increase the performance of Neural Networks (NNs) significantly and in almost all situations.
no code implementations • EMNLP (Louhi) 2020 • Andrey Kormilitzin, Nemanja Vaci, Qiang Liu, Hao Ni, Goran Nenadic, Alejo Nevado-Holgado
In this work we addressed the problem of capturing sequential information contained in longitudinal electronic health records (EHRs).
2 code implementations • 3 Mar 2020 • Andrey Kormilitzin, Nemanja Vaci, Qiang Liu, Alejo Nevado-Holgado
In this work we introduced a named-entity recognition model for clinical natural language processing.
Medical Named Entity Recognition named-entity-recognition +4
no code implementations • 29 Aug 2019 • Andrey Kormilitzin, Xinyu Yang, William H. Stone, Caroline Woffindale, Francesca Nicholls, Elena Ribe, Alejo Nevado-Holgado, Noel Buckley
Understanding the morphological changes of primary neuronal cells induced by chemical compounds is essential for drug discovery.
no code implementations • 6 Jan 2019 • Luka Gligic, Andrey Kormilitzin, Paul Goldberg, Alejo Nevado-Holgado
In our study, we develop an approach that solves these problems for named entity recognition, obtaining 94. 6 F1 score in I2B2 2009 Medical Extraction Challenge [6], 4. 3 above the architecture that won the competition.
4 code implementations • 13 Nov 2018 • Maximilian Hofer, Andrey Kormilitzin, Paul Goldberg, Alejo Nevado-Holgado
Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017).