Search Results for author: Francesco Moramarco

Found 8 papers, 1 papers with code

Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation

no code implementations17 Nov 2022 Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter

Evaluating automatically generated text is generally hard due to the inherently subjective nature of many aspects of the output quality.

User-Driven Research of Medical Note Generation Software

no code implementations NAACL 2022 Tom Knoll, Francesco Moramarco, Alex Papadopoulos Korfiatis, Rachel Young, Claudia Ruffini, Mark Perera, Christian Perstl, Ehud Reiter, Anya Belz, Aleksandar Savkov

A growing body of work uses Natural Language Processing (NLP) methods to automatically generate medical notes from audio recordings of doctor-patient consultations.

Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation

no code implementations ACL 2022 Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Damir Juric, Jack Flann, Ehud Reiter, Anya Belz, Aleksandar Savkov

In recent years, machine learning models have rapidly become better at generating clinical consultation notes; yet, there is little work on how to properly evaluate the generated consultation notes to understand the impact they may have on both the clinician using them and the patient's clinical safety.

PriMock57: A Dataset Of Primary Care Mock Consultations

no code implementations ACL 2022 Alex Papadopoulos Korfiatis, Francesco Moramarco, Radmila Sarac, Aleksandar Savkov

Recent advances in Automatic Speech Recognition (ASR) have made it possible to reliably produce automatic transcripts of clinician-patient conversations.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Towards more patient friendly clinical notes through language models and ontologies

no code implementations23 Dec 2021 Francesco Moramarco, Damir Juric, Aleksandar Savkov, Jack Flann, Maria Lehl, Kristian Boda, Tessa Grafen, Vitalii Zhelezniak, Sunir Gohil, Alex Papadopoulos Korfiatis, Nils Hammerla

Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning, surpassing the current state of the art.

Language Modelling Text Simplification

Towards objectively evaluating the quality of generated medical summaries

no code implementations EACL (HumEval) 2021 Francesco Moramarco, Damir Juric, Aleksandar Savkov, Ehud Reiter

We propose a method for evaluating the quality of generated text by asking evaluators to count facts, and computing precision, recall, f-score, and accuracy from the raw counts.

Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors

2 code implementations ICLR 2019 Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Francesco Moramarco, Jack Flann, Nils Y. Hammerla

Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.

Semantic Textual Similarity Sentence +2

Cannot find the paper you are looking for? You can Submit a new open access paper.