Search Results for author: Gareth J. F. Jones

Found 12 papers, 4 papers with code

Achieving Reliable Human Assessment of Open-Domain Dialogue Systems

1 code implementation ACL 2022 Tianbo Ji, Yvette Graham, Gareth J. F. Jones, Chenyang Lyu, Qun Liu

Answering the distress call of competitions that have emphasized the urgent need for better evaluation techniques in dialogue, we present the successful development of human evaluation that is highly reliable while still remaining feasible and low cost.

Dialogue Evaluation

Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods

1 code implementation MoTra (NoDaLiDa) 2021 Lifeng Han, Gareth J. F. Jones, Alan F. Smeaton

To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality.

Machine Translation Natural Language Processing +4

Exploring Current User Web Search Behaviours in Analysis Tasks to be Supported in Conversational Search

no code implementations9 Apr 2021 Abhishek Kaushik, Gareth J. F. Jones

Conversational search presents opportunities to support users in their search activities to improve the effectiveness and efficiency of search while reducing their cognitive load.

Conversational Search Information Retrieval

Chinese Character Decomposition for Neural MT with Multi-Word Expressions

1 code implementation NoDaLiDa 2021 Lifeng Han, Gareth J. F. Jones, Alan F. Smeaton, Paolo Bolzoni

To investigate the impact of Chinese decomposition embedding in detail, i. e., radical, stroke, and intermediate levels, and how well these decompositions represent the meaning of the original character sequences, we carry out analysis with both automated and human evaluation of MT.

Machine Translation Translation

A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

no code implementations8 Apr 2021 Abhishek Kaushik, Gareth J. F. Jones

We propose a CS evaluation framework which includes multiple dimensions: search experience, knowledge gain, software usability, cognitive load and user experience, based on studies of conversational systems and IR.

Conversational Search Information Retrieval

Kernel Density Estimation based Factored Relevance Model for Multi-Contextual Point-of-Interest Recommendation

no code implementations28 Jun 2020 Anirban Chakraborty, Debasis Ganguly, Annalina Caputo, Gareth J. F. Jones

An automated contextual suggestion algorithm is likely to recommend contextually appropriate and personalized 'points-of-interest' (POIs) to a user, if it can extract information from the user's preference history (exploitation) and effectively blend it with the user's current contextual information (exploration) to predict a POI's 'appropriateness' in the current context.

Density Estimation

Response to LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts

2 code implementations4 Jun 2020 Hao Wu, Gareth J. F. Jones, Francois Pitie

Recently the Chinese video sharing platform Bilibili, has popularised a novel captioning system where user comments are displayed as streams of moving subtitles overlaid on the video playback screen and broadcast to all viewers in real-time.

Creating a Data Collection for Evaluating Rich Speech Retrieval

no code implementations LREC 2012 Maria Eskevich, Gareth J. F. Jones, Martha Larson, Roel Ordelman,

We describe the development of a test collection for the investigation of speech retrieval beyond identification of relevant content.

Cannot find the paper you are looking for? You can Submit a new open access paper.