Search Results for author:
Found 10 papers, 4 papers with code
How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods
Researchers evaluate the quality of those methods by measuring the correlation between the known gold ranking of systems under the full collection and the observed ranking of systems under the lower-cost one.
Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education
This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together 37 participants from 12 countries.
Query Performance Prediction for Neural IR: Are We There Yet?
On top of that, in lexical-oriented scenarios, QPPs fail to predict performance for neural IR systems on those queries where they differ from traditional approaches the most.
Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales"
Moffat's comments build on: (i) misconceptions about the representational theory of measurement, such as what an interval scale actually is and what axioms it has to comply with; (ii) they totally miss the central concept of meaningfulness.
Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks
The noise is due to a fatal bug in the backend of our relevance assessment interface.
A deep learning approach for detection and localization of leaf anomalies
The detection and localization of possible diseases in crops are usually automated by resorting to supervised deep learning approaches.
Towards Feature Selection for Ranking and Classification Exploiting Quantum Annealers
By removing redundant or noisy features, the accuracy of ranking or classification can be improved and the computational cost of the subsequent learning steps can be reduced.
repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments.
Towards Meaningful Statements in IR Evaluation. Mapping Evaluation Measures to Interval Scales
Recently, it was shown that most popular IR measures are not interval-scaled, implying that decades of experimental IR research used potentially improper methods, which may have produced questionable results.
How to Measure the Reproducibility of System-oriented IR Experiments
Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception.
