…Japanese-English) corpus of patent abstracts, extracted from the MAREC patent data, and the data from the NTCIR PatentMT workshop collections, accompanied with relevance judgements for the task of patent prior-art
2 PAPERS • NO BENCHMARKS YET
…(bachelor_of_arts, juris_doctor).
202 PAPERS • 3 BENCHMARKS
…Either way, thank you—you contributed to the state-of-the-art in the NLP field.
3 PAPERS • NO BENCHMARKS YET
…The images were obtained by running a state-of-the-art person detector on every tenth frame of 30 movies.
45 PAPERS • 2 BENCHMARKS
…We also propose a benchmark of experiments using DemogPairs over state-of-the-art deep face recognition models in order to analyze their cross-demographic behavior and potential demographic biases (see
7 PAPERS • NO BENCHMARKS YET
…Using state-of-the-art computer vision algorithms, the positional error is typically less than 10 centimetres.
40 PAPERS • NO BENCHMARKS YET
…The goal of this dataset is to boost research on exploitation of interferometric data enabling the application of state-of-the-art computer vision+NLP methods.
…interactive traffic scenes 1,071,302 3D bounding box labels 8 common classes of traffic participants (Manually annotated every 2Hz and linearly propagated for 10 Hz data) Benchmarked on state-of-the art
33 PAPERS • NO BENCHMARKS YET
…See our paper Training and Evaluating a Jupyter Notebook Data Science Assistant for more details about state of the art results and other properties of the dataset.
6 PAPERS • NO BENCHMARKS YET
…This dataset poses a significant challenge to state-of-the-art vision models as merely zooming in often fails to improve their ability to classify images correctly.
2 PAPERS • 1 BENCHMARK
…Chinese education system, ranging from the primary school to college, as well as a wide variety of subjects, including humanities, history, politics, law, education, psychology, science, technology, art
13 PAPERS • NO BENCHMARKS YET
DELAUNAY is a dataset of abstract paintings and non-figurative art objects labelled by the artists' names.
…A day-based anchored cross-validation experimental protocol is also provided that can be used as a benchmark for comparing the performance of state-of-the-art methodologies.
1 PAPER • NO BENCHMARKS YET
…Several state-of-the-art deep learning models are used to enrich the data with important attributes, including sentiment labels, named-entities (e.g., mentions of persons, organizations, locations), user
…News, Politics, Sports, Weather, Business, Technology, Science, Health, Family, Education, Entertainment and Arts).
27 PAPERS • 6 BENCHMARKS
…Using this new dataset, we assess the impact of two state-of-the-art NMT systems, Google Translate and the multilingual mBART-50 model, on translation productivity.
The ALT project aims to advance the state-of-the-art Asian natural language processing (NLP) techniques through the open collaboration for developing and using ALT.
0 PAPER • NO BENCHMARKS YET
…textual question answering benchmark for spatial reasoning on natural language text which contains more realistic spatial phenomena not covered by prior datasets and that is challenging for state-of-the-art
9 PAPERS • NO BENCHMARKS YET
…It relies on the open access collection from the Metropolitan Museum of Art (The Met) in New York to form the training set, which consists of about 400k images from more than 224k classes, with artworks
OLPBENCH is a large Open Link Prediction benchmark, which was derived from the state-of-the-art Open Information Extraction corpus OPIEC (Gashteovski et al., 2019).
4 PAPERS • NO BENCHMARKS YET
…With the goal of advancing the state-of-the-art in automatic classification, the Grand Challenge on BreAst Cancer Histology images (BACH) was organized in conjunction with the 15th International Conference The submitted algorithms improved the state-of-the-art in automatic classification of breast cancer with microscopy images to an accuracy of 87%.
…Using state-of-the-art computer vision algorithms, the positioning error is typically less than ten centimeters.
96 PAPERS • NO BENCHMARKS YET
…In contrast to prior efforts, the proposed database contains genuine and replayed recordings of voice commands obtained in realistic usage scenarios and using state-of-the-art voice assistant development
…Evaluation results from two state-of-the-art SMAD systems are also provided as a benchmark for future reference.
…We also conducted extensive empirical evaluation of state-of-the-art methods across supervised and transfer learning settings.
…This paper presents a machine-learning approach for automatic language identification for the Nordic languages, which often suffer miscategorization by existing state-of-the-art tools.
1 PAPER • 1 BENCHMARK
…The adversarial human annotation paradigm ensures that these datasets consist of questions that current state-of-the-art models (at least the ones used as adversaries in the annotation loop) find challenging
24 PAPERS • 2 BENCHMARKS
…We also add state-of-the-art foundation models such as CLIP and GPT-3.5-Turbo to our benchmark.
…This makes it easy to benchmark against other state-of-the-art text generative models that are capable of generating long paragraphs of coherent text.
3 PAPERS • 1 BENCHMARK
FathomNet is an open-source image database that can be used to train, test, and validate state-of-the-art artificial intelligence algorithms to help us understand our ocean and its inhabitants.
5 PAPERS • NO BENCHMARKS YET
The Drive&Act dataset is a state of the art multi modal benchmark for driver behavior recognition.
18 PAPERS • 1 BENCHMARK
…We conduct a series of domain- and language-transfer experiments with state-of-the-art monolingual and multilingual transformer models, setting strong baseline results and profiling XHate-999 as a comprehensive
…Difficulty of exploration, using states of the art algorithms and imitation to generate data for difficult environments. Real world challenges.
…dataset is a large-scale image dataset that aims to include a diverse collection of real and synthetic images from multiple categories, including Human/Human Faces, Animal/Animal Faces, Places, Vehicles, Art including 13 GANs, 7 Diffusion, and 5 miscellaneous generators) Number of sources used for real images: 8 Categories included in the dataset: Human/Human Faces, Animal/Animal Faces, Places, Vehicles, Art
…In this paper, we have implemented state-of-the-art deep learning-based methods for table detection to create several strong baselines.
…In order to showcase some of the dataset’s capabilities, we ran multiple relevant experiments using state-of-the-art algorithms from the field of autonomous driving.
33 PAPERS • 1 BENCHMARK
…We describe how the dataset was created and present a first evaluation of state-of-the-art visual question-answering models, showing that QLEVR presents a formidable challenge to our current models.
…While all questions directly relate to the passage, the English dataset on its own proves difficult enough to challenge state-of-the-art language models.
19 PAPERS • NO BENCHMARKS YET
…VIS30K’s comprehensive coverage of the scientific literature in visualization not only reflects the progress of the field but also enables researchers to study the evolution of the state-of-the-art and
…It is procedurally generated, rich in entities and dynamics, and overall an extremely challenging environment for current state-of-the-art RL agents, while being much cheaper to run compared to other challenging
19 PAPERS • 1 BENCHMARK
…These annotations are generated by various state-of-the-art language models (LLMs) and include detailed descriptions of the activities being performed, the count of people present, and their specific poses
…With NExT-GQA, we scrutinize a variety of state-of-the-art VLMs.
8 PAPERS • 1 BENCHMARK
…We present extensive quantitative evaluation results of the state-of-the-art methods on this benchmark dataset and discuss the potential research directions in this field.
…The ability to form and abstract concepts is key to human intelligence, but such abilities remain lacking in state-of-the-art AI systems.
…The vehicle path trajectory in these datasets contain several large and small-scale loop closures, which should be useful for testing various state of the art computer vision and SLAM (Simultaneous Localization
…Moreover, eleven state-of-the-art algorithms are evaluated on the benchmark using two evaluation metrics, with detailed analysis provided for the evaluation results.
…On this benchmark, we evaluated existing state-of-the-art SLAM algorithms of various designs and analyzed their characteristics and defects individually.
20 PAPERS • NO BENCHMARKS YET