Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy

15 Mar 2022  Â·  Yuanhan Zhang, Qinghong Sun, Yichun Zhou, Zexin He, Zhenfei Yin, Kun Wang, Lu Sheng, Yu Qiao, Jing Shao, Ziwei Liu ·

Large-scale datasets play a vital role in computer vision. But current datasets are annotated blindly without differentiation to samples, making the data collection inefficient and unscalable. The open question is how to build a mega-scale dataset actively. Although advanced active learning algorithms might be the answer, we experimentally found that they are lame in the realistic annotation scenario where out-of-distribution data is extensive. This work thus proposes a novel active learning framework for realistic dataset annotation. Equipped with this framework, we build a high-quality vision dataset -- Bamboo, which consists of 69M image classification annotations with 119K categories and 28M object bounding box annotations with 809 categories. We organize these categories by a hierarchical taxonomy integrated from several knowledge bases. The classification annotations are four times larger than ImageNet22K, and that of detection is three times larger than Object365. Compared to ImageNet22K and Objects365, models pre-trained on Bamboo achieve superior performance among various downstream tasks (6.2% gains on classification and 2.1% gains on detection). We believe our active learning framework and Bamboo are essential for future work.

PDF Abstract

Results from the Paper


 Ranked #1 on Image Classification on Food-101 (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Fine-Grained Image Classification Caltech-101 Bamboo (ViT-B/16) Accuracy 94.8 # 4
Image Classification CIFAR-10 Bamboo (ViT-B/16) Percentage correct 98.2 # 44
Image Classification CIFAR-100 Bamboo (ViT-B/16) Percentage correct 90.2 # 26
Image Classification DTD Bamboo (ViT-B/16) Accuracy 81.9 # 3
Image Classification Flowers-102 Bamboo (ViT-B/16) Accuracy 99.7 # 4
Image Classification Food-101 Bamboo (ViTB/16) Accuracy (%) 92.9 # 1
Image Classification ObjectNet ResNet-50 (Bamboo) Top-1 Accuracy 38.8 # 46
Image Classification ObjectNet Vit B/16 (Bamboo) Top-1 Accuracy 53.9 # 23
Image Classification OmniBenchmark Bamboo-R50 Average Top-1 Accuracy 45.4 # 3
Fine-Grained Image Classification Oxford-IIIT Pet Dataset Bamboo (ViT-B/16) Accuracy 95.1% # 8
Fine-Grained Image Classification Stanford Cars Bamboo (ViT-B/16) Accuracy 93.9% # 50
Fine-Grained Image Classification SUN397 Bamboo (ViT-B/16) Accuracy 79.5 # 3

Methods


No methods listed for this paper. Add relevant methods here