Efficient Packing: Towards 2x NLP Speed-Up without Loss of Accuracy for BERT

no code implementations • 29 Sep 2021 • Matej Kosec, Sheng Fu, Mario Michael Krell

The shortest-pack-first histogram-packing (SPFHP) algorithm determines the packing order for the Wikipedia dataset of over 16M sequences in 0. 02 seconds.