BERT-of-Theseus: Compressing BERT by Progressive Module Replacing

7 Feb 2020Canwen XuWangchunshu ZhouTao GeFuru WeiMing Zhou

In this paper, we propose a novel model compression approach to effectively compress BERT by progressive module replacing. Our approach first divides the original BERT into several modules and builds their compact substitutes... (read more)

PDF Abstract

Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.