EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (2021) - Comments
doi: 10.18653/v1/2021.acl-long.171 

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu