NarrowBERT: Accelerating Masked Language Model Pretraining and Inference

Published in ACL, 2023

Recommended citation: Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, and Noah A. Smith. 2023. "NarrowBERT: Accelerating Masked Language Model Pretraining and Inference." Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2301.04761