Finetuning Pretrained Transformers into RNNs

Published in EMNLP, 2022

Recommended citation: Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, and Noah A. Smith. 2021. "Finetuning Pretrained Transformers into RNNs." Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). https://arxiv.org/abs/2103.13076