Before revision:  To solve this problem, we propose Taking Notes on the Fly (TNF) . TNF takes notes for rare words on the fly during pre-training to help the model understand them when they occur next time.
After revision:  To mitigate this problem, we propose Taking Notes on the Fly (TNF) . TNF takes notes for rare words on the fly during pre-training to help the model understand them when they occur next time.