Before revision:  Our method trains to convergence using 40\% fewer batches than normal finetuning, and achieves a median perplexity of 54.0 on a books dataset compared to a median perplexity of 57.3 for standard finetuning using the same neural architecture .
After revision:  Our method trains to convergence using 40\% fewer batches than normal finetuning, and achieves a median perplexity of 54.0 on a books dataset compared to 57.3 for standard finetuning using the same neural architecture .