Before revision: We present a general finetuning meta-method that we call information gain filtration for improving the overall training efficiency and final performance of language model finetuning.
After revision: We present a general fine-tuning method that we call information gain filtration for improving the overall training efficiency and final performance of language model finetuning.