Before revision:  In our evaluation on fact verification systems , we show that fine-tuning with EWC Pareto dominates standard fine-tuning, yielding models  lower levels of URLetting on the original task for equivalent gains in accuracy on the fine-tuned task.
After revision:  In our evaluation on fact verification systems , we show that fine-tuning with EWC Pareto dominates standard fine-tuning, yielding models lower levels of URLetting on the original (biased) dataset for equivalent gains in accuracy on the fine-tuned task.