RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
Claim: From Figure 7 , we observe that GPT-4o is a strong teacher, Mistral-v0.2 (7B) fine-tuned on GPT-4o distilled training data achieves the rank 2 outperforming the Llama-3 (70B) model.
Context: Does fine-tuning on \mirage training data help? We evaluate three variants of the \mirage training dataset using two backbones: Mistral-v0.2 (7B) and Llama-3 (8B). We fine-tune the \mirage training datasets using (i) both on GPT-4o, (ii) Llama-3 (8B) on Llama-3 (70B), and (iii) Mistral-v0.2 (7B) on Mixtral (8x22B).
Caption: Figure 7: Approximate rankings using heuristic features after fine-tuning Llama-3 (8B) and Mistral-v0.2 (7B) on \mirage dataset across four configurations.