Fine Tuning for Classification

#129
by MUHAMMAD-SOHAIL-ZZU - opened

Can anyone explain how I fine-tune Mistral 7b for classification purposes?

It might be extremely overkill to fine tune Mistral for such tasks, there are models designed specifically for classification after all... is there a reason why you want to use an LLM such as Mistral for that?

May be Mistral 7b yield valuable insights or performance improvements compared to more traditional classification models.

May be Mistral 7b yield valuable insights or performance improvements compared to more traditional classification models.

https://colab.research.google.com/drive/1Dyauq4kTZoLewQ1cApceUQVNcnnNTzg_?usp=sharing#scrollTo=2eSvM9zX_2d3

Here just optimize the probability of the yes/no tokens

It might be extremely overkill to fine tune Mistral for such tasks, there are models designed specifically for classification after all... is there a reason why you want to use an LLM such as Mistral for that?

can you leave some names/links! would be great help!

Sign up or log in to comment