README.md

metadata

library_name: transformers
license: other
base_model: tinycompany/ShawtyIsBad-nomic1.5
tags:
  - llama-factory
  - full
  - generated_from_trainer
model-index:
  - name: pretrain
    results: []

Task	Shot	Accuracy	Precision	Recall	F1 Score
indicxparaphrase	5	0.6119	0.9516	0.2358	0.3779
indicxparaphrase	0	0.7268	0.8650	0.5375	0.6630
indicxnli	0	0.4689	0.6390	0.4689	0.3782
indicxnli	5	0.5022	0.5180	0.5022	0.4651
indicsentiment	0	0.8367	0.7511	1.0000	0.8579
indicsentiment	5	0.9689	0.9894	0.9472	0.9678
indiccopa	0	0.6102	0.5701	0.8604	0.6858
indiccopa	5	0.7194	0.7000	0.7568	0.7273

Todo Tasks:

• indicheadline
• indicqa
• in22 Dataset link link doesnt work for now.
• Comparisons with other Indic models.