Model: cimphony-ai-admin/Cimphony-Mistral-Law-7B
Author: cimphony-ai-admin
Pipeline: text-generation
Library: peft
Tags: peft, safetensors, mistral, alignment-handbook, trl, sft, generated_from_trainer, text-generation, base_model:mistralai/Mistral-7B-v0.1, base_model:adapter:mistralai/Mistral-7B-v0.1, license:apache-2.0, model-index, region:us
Base models (adapter): id: mistralai/Mistral-7B-v0.1
Card metadata: license: apache-2.0
library_name: peft
tags: alignment-handbook, trl, sft, generated_from_trainer
base_model: mistralai/Mistral-7B-v0.1
model-index: name: Cimphony-Mistral-Law-7B
results: task: type: text-generation
dataset: type: cais/mmlu
name: MMLU
metrics: name: International Law
type: accuracy
value: 0.802
verified: no, task: type: text-generation
dataset: type: cais/mmlu
name: MMLU
metrics: name: Jurisprudence
type: accuracy
value: 0.704
verified: no, task: type: text-generation
dataset: type: cais/mmlu
name: MMLU
metrics: name: Professional Law
type: accuracy
value: 0.416
verified: no, task: type: text-generation
dataset: type: coastalcph/lex_glue
name: LexGLUE
metrics: name: ECtHR A
type: balanced accuracy
value: 0.631
verified: no, task: type: text-generation
dataset: type: coastalcph/lex_glue
name: LexGLUE
metrics: name: LEDGAR
type: balanced accuracy
value: 0.741
verified: no, task: type: text-generation
dataset: type: coastalcph/lex_glue
name: LexGLUE
metrics: name: CaseHOLD
type: accuracy
value: 0.776
verified: no, task: type: text-generation
dataset: type: coastalcph/lex_glue
name: LexGLUE
metrics: name: Unfair-ToS
type: balanced accuracy
value: 0.809
verified: no
pipeline_tag: text-generation
Likes: 3 | All-time downloads: 585
Created: 2024-05-10 18:58:33