metadata
license: wtfpl
CausalLM 34B β
MT-Bench: 8.5
Konwledge cutoff:
ALL: 2023-06 (pretrained)
Some General Knowledge and Politics: 2024-02-01
Some contamination detection if you want to check:
| Models | MMLU (ref: llama7b) | TBA |
|---|---|---|
| microsoft/Orca-2-7b | 0.77 | |
| mistralai/Mistral-7B-v0.1 | 0.46 | |
| CausalLM/34b-beta | 0.38 | |
| 01-ai/Yi-6B-200K | 0.3 |
data from https://huggingface.co/spaces/Yeyito/llm_contamination_detector
It should be safe. It was not trained on the benchmark, but the contamination of the training dataset is unavoidable due to cost constraints.