|
--- |
|
license: wtfpl |
|
--- |
|
# CausalLM 34B β |
|
|
|
## MT-Bench: 8.5 |
|
|
|
![mt-bench](https://cdn-uploads.huggingface.co/production/uploads/63468a143ea42ee2cb49ddd1/2vv2_nGbfWuOM8jwy40dn.png) |
|
|
|
## Konwledge cutoff: |
|
|
|
ALL: 2023-06 (pretrained) |
|
|
|
**Some** General Knowledge and Politics: 2024-02-01 |
|
|
|
|
|
## Some contamination detection if you want to check: |
|
|
|
| Models | MMLU (ref: llama7b) | TBA | |
|
| ------------------------- | ------------------- | ---- | |
|
| microsoft/Orca-2-7b | 0.77 | | |
|
| mistralai/Mistral-7B-v0.1 | 0.46 | | |
|
| **CausalLM/34b-beta** | **0.38** | | |
|
| 01-ai/Yi-6B-200K | 0.3 | | |
|
|
|
data from https://huggingface.co/spaces/Yeyito/llm_contamination_detector |
|
|
|
It should be *safe*. It was not trained on the benchmark, but the contamination of the training dataset is unavoidable due to cost constraints. |