itsliupeng's picture
Update README.md
e45d1bc
|
raw
history blame
No virus
642 Bytes
metadata
license: apache-2.0

Just to obtain metrics from the HuggingFaceH4/open_llm_leaderboard.

To evaluate the impact of increasing the number of experts, modify the num_experts_per_tok setting in the config.json file from 2 to 3. This alteration aims to specifically determine if such a change leads to any notable improvements in performance metrics.

Other details to note include that the model weights are directly copied from the source available at https://huggingface.co/mistralai/Mixtral-8x7B-v0.1.

image/png