abacusai
/

Smaug-Llama-3-70B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

siddartha-abacus commited on Jun 3

Commit

2a6e114

•

1 Parent(s): d11fb56

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -142,7 +142,8 @@ Meta-Llama-3-70B-Instruct           9.006250
 of the [LM Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness/).
 The commit used by the leaderboard has a significant issue that impacts models that
 tend to use `:` in their responses due to a bug in the stop word configuration for
-GSM8K. The issue is discussed in more detail at [GSM8K eval issue](http://fixme).
 The score for both Llama-3 and this model are significantly different when evaluated
 with the updated harness as the issue with stop words has been addressed.

 of the [LM Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness/).
 The commit used by the leaderboard has a significant issue that impacts models that
 tend to use `:` in their responses due to a bug in the stop word configuration for
+GSM8K. The issue is covered in more detail at
+[GSM8K eval issue discussion](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/770).
 The score for both Llama-3 and this model are significantly different when evaluated
 with the updated harness as the issue with stop words has been addressed.