update parameter count
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ model-index:
|
|
| 30 |
|
| 31 |
# TinyStarCoderPy
|
| 32 |
|
| 33 |
-
This is a
|
| 34 |
for ~6 epochs which amounts to 100B tokens.
|
| 35 |
|
| 36 |
|
|
|
|
| 30 |
|
| 31 |
# TinyStarCoderPy
|
| 32 |
|
| 33 |
+
This is a 164M parameters model with the same architecture as [StarCoder](https://huggingface.co/bigcode/starcoder) (8k context length, MQA & FIM). It was trained on the Python data from [StarCoderData](https://huggingface.co/datasets/bigcode/starcoderdata)
|
| 34 |
for ~6 epochs which amounts to 100B tokens.
|
| 35 |
|
| 36 |
|