1 contributor

History: 5 commits

TroyDoesAI

Attempt #2 at Context obedient for 128k context model, trained longer at lower LR.

ab78bdb verified about 2 months ago

.gitattributes

1.52 kB

initial commit about 2 months ago
README.md

3.18 kB

Update README.md about 2 months ago
added_tokens.json

306 Bytes

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
config.json

3.48 kB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
configuration_phi3.py

10.4 kB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
generation_config.json

183 Bytes

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
model-00001-of-00002.safetensors
4.97 GB
LFS

Attempt #2 at Context obedient for 128k context model, trained longer at lower LR. about 2 months ago
model-00002-of-00002.safetensors

2.67 GB
LFS

Attempt #2 at Context obedient for 128k context model, trained longer at lower LR. about 2 months ago
model.safetensors.index.json

16.5 kB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
modeling_phi3.py

73.8 kB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
special_tokens_map.json

599 Bytes

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
tokenizer.json

1.84 MB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
tokenizer.model

500 kB
LFS

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago
tokenizer_config.json

3.3 kB

1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. about 2 months ago