4 contributors

History: 47 commits

cahya

added text collection

f126def almost 3 years ago

text_collection
added text collection almost 3 years ago
.gitattributes

737 Bytes

save checkpoint after 2000 steps almost 3 years ago
.gitignore

7 Bytes

remove wandb, add gitignore almost 3 years ago
README.md

119 Bytes

add wandb integration almost 3 years ago
added_tokens.json

24 Bytes

add tokenizers files almost 3 years ago
config.json

864 Bytes

Saving weights and logs of step 10000 almost 3 years ago
create_config.py

257 Bytes

add config almost 3 years ago
create_tokenizer.py

748 Bytes

add config almost 3 years ago
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2

1.44 kB
LFS

Saving weights and logs of step 100 almost 3 years ago
events.out.tfevents.1625843003.t1v-n-528d9406-w-0.250031.3.v2

2.95 MB
LFS

remove wandb, add gitignore almost 3 years ago
events.out.tfevents.1625892207.t1v-n-528d9406-w-0.296755.3.v2

9.65 MB
LFS

Saving weights and logs of step 65000 almost 3 years ago
flax_model.msgpack

1.42 GB
LFS

updated the models almost 3 years ago
jax2torch.py

311 Bytes

update jax converter almost 3 years ago
merges.txt

467 kB

add tokenizers files almost 3 years ago
pytorch_model.bin

1.44 GB
LFS

updated the models almost 3 years ago
run_clm_flax.py

28.4 kB

udpated the model and script to load local data almost 3 years ago
run_pretraining.sh

992 Bytes

udpated the model and script to load local data almost 3 years ago
special_tokens_map.json

90 Bytes

add tokenizers files almost 3 years ago
tokenizer.json

1.38 MB

add tokenizer almost 3 years ago
tokenizer_config.json

207 Bytes

add tokenizers files almost 3 years ago
vocab.json

808 kB

add tokenizers files almost 3 years ago