4 contributors

History: 67 commits

SFconvertbot

Adding `safetensors` variant of this model

fda5a56 over 1 year ago

text_collection
updated minimal line length about 3 years ago
.gitattributes

791 Bytes

Adding `safetensors` variant of this model over 1 year ago
.gitignore

7 Bytes

remove wandb, add gitignore over 3 years ago
README.md

9.37 kB

Add bias analysis over 3 years ago
added_tokens.json

24 Bytes

change endoftext value to len of tokenizer vocab size over 3 years ago
config.json

864 Bytes

Saving weights and logs of step 10000 over 3 years ago
create_config.py

257 Bytes

add config over 3 years ago
create_tokenizer.py

748 Bytes

add config over 3 years ago
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2

1.44 kB
LFS

Saving weights and logs of step 100 over 3 years ago
events.out.tfevents.1625843003.t1v-n-528d9406-w-0.250031.3.v2

2.95 MB
LFS

remove wandb, add gitignore over 3 years ago
events.out.tfevents.1625892207.t1v-n-528d9406-w-0.296755.3.v2

9.65 MB
LFS

Saving weights and logs of step 65000 over 3 years ago
flax_model.msgpack

1.42 GB
LFS

model udpate over 3 years ago
jax2torch.py

311 Bytes

update jax converter over 3 years ago
merges.txt

467 kB

refactor tokenizer related files with eos token over 3 years ago
model.safetensors

1.44 GB
LFS

Adding `safetensors` variant of this model over 1 year ago
pytorch_model.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.ByteStorage"
What is a pickle import?
1.44 GB
LFS

model udpate over 3 years ago
replace_token_script.py

2.93 kB

update <|endoftext|> tokenizer id from 50257 to 50256 over 3 years ago
run_clm_flax.py

28.4 kB

reorder "import jax" to avoid the stuck on importing it, change the dataset about 3 years ago
run_finetuning.sh

1.04 kB

put MODEL_DIR export separately about 3 years ago
run_pretraining.sh

992 Bytes

udpated the model and script to load local data over 3 years ago
special_tokens_map.json

90 Bytes

add tokenizers files over 3 years ago
tokenizer.json

1.82 MB

update <|endoftext|> tokenizer id from 50257 to 50256 over 3 years ago
tokenizer_config.json

207 Bytes

add tokenizers files over 3 years ago
vocab.json

1.05 MB

refactor tokenizer related files with eos token over 3 years ago

Detected Pickle imports (4)