2 contributors

History: 36 commits

yhavinga

Retrain tokenizer for case sensitive

a37447a almost 3 years ago

clean
Saving weights and logs of step 900 almost 3 years ago
runs
Update scripts to work around collator valueerror. Update weights almost 3 years ago
.gitattributes

737 Bytes

initial commit almost 3 years ago
.gitignore

38 Bytes

Saving weights and logs of step 300 almost 3 years ago
Determine_batch_size.ipynb

6.45 kB

Saving weights and logs of step 16000 almost 3 years ago
Load_preprocessed_dataset.ipynb

3.54 kB

Saving weights and logs of step 16000 almost 3 years ago
Load_token_group_dataset.ipynb

34.1 kB

Update scripts. Add dataset load check notebook almost 3 years ago
config.json

1.42 kB

Update scripts to work around collator valueerror. Update weights almost 3 years ago
create_config.py

148 Bytes

Add config, tokenizer and training script almost 3 years ago
flax_model.msgpack

892 MB
LFS

Update scripts to work around collator valueerror. Update weights almost 3 years ago
flax_to_pt.py

158 Bytes

Saving weights and logs of step 600 almost 3 years ago
opt_state.msgpack

1.99 MB
LFS

Update scripts to work around collator valueerror. Update weights almost 3 years ago
pytorch_model.bin

892 MB
LFS

Update scripts to work around collator valueerror. Update weights almost 3 years ago
run_t5.sh

1.4 kB

Update scripts to work around collator valueerror. Update weights almost 3 years ago
run_t5_mlm_flax.py

73 Bytes

Add config, tokenizer and training script almost 3 years ago
run_t5_mlm_flax_custom_dataset.py

44.4 kB

Update scripts to work around collator valueerror. Update weights almost 3 years ago
streaming_dataset_filter_test.py

546 Bytes

Saving weights and logs of step 1500 almost 3 years ago
t5_tokenizer_model.py

76 Bytes

Add config, tokenizer and training script almost 3 years ago
tokenizer.json

1.03 MB

Retrain tokenizer for case sensitive almost 3 years ago
train_tokenizer.py

2 kB

Retrain tokenizer for case sensitive almost 3 years ago
training_state.json

15 Bytes

Update scripts to work around collator valueerror. Update weights almost 3 years ago