bertin-project/bertin-roberta-base-spanish at dd7ee736901b46d87e653e80a0f43468792a2ce2

bertin-roberta-base-spanish

8 contributors

History: 66 commits

Pablo

Addded random_512.jpg image

dd7ee73 over 1 year ago

configs
Changed and added vocab and tokenizer over 1 year ago
images
Addded random_512.jpg image over 1 year ago
mc4
Fixing restore checkpoint step over 1 year ago
utils
Explanations over 1 year ago
.gitattributes

737 Bytes initial commit over 1 year ago
.gitignore

1.84 kB Initial test with BETO's corpus over 1 year ago
README.md

13.2 kB Update README.md over 1 year ago
config.json

618 Bytes Fix config for checkpoint over 1 year ago
config.py

256 Bytes Preparing code for final runs over 1 year ago
convert.py

876 Bytes Improved version of conversion script Flax → PyTorch over 1 year ago
events.out.tfevents.1625704081.t1v-n-a4d97d44-w-0.212075.3.v2

40 Bytes
LFS
Adding tfevents over 1 year ago
events.out.tfevents.1625704245.t1v-n-a4d97d44-w-0.216676.3.v2

40 Bytes
LFS
Adding tfevents over 1 year ago
events.out.tfevents.1625705283.t1v-n-a4d97d44-w-0.234462.3.v2

40 Bytes
LFS
Adding tfevents over 1 year ago
flax_model.msgpack

250 MB
LFS
Model at 211k steps, mlm ac 0.6547 over 1 year ago
get_embeddings_and_perplexity.py

1.53 kB Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization. over 1 year ago
merges.txt

505 kB Changed and added vocab and tokenizer over 1 year ago
perplexity.py

751 Bytes Adding checkpointing, wandb, and new mlm script over 1 year ago
pytorch_model.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.LongStorage",
- "torch.FloatStorage"
What is a pickle import?
499 MB
LFS
Model at 211k steps, mlm ac 0.6547 over 1 year ago
run.sh

883 Bytes Adding base config and organizing configs over 1 year ago
run_mlm_flax.py

30 kB Adding sampling to mc4 over 1 year ago
run_mlm_flax_stream.py

32.9 kB Fixing restore checkpoint step over 1 year ago
run_stream.sh

932 Bytes Preparing code for final runs over 1 year ago
special_tokens_map.json

239 Bytes Changed and added vocab and tokenizer over 1 year ago
tokenizer.json

1.45 MB Changed and added vocab and tokenizer over 1 year ago
tokenizer_config.json

292 Bytes Changed and added vocab and tokenizer over 1 year ago
tokens.py

649 Bytes Scripts for perplexity sampling and fixes over 1 year ago
tokens.py.orig

899 Bytes Adjust batch size for extrating tokens over 1 year ago
tsne_plot.py

3.02 kB Remove unused imports over 1 year ago
vocab.json

846 kB Changed and added vocab and tokenizer over 1 year ago