bertin-project/bertin-roberta-base-spanish at 3f09f56171a9b579447aa2e151140b67acdaf015

bertin-roberta-base-spanish

8 contributors

History: 18 commits

versae's picture

Adding sampling to mc4

3f09f56 almost 3 years ago

mc4
Adding sampling to mc4 almost 3 years ago
.gitattributes

690 Bytes

initial commit almost 3 years ago
.gitignore

1.84 kB

Initial test with BETO's corpus almost 3 years ago
README.md

1.84 kB

Adding checkpointing, wandb, and new mlm script almost 3 years ago
config.json

619 Bytes

Initial test with BETO's corpus almost 3 years ago
config.py

247 Bytes

Scripts for perplexity sampling and fixes almost 3 years ago
convert.py

458 Bytes

Scripts for perplexity sampling and fixes almost 3 years ago
flax_model.msgpack

712 MB
LFS

Adding correct models 10k steps almost 3 years ago
get_embeddings_and_perplexity.py

1.53 kB

Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization. almost 3 years ago
perplexity.py

751 Bytes

Adding checkpointing, wandb, and new mlm script almost 3 years ago
pytorch_model.bin

1.42 GB
LFS

Adding correct models 10k steps almost 3 years ago
run.sh

978 Bytes

Updating run script almost 3 years ago
run_mlm_flax.py

30 kB

Adding sampling to mc4 almost 3 years ago
run_mlm_flax_stream.py

28 kB

Adding sampling to mc4 almost 3 years ago
run_stream.sh

928 Bytes

Adding sampling to mc4 almost 3 years ago
tokenizer.json

1.45 MB

Initial test with BETO's corpus almost 3 years ago
tokens.py

649 Bytes

Scripts for perplexity sampling and fixes almost 3 years ago
tokens.py.orig

899 Bytes

Adjust batch size for extrating tokens almost 3 years ago
tsne_plot.py

3.02 kB

Remove unused imports almost 3 years ago