Hugging Face
Models
Datasets
Spaces
Docs
Solutions
Pricing
Log In
Sign Up
bertin-project
/
bertin-roberta-base-spanish
Copied
like
22
Fill-Mask
PyTorch
JAX
TensorBoard
Safetensors
Transformers
bertin-project/mc4-es-sampled
Spanish
roberta
spanish
AutoTrain Compatible
arxiv:
2107.07253
arxiv:
1907.11692
License:
cc-by-4.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
1
Train
Deploy
Use in Transformers
v2
bertin-roberta-base-spanish
8 contributors
History:
196 commits
versae
Update README.md
725c101
11 months ago
configs
Changed and added vocab and tokenizer
over 1 year ago
evaluation
Adding stepwise 512 and fixing some markdown warnings
over 1 year ago
images
image style update
over 1 year ago
mc4
Add eval scripts
over 1 year ago
utils
Fixes and eval configs
over 1 year ago
.gitattributes
737 Bytes
initial commit
over 1 year ago
.gitignore
1.84 kB
Initial test with BETO's corpus
over 1 year ago
README.md
45.2 kB
Update README.md
11 months ago
config.json
674 Bytes
Add v2 files
11 months ago
config.py
256 Bytes
Preparing code for final runs
over 1 year ago
convert.py
876 Bytes
Improved version of conversion script Flax → PyTorch
over 1 year ago
events.out.tfevents.1625704081.t1v-n-a4d97d44-w-0.212075.3.v2
40 Bytes
LFS
Adding tfevents
over 1 year ago
events.out.tfevents.1625704245.t1v-n-a4d97d44-w-0.216676.3.v2
40 Bytes
LFS
Adding tfevents
over 1 year ago
events.out.tfevents.1625705283.t1v-n-a4d97d44-w-0.234462.3.v2
40 Bytes
LFS
Adding tfevents
over 1 year ago
flax_model.msgpack
499 MB
LFS
Add v2 files
11 months ago
get_embeddings_and_perplexity.py
1.53 kB
Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization.
over 1 year ago
merges.txt
509 kB
Add v2 files
11 months ago
perplexity.py
751 Bytes
Adding checkpointing, wandb, and new mlm script
over 1 year ago
pytorch_model.bin
pickle
Detected Pickle imports (4)
"collections.OrderedDict"
,
"torch.LongStorage"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
499 MB
LFS
Add v2 files
11 months ago
run.sh
883 Bytes
Adding base config and organizing configs
over 1 year ago
run_mlm_flax.py
30 kB
Adding sampling to mc4
over 1 year ago
run_mlm_flax_stream.py
35.2 kB
Fixes and eval configs
over 1 year ago
run_stream.sh
932 Bytes
Preparing code for final runs
over 1 year ago
special_tokens_map.json
772 Bytes
Add v2 files
11 months ago
tokenizer.json
2.21 MB
Add v2 files
11 months ago
tokenizer_config.json
1.12 kB
Add v2 files
11 months ago
tokens.py
649 Bytes
Scripts for perplexity sampling and fixes
over 1 year ago
tokens.py.orig
899 Bytes
Adjust batch size for extrating tokens
over 1 year ago
tsne_plot.py
3.02 kB
Remove unused imports
over 1 year ago
vocab.json
851 kB
Add v2 files
11 months ago