3 contributors

History: 30 commits

SFconvertbot

Adding `safetensors` variant of this model

412a643 almost 2 years ago

language_model
update lm almost 3 years ago
.gitattributes

1.32 kB

Adding `safetensors` variant of this model almost 2 years ago
.gitignore

66 Bytes

add language model almost 3 years ago
README.md

4.97 kB

Update README.md over 2 years ago
README_inital_step.md

2.06 kB

update readme for 2 step trainings almost 3 years ago
README_prev.md

2.96 kB

retrain with train-val-test split almost 3 years ago
Untitled.ipynb

1.38 MB

add some files almost 3 years ago
added_tokens.json

23 Bytes

add tokenizer almost 3 years ago
alphabet.json

763 Bytes

add language model almost 3 years ago
build_lm_processor.ipynb

5.22 kB

update lm almost 3 years ago
config.json

2.07 kB

add model almost 3 years ago
eval.py

4.93 kB

add evaluation score from eval.py almost 3 years ago
eval.sh

111 Bytes

add language model almost 3 years ago
inference.ipynb

8.84 kB

add language model almost 3 years ago
log_openslr_km_test_predictions.txt

38.3 kB

update readme result almost 3 years ago
log_openslr_km_test_targets.txt

38.5 kB

retrain with train-val-test split almost 3 years ago
model.safetensors

1.26 GB
LFS

Adding `safetensors` variant of this model almost 2 years ago
openslr_km_test_eval_results.txt

47 Bytes

update readme result almost 3 years ago
preprocessor_config.json

262 Bytes

add language model almost 3 years ago
pytorch_model.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
1.26 GB
LFS

add model almost 3 years ago
special_tokens_map.json

1.27 kB

add tokenizer almost 3 years ago
tokenizer_config.json

306 Bytes

add tokenizer almost 3 years ago
train-Copy1.ipynb

256 kB

update readme with training almost 3 years ago
train.ipynb

256 kB

update readme with training almost 3 years ago
train_kh.ipynb

1.88 MB

add tokenizer almost 3 years ago
train_kh_lm.ipynb

1.86 MB

add language model almost 3 years ago
training_args.bin
Detected Pickle imports (6)
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.TrainingArguments",
- "torch.device",
- "transformers.trainer_utils.IntervalStrategy"
How to fix it?
2.99 kB
LFS

retrain with train-val-test split almost 3 years ago
vocab.json

795 Bytes

add language model almost 3 years ago

Detected Pickle imports (3)

Detected Pickle imports (6)