Notebook to encode splitted YFCC100M files.
82fad8c
Pedro Cuenca
commited on
Spaces:
Running
Running
Commit History
change bart-large-cnn to bart-large in demo folder
5801f13
Ritobrata Ghosh
commited on
Shift tokens in numpy because the built in shift function stalls.
835ea55
Pedro Cuenca
commited on
fix: should be converted to array
945d86c
fix: labels array
6c1f112
fix: typo
678a62f
Merge pull request #17 from borisdayma/fix-model
357779a
unverified
fix: model config
0be4942
fix: correct decoder_input_ids and labels
19946be
Merge pull request #16 from borisdayma/feat-log_model
bf4da91
unverified
feat: don't log model by default
5b79afd
fix: typo
47bc7b9
feat: fix typo
ec8d66b
feat: log model
1c44a7d
doc: fix comment
3073ff4
feat: update default parameters
dbe8c41
feat: output_length considers bos and eos
8bb2236
fix: missing arg
bc01f78
[WIP] Encoding YFC100M dataset.
b4dfea0
Pedro Cuenca
commited on
Merge pull request #15 from borisdayma/feat-fix-lr
dc5ae57
unverified
feat: requirements for tb logging
8884d40
feat: shared cache folder
42ce7dd
feat: update lr range
dbbd01a
fix: accumulation vs lr
4d55db6
Move generate nb by @ghosh-r to demo
dcbf091
Pedro Cuenca
commited on
Merge pull request #14 from khalidsaifullaah/main
66bfb99
unverified
Merge pull request #13 from borisdayma/model-generate-notebook
894a546
unverified
Updated with train_file flag to resolve the error
8f058ae
unverified
notebook example for model.generate
67221fc
Ritobrata Ghosh
commited on
text-heneration-notebook
1c2552a
Ritobrata Ghosh
commited on
feat: update sweep parameters
2f69241
feat: update script
650ecb1
fix: wandb logging with sync_tensorboard
8ba598c
Merge pull request #12 from borisdayma/feat-sweeps
06f1345
unverified
feat: add sweep for parameter search
dad6d93
feat: lower default source length
48c07ca
Merge pull request #11 from borisdayma/feat-cumul
ba73e00
unverified
fix: typos
5960e87
feat: gradient accumulation
c9e9575
Merge pull request #10 from borisdayma/feat-loss
cbeacb9
unverified
feat: simplify loss function
9db361a
feat: padding mask not required
d61405b
fix: typo
833a2d5
feat: default to 1000 warmup steps
b66b951
feat: add adafactor
600ad79
feat: log metrics more frequently
498559f
* Make padding mask optional.
ecafe5e
Pedro Cuenca
commited on
* Only perform validation if requested
32dc2d8
Pedro Cuenca
commited on
Preprocessing: return "labels", "decoder_input_ids" and
df3c7bd
Pedro Cuenca
commited on