Commit History

feat: update sweep parameters
2f69241

boris commited on

feat: update script
650ecb1

boris commited on

fix: wandb logging with sync_tensorboard
8ba598c

boris commited on

Merge pull request #12 from borisdayma/feat-sweeps
06f1345
unverified

boris commited on

feat: add sweep for parameter search
dad6d93

boris commited on

feat: lower default source length
48c07ca

boris commited on

Merge pull request #11 from borisdayma/feat-cumul
ba73e00
unverified

boris commited on

fix: typos
5960e87

boris commited on

feat: gradient accumulation
c9e9575

boris commited on

Merge pull request #10 from borisdayma/feat-loss
cbeacb9
unverified

boris commited on

feat: simplify loss function
9db361a

boris commited on

feat: padding mask not required
d61405b

boris commited on

Merge pull request #9 from borisdayma/feat--wandb-search
61f888f
unverified

boris commited on

fix: typo
833a2d5

boris commited on

feat: default to 1000 warmup steps
b66b951

boris commited on

feat: add adafactor
600ad79

boris commited on

feat: log metrics more frequently
498559f

boris commited on

* Make padding mask optional.
ecafe5e

Pedro Cuenca commited on

* Only perform validation if requested
32dc2d8

Pedro Cuenca commited on

Preprocessing: return "labels", "decoder_input_ids" and
df3c7bd

Pedro Cuenca commited on

Decoder: set eos to an unreachable value, set min_length=max_length to
a841a4c

Pedro Cuenca commited on

accept tsv files as inputs.
a104edb

Pedro Cuenca commited on

val_max_target_length set to OUTPUT_LENGTH
6c27b0d

Pedro Cuenca commited on

use pylogging to refer to logging.
d9f5a35

Pedro Cuenca commited on

fix typos and update requirements
de74f11

Pedro Cuenca commited on

Merge pull request #8 from pcuenca/main
9c0e5c9
unverified

boris commited on

feat: adjust seq2seq script for dalle
3f0364c

boris commited on

feat: add seq2seq requirements
fad333f

boris commited on

feat: add run_seq2seq_flax
46cb01f

boris commited on

* Prepend [bos] to image encodings, rename to "labels".
86ba774

Pedro Cuenca commited on

* Data preprocessing pipeline proof of concept.
95d2faf

Pedro Cuenca commited on

* Notebook that processes CC12M and creates a version with encodings.
16f038a

Pedro Cuenca commited on

* dalle_mini package with models and utilities:
150ed18

Pedro Cuenca commited on

* Ignore __pycache__
550b472

Pedro Cuenca commited on

* JIT outside the loop.
4b8c3a8

Pedro Cuenca commited on

* Initial encoding tests.
eb912a1

Pedro Cuenca commited on

Merge pull request #7 from khalidsaifullaah/main
1055c3d
unverified

boris commited on

Merge pull request #2 from pcuenca/main
8b9d1f5
unverified

boris commited on

* Update README with `-f` instructions for pip.
df7b7be

Pedro Cuenca commited on

Merge pull request #4 from khalidsaifullaah/main
11c8be9
unverified

boris commited on

* Simplify requirements.txt, do not pin packages.
ccd00b6

Pedro Cuenca commited on

Merge pull request #3 from khalidsaifullaah/patch-1
182f15a
unverified

boris commited on

Updated the README based on our current strategy
bcac695
unverified

khalidsaifullaah commited on

* Update requirements for TPU support.
d86c32f

Pedro Cuenca commited on

pip and conda cpu install
bdaeeba

lkhphuc commited on

Create README.md
b0b9920

Boris Dayma commited on

Create README.md
68b5b51

Boris Dayma commited on