qwerrwe / tests /fixtures

Commit History

fix test fixture b/c hf trainer tokenization changed (#464)
d5dcf9c
unverified

winglian commited on

fix fixture for new tokenizer handling in transformers (#428)
8cace80
unverified

winglian commited on

experimental llama 2 chat support (#296)
3392270
unverified

Jan Philipp Harries Jan Philipp Harries commited on

fix packing so that concatenated sequences reset the attention
9b8585d

winglian commited on

Fix pre-commit for rebased files
b81c97f

Nanobit commited on

add unit test for sharegpt tokenization
e6fdeb0

winglian commited on