Salesforce
/

xgen-7b-8k-base

Text Generation

text-generation-inference

Model card Files Files and versions Community

xgen-7b-8k-base / tokenization_xgen.py

Commit History

Update _decode method to accept integer element and convert it to sequence

154b411

ramkrithiks commited on Oct 19, 2023

Update tokenization_xgen.py (#28)

6d7139b

rooa commited on Aug 18, 2023

fix issue in get vocab (#18)

1a0f468

tianxie-sf commited on Jul 7, 2023

_convert_id_to_token (#12)

3987e09

tianxie-sf commited on Jul 2, 2023

Tokenization updates (#8)

f12f979

psinger commited on Jun 30, 2023

add pad token and default eos token (#6)

e9a901f

tianxie-sf commited on Jun 29, 2023

.

d2cc612

rooa commited on Jun 28, 2023

.

b9f4adf

rooa commited on Jun 28, 2023

.

04d6513

rooa commited on Jun 28, 2023