Hugging Face's logo

tokiers
/
gpt2

tokie
Model card Files
xet
 Community
gpt2 / tokenizer.tkz
bhavnicksm's picture
bhavnicksm
Update tokenizer.tkz to v11 (with pad_token_id)
6b45db9 verified
download
history blame contribute delete
3.3 MB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
cfeb5aba80b4be83262d1b33caa238ac1998bd33b410324086f297f486bd2888
Size of remote file:
3.3 MB
·
SHA256:
343864b43ad2e2856575cad505537ce214475099cc44db1cf60bd252289f300c

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.