feat: add dropout support

fix: make `eos_token`/`pad_token` overridable and add `pickle` support

Update tokenizer_config.json

feat(tokenizer): expose merge ranks and special tokens for GGUF

Update README.md

Create LICENSE

init: release

init: release

initial commit