gpt-tokenizer (npm): A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
Keywords: BPE|encoder|decoder|tokenizer|GPT|GPT-2|GPT-3|GPT-3.5|GPT-4|NLP|Natural Language Processing|Text Generation|OpenAI|Machine Learning|ml|bpe|gpt-2|gpt-3|gpt-4|machine-learning|openai