text-splitter (cargo): Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens (when used with large language models).
Keywords: text|ai|tokenizer|nlp|split