nlcodec (pypi): nlcodec is a collection of encoding schemes for natural language sequences.  nlcodec.db is a efficient storage and retrieval layer for integer sequences of varying lengths.
Keywords: bpe|nlp|preprocessing|text