indic_nlp_library/docs/indicnlp.tokenize.rst

tokenize Package
================

:mod:`indic_tokenize` Module
----------------------------

.. automodule:: indicnlp.tokenize.indic_tokenize
    :members:
    :undoc-members:
    :show-inheritance:

:mod:`indic_detokenize` Module
------------------------------

.. automodule:: indicnlp.tokenize.indic_detokenize
    :members:
    :undoc-members:
    :show-inheritance:

:mod:`sentence_tokenize` Module
----------------------------

.. automodule:: indicnlp.tokenize.sentence_tokenize
    :members:
    :undoc-members:
    :show-inheritance: