Text denormalization
State: closed | Pull request: yes

* added nemo_tools sub package with python requirements and setup.sh
* added doc strings
* added text denormalization to nemo_tools
* added pytests and pynini tests
* added export option for inverse text normalization to NeMo/tools

This pull request **introduces 55 alerts** when merging 0760edf72a1c9210a4b84081f52a4ebb69f91408 into db5a787f460d67f0cd89b400cf81826fa2cc9ed6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-b2818a87c73567cb6706894ac48ef65064c145a5)

**new alerts:**

* 49 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 1 alert** when merging e807860c5f1d14e675255e3d89d917f74de96e09 into db5a787f460d67f0cd89b400cf81826fa2cc9ed6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-eac33ae64d795dbdc1df8d0314b67c00540d5314)

**new alerts:**

* 1 for Unused local variable

This pull request **introduces 1 alert** when merging f2a75637a38e6c96a3513da287e07a3f67807ffd into 308c7d2115d30dfccf734d467cb61ef6c5c30813 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-f567ce1c601ede9781a995ba4c8e42da94af5c77)

**new alerts:**

* 1 for Unused local variable

This pull request **introduces 1 alert** when merging d49bb6d8d311f8e3c3d32e085fca03f6dbea8c12 into 27e5f2dce512495d93577c39618409d3403b210a - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-71587ee9efa31974453d149270427d4eca6dc73a)

**new alerts:**

* 1 for Unused local variable

This pull request **introduces 25 alerts** when merging ef510f5f526639b92a83f0b6c752d2b73f2e6caa into cf1b6787e91d5354d5b0d053c6a2ae72caaa1f1a - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-3dec1e10cd6ae73e45cd44d04c4228dbf70d1d0a)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging be1d55ff62b5e36a1cb76b663bae414702693b12 into cf1b6787e91d5354d5b0d053c6a2ae72caaa1f1a - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-28817fcbdd1b9aab87fd75ffa1ef63a1b43ad9d6)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging 2edf9fc00b4e6b160e24d9db1d72e4c7d30772b4 into cf1b6787e91d5354d5b0d053c6a2ae72caaa1f1a - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-3d7b0dd0e34f343742ae25144fdb6970aca11329)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging 57862ab8231937e7322be9c41ed5288637c08e96 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-f8d846764b7321473627ca086231bf502648c1db)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging 9f55611151d6f9dfd2e589faf9fcdbea8dba1826 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-46ffcdb32c91775dc976195590658a74f2d84086)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging c0990ecb6beacd5fafc8ab0f9dbfe6e4ddb3d0ba into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-26820db341e7f6e90d3abac291fe595b78e981f0)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 25 alerts** when merging b4f69800bb88f0d19f867cfb8b8afeb0926589cc into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-a29ee40c612fe88bb1aae65b17806d0828c15b86)

**new alerts:**

* 19 for Unused import
* 4 for Unused local variable
* 2 for Variable defined multiple times

This pull request **introduces 2 alerts** when merging 53963d4dc2f3898d48082ac0bd359906e4b2d2d6 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-98df2372d702223a7f2e10c5654aa205cd5bf928)

**new alerts:**

* 1 for Unused local variable
* 1 for Unused import

This pull request **introduces 2 alerts** when merging 8bcd0dd90c1ed831b49e0c671b3f8af0e122fca1 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-38fb5857074ee8ea6011cfd9455760b777e1c690)

**new alerts:**

* 1 for Unused local variable
* 1 for Unused import

This pull request **introduces 2 alerts** when merging 7ca527fa6b05255131a722d0b5373c4bb99325c7 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-1023b7803ab22fbadc03a7538eb6c153ac74a379)

**new alerts:**

* 2 for Unused import

This pull request **introduces 1 alert** when merging 65b96825a3b433806acb8ff9fcb3b41611831682 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-0b7ad1a04d5ffae6cb99bfbc285db92d9b6f0e33)

**new alerts:**

* 1 for Unused import

This pull request **introduces 1 alert** when merging b17369f0b67a09f1d6082eff556c424f3b82d07f into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-3cc2a31fb8305abf8131487faf8ae76e1dc2af08)

**new alerts:**

* 1 for Unused import

This pull request **introduces 1 alert** when merging ee24ea0c68cc21d474b0b6a5e976e2e92cfa3da3 into 479b6155710e1564c60d7824a8e88ee3d18de1f6 - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-edbe537e823b50ff4646511ff409d9fbd3f0a8db)

**new alerts:**

* 1 for Unused import

Could you please fix the LGTM errors. @okuchaiev to review the new lib

> Could you please fix the LGTM errors. @okuchaiev to review the new lib

the LGTM should be already fixed, those are old ones

How about adding to the main README what are nemo_tools vs tools?

> How about adding to the main README what are nemo_tools vs tools?
The main Readme is pretty crisp and only talks about installation. Its better to add a readme to NeMo/tools folder what this folder is doing. I added readme to NeMo/nemo_tools too, just like NeMo/nemo/README