Documented and improved basic lexer mode

Changes:
* Improved API.
* Documented basic Mode.