These include a tokenizer, a word segmenter, a sentence marker and an SGML-aware version of the Unix utility grep, called sggrep. The sggrep utility works on patterns in the document tree structure as well as patterns in the text itself. The C API has 53 functions and one callback. The Language Technology Group has bulit an interface to Python, an interactive programming language for user-interface implementations and for specialised SGML editors. The effect of LT NSL, if it lives up to its billing, will be to make it possible to do extensive processing without modifying, replacing or invalidating the SGML markup.
More information is available from the sources cited below .
The toolset is available without charge to academic research groups and under license to commercial organistaions.