The last word in the multiword token is given the tag for the entire phrase. To use tagsent with tokenize , the extra information provided by tokenize must be removed from its output. The npr program finds noun phrases in the given tagged text. Npr accepts one token per line, with tag information, as output by tagsent . The input comes from the standard input, which is by default set to the terminal keyboard.
Output is sent to standard output, which is by default the terminal screen.
Redirection and pipe operators can be used in most command-line shells to use npr with files and the other programs tokenize , field , and tagsent . The language given may be any language for which the file language .npr exists. For example, english may be specified. The output of npr is phrase information, one phrase per line. Included is the token offset of the phrase, the type of the phrase, which is always np , and the text of the phrase.