javadoc improvements.
Rename UnrecognizedOptionException to the more general UnrecognizedTokenException.