crawler update: command line parameters, cleaned recommended lex, etc.