change names and default values of crawler settings
refactor spider argument parsing; support passing spider policy from command line