CADC: cache status of e-transfer files via os.walk

Now use os.walk to search all of the e-transfer directories.  The
status of each file is now stored in a cache dictionary to allow
multiple queries to be made in an efficient manner.
CADC: complete implementation of e-transfer poll
test: Correct reference ACSIS data directory
CADC: add a warning to the e-transfer poll routine

This warning will be logged if the files have left the e-transfer
directories but do not appear to be at CADC.
CADC: add additional file search patterns

The CADCFiles class needs these file search patterns in order
to know how to query the JCMT info service.
test: add tests of new CADC file patterns
scripts: move state polling into jsa_proc script
scripts: add --no-etransfer option to poll command
scripts: make --job-id opt. consistent with others

Now --job-id rather than --job_id to match the other options.
scripts: move fetch and run tasks into jsa_proc

The "assemble_data_and_advance" and "run_job" scripts have been
amalgamated into the "jsa_proc" script.  The integer option
handing from the etransfer sub-command has been brought to the
top of the script so that it can easily be applied to multiple
options for multiple sub-commands.
scripts: move docopt import to the top of jsa_proc
scripts: merge import_from_cadcdp into jsa_proc

Adds a new sub-command "import", so the command decorator needs
to handle function names with trailing underscores.
DB: use _dict_query_where_clause in find_jobs

Now also use this function to prepare the query for the job
table parameters.  This is so that we can handle the range of
options which it supports.
Action: pass new --debugxfer option to jsawrapdr
Merge branch 'master' into temporary-qa-indexes