fix spotlight migration error on undefined index
Merge branch 'develop' of github.com:au-research/ANDS-Online-Services into develop

* 'develop' of github.com:au-research/ANDS-Online-Services:
  Fix non-registry directories not being recognised in routing
  Update README.md
  global config addition for pids identifier suffix
  DCI wrapper for OAI
more fix to the spotlight stuff
Merge spotlight hotfix