Add auto-reloading when the metadata files change.
Use new config mechanism and rename test spec.
Make file watch use persistent: false so that it can shut down gracefully.