Add script to extract list of EDB's hosted files.

Also add a robots.txt file to protect the generated HTML file.