Remove anything unnecessary from the build task.

There is now a public directory, which can be used
as a web server's document root. Build fragments are
created to it instead of the old build directory.
Update robots ignores.