Isolate Docker-necessary files in a subdirectory

Because https://github.com/dotcloud/docker/issues/2224