I think we have to set up a workdir and copy the contents of the build into it when building the gem for this to work.