Create a directory that jenkins expects during setup

This is a temporary workaround for a bug that was introduced over the weekend by Jenkins 1.538.