Manage workspace dir so it works before Jenkins runs a job