Change to build dir before building

This caused errors such as 'unable to find Gemfile'