Fix path to gemfiles in build matrix