Try moving gems into the build_dir and set them explicitly to the path.