Don't build branches directly, let the PRs do that