Hmmm maybe if there is a way to decompose this into atomic tests and have them skipped, so it is obvious what is being executed from the log and main output:

```
if [[ -n $FOREMAN_INSTALLER_PATH ]] ; then
@test "install the installer from git" {
}
else
@test "install the installer using yum" {
}
i
```