Pass executable explicitly

For some tests the executable detection did not work (if the executable is not up the tree from the current directory). Amends  #4144.