build-remote.pl: Don't use substituters on the remote

It's kinda pointless to check substituters on the remote side, since
we just checked them locally.