Better perf fail warning

I blindly ran `perf.py` and it then silently fails and gives you outputs of zero for all tests.

This will at least print a warning if the executable has not been compiled for running the test.