Don't check for the executable unless we are running the tests. (JMS)
Delete some unnecessary test files.