Keep quiet if no executable
Cache failures

Closes #1.