Document that executable may only be ruby scripts

Fixes #830
Fix test broken on 1.8.7 by @ab28a37