Fix runner issues and delete binary before running
Merge pull request #818 from dlsniper/fix-706

Fix runner issues and delete binary before running (fixes #706)