Fix running the runner script using a symlink

https://www.pivotaltracker.com/story/show/62513440