Added back compile the runner on the fly support, and some error handling