Start application before running tasks

/cc @devinus @josevalim