Run rails in background and kill it in the end