Don't remove handle if job hasn't finished

This commit stops client from removing the handle from jobhandlers
if the job has not finished yet. It probably breaks DoBg(), but I am
just using Do() for now.