worker: Change dir to something that exists

Try to change working directory to $HOME. If that fails, go for "/". If
that fails, too, I don't know what do do and just do nothing - when
someone can describe when that could reasonably happen, they get to
dictate what is the proper course of action.

Signed-off-by: Robin Sonefors <robin.sonefors@op5.com>