Fix #1132 -- don’t CWD to dir-with-conf.py if not needed

Signed-off-by: Chris “Kwpolska” Warrick <kwpolska@gmail.com>