Fix #2 - move external config directory creation and add attribute to skip the cleanup

Fixes #2 Not sure about the naming or placement of the cleanup attribute.