Make store and tmpdir configurable and automatically create them