setup: Ensure directory for dummy file exists

Signed-off-by: Michael Buesch <m@bues.ch>