Ensure existence of parent directories

Ensure existence of parent directories for admin and bootstrap keys.

This fixes bug #5311.