Ensure we leave directory contents with proper owner