Survive config where an AZ is empty

[#59157138, #58671252]

Signed-off-by: Stephan Hagemann <stephan@pivotallabs.com>