Only make a map if it is nil while decoding