`catMaps` should have the same size as `categoricalFields` to save space. The worst case is when the dimension is huge but number of categorical features is small.