Use submap info for memory protection