Always clone the user key map regardless of whether it is empty or not.