Remove the hashmap for attributes.