Remove cloak before broadcasting that the skin changed