It's considered rude to remove your mask during a masquerade party, so keep it on for the duration of the event.