If the location you are visiting requires shoes to be left outside, it would be considered rude not to comply with that rule.