If you're walking around temples and shrines, it is a good idea to be respectful and have a top layer with sleeves and no tummy or cleavage showing. However, it is not a rule and you'll sometimes see Japanese people not following these dress-code standards.