Yes, you can wear shorts in Pondicherry. There is no restriction to the kind of clothes you can wear here.