You are not being rude.
You are being nice.