It's not rude in most cases, but it might not encourage any further conversation if it is only a one-worded response.