Not usually. However, like any expression, it can be viewed as rude if used inappropriately or in a negative context.