Barring a few situations in certain contexts, it usually is rude to decline gifts because it would be like rejecting a person’s good intentions.