No, backbiting can be by words, gestures, or even implications. It's any action that indicates the faults of a person in their absence in a manner they would dislike.