Touching him can be a good opportunity to observe his body language. It's possible that he's trying to communicate something else before he growls.