In Pythagorean Numerology, every number has a positive and negative energy corresponding to it. So you may be activating a person's number with negative energy just because that's what you've learned to expect from them and what you've come to anticipate.