Passive NPC's will retaliate if you attack them.