"Pressing my button" might mean that you have upset me emotionally.