Yes. Any minions near enemy champions will make Kha lose his isolated bonus damage against them.