Apply an insecticide powder or spray directly into the opening of the hive over three weeks to exterminate them. You will only kill the flying bees with the first application. However, you can kill the unhatched ones by spraying into the hive opening for three weeks.