The phrase you've heard "Hai KaoKao" is,correctly,"Hai,Kakka". "Hai" means "Yes" in English. And "Kakka" is the Japanese word usually used to call higher level person such as general, Chancellor,Prime minister and more.