You can kill the ones you can hit but the underlying problem is the colony that they came from remains and only in exterminating the colony will you remove the threat brought by termites.