Yes. However, for maximum effectiveness, you need to use a type of ant killer that can permeate the hill and kill off the queen. You need to first identify where the colony is. Once this is done, the next step is to use ant baits. Bait ant killers are highly effective because they use the ants way of life to destroy them.
Once the ants eat the bait, they carry some of it back to the colony and share it with other ants. The bait is slow-acting, so it reaches as many ants as possible. If the ant dies in the nest, it is eaten by other ants, which also ingest the poison.