Free host buffer as well.