Only delete the 1 buffer we created