Fail if trying to release a buffer that is none