Don't try to unload a chunk which is already unloading

Signed-off-by: Ross Allan <rallanpcl@gmail.com>