Ignore attempts to unload chunks which aren't loaded

Signed-off-by: Ross Allan <rallanpcl@gmail.com>