Don't remove cached chunks on raw access for dynmap

Signed-off-by: Ross Allan <rallanpcl@gmail.com>