Improve performance when unloading entities

Signed-off-by: Ross Allan <rallanpcl@gmail.com>