Use set for entity unload list, batch remove entities

Signed-off-by: Ross Allan <rallanpcl@gmail.com>