Server: Decouple update_map_memory() and build_fov_map(), thus fix bugs.