Copied grid maps only when necessary