This pointer is unsafe only when there is a diff publishing thread running in the background (which is usually the case, when running in conjunction with rviz)