Don't update object root controllers with no time source (Fixes #1564)