Improving performance of ConnectorTracker (#12218)

Swapping the if check in cleanConnectorMap to prevent unnecessary calls to
isComponentVisible when the connector is in uninitializedConnectors set.

Change-Id: If6305a908364f8a7bb51fd7302449c6f54c274a3