When a connector is running, it remains active as it connects to the service. Uninstalled /Unused connectors are tagged as inactive and are removed after 10 days of inactivity from the portal.
There is no way to remove the Inactive connector manually from the Microsoft Entra admin center.