Clean up properly if alternative injection left registry entries