Reducing unnecessary lines is likely to improve page speed and latency, especially when those lines are non-entities and serve no purpose at all. Removing lines of hidden/unauthorized sellers will likely improve performance on your direct accounts and may increase overall revenue.