2 seconds even to a localhost connection is too fast. First time connections will almost always timeout and then fallback to Long Polling. Giving it a bit more time will get more clients over SSE and less fallbacks.

In this particular scenario just increasing the timeout stopped the problem from happening altogether. Having proper handling of the timeout is the right solution though and this is something small to improve the experience.