Microsoft Enough has been said about this topic. Microsoft is an easy target, but it's a scapegoat, not the real source of difficulty. Details to follow. The web happened in the early 1990s and it surprised the computer science community as much as the commercial one. It then came to dominate much of the discussion, but not to much effect.
Business controls it.
Research has contributed little, despite a huge flow of papers on caches, proxies, server architectures, etc. A huge amount of work, but if you don't honor the standards you're marginalized. At another level, instruction architectures, buses, etc. have the same influence. With so much externally imposed structure, there's little slop left for novelty. Academia is a casualty.