Revert: TTT: Prevent propspec fix from breaking spectators

Occasionally caused players to spawn invisible and in noclip (as if a
spectator).

Reverts commit 6aaed736f3279ddfe50e41e0e1750792bc5c4230

I have tested this change on my server for 3 hours now, and it seems to fix the problem.