Re-enable panning and chatting after game ends

Also removes all of the pretty, since it conflicts with the chat box :/

Fixes #6422.