Add in-game latency indicators

This fixes a few issues with the in-game menu plumbing, and adds the latency indicators from the lobby to the in-game and end-game score panels.

Closes #2281, #4577.