Don't listen to keyboard events right away

We would accidentally catch people pressing enter after having the address in
the addressbar and start the game right away.