Store the paused state in the world, not the game loop (swing)