Fix observer widgets not showing up when a player loses

Fixes #6172.