pointer: Fix crash when we have the pointer over nothing during a popup grab