wayland: Fix broken mouse pointer more properly