Fix busy client grab
Don't set pointer->focus