Send the button events during a panel grab