Don't propagate keypresses in the panel to the toolbar button.