Core: Only apply top offset to icon-only buttons that are direct children of the toolbar. Fixes #5502.