If you've opted for the "Search box" option for Search via Taskbar personalization options in Settings ("Settings -> Personalization -> Taskbar -> Taskbar items -> Search"), you will also see a Bing icon in your Search box in the taskbar. To disable it, use the Registry Editor, as explained above, which also disables the Bing Chat button from the Search window.