If you want to unpin or remove an app icon from the Taskbar, right-click on the app you want to remove and choose Unpin from the taskbar. It will remove all your selected icons from the Taskbar on Windows 11/10.