remove Torch from all devices and add it to devices that can actually use it