The one major problem with this setup is bootloader installation on UEFI systems. A system can only have one active ESP partition at a time and it causes issues.
While installing Linux, even if you choose the USB as the destination for bootloader, the existing ESP partition is still used for placing the EFI file for the new distribution