Yes! If the PC in question is really old, then chances are your newly minted Batocera USB won't work, as modern PCs use a different architecture.
However, the Batocera team has compiled OS images compatible with 32-bit CPUs, low-powered processors like the Intel Atom, and PCs with old Nvidia legacy drivers. To find them, head to the Batocera download page and scroll all the way to the bottom. After you download the correct file, simply follow the instructions outlined above to make a new Batocera USB that will work on your old PC.