Question: is a yubikey worth it?
Answer: Yes, Yubikeys are more secure. They use a physically protected element and public key encryption which makes key material immune to theft or cloning unlike your symmetric-based encrypted flash drive scheme.