You are correct, you would. At least, once. I overlooked this because in my specific use case, I already had users backed up/restored separately (by doing a full export/partial restore on a different org, with users included).