Allays can only spawn in woodland mansions and pillager outposts. There is not a guaranteed chance of finding an allay in either of these structures, however pillager outposts are far more common, so searching them is recommended.