Milk will give Yorkshire puddings a richer flavor and softer texture, while water will give them a crispier finish. Whether you use milk or water is up to preference as both work, but I recommend using milk for the flavor and texture it provides.