It won’t be the end of the world, but the nutritional makeup and texture of these pancakes will be altered. Egg yolks hold the egg's cholesterol, fat, and calories, so you will be adding these into your nutritional count. Egg yolks also add some density, so the pancakes will come out thicker than they otherwise would.