No, but the texture will be a bit different. Egg helps lighten and lift the sweet potato mixture as it bakes, so omitting it will result in a denser casserole. I think it would still taste good, though!