Not at all! You can bake the potatoes completely separately from the lamb instead. This method will also create a totally vegetarian side dish, if you need one. I highly recommend my Crispy Green Lemon Potato recipe...it's perfection!