You don't have to brown the lamb, but doing so adds another layer of flavour that makes the dish richer. Side by side, the flavour difference isn't big, so if you're short on time, you can skip the browning.