This depends on your experience and fitness level. If you are new to this type of workout, stick to the more leveled and smooth surfaces to help you work up to getting used to using minimalistic gear during physical activity. If you are experienced then you have more flexibility because your body is in tune with the feel of minimalistic running.
The materials that the sandals are made of will also play a role in determining the surface you choose.