There were a few instances in this list where it was advised to stay away from balancing on a particular surface. However, in general, the type of surface you utilize your balance board on will go a long way in determining the difficulty of the training. If you are a novice and are not looking to push yourself to the extreme, you should opt for surfaces that assist you in controlling your speed. For example, with roller boards, surfaces that are carpeted are ideal. The carpet will prevent the roller from accelerating too quickly. Now, if you are looking for more of a challenge, take your roller board on a slick surface such as hardwood.
On this, you will not be able to control the speed as much and will achieve the difficulty you crave. But, there is not necessarily a surface that you should not ride on (it just depends on how tough you want the training to be).