Only add layers if they have sublayers