To label images for semantic segmentation, each pixel in the image is manually or automatically assigned to a specific class (e.g., road, sky, vehicle). This can be done through manual annotation tools, semi-automated methods, or fully automated systems using pre-trained models.