No, you can safely wear clothes of any color. However, consider using a color other than light gray and white as it may blend into the background and disturb the required contrast in the photo.