Yes, creating an image sitemap ensures your images are properly indexed by search engines, improving their visibility in search results.