We’ve seen this exact situation on client sites. We removed sitemap so we could get Google to show the thumbnail and not the video and traffic went up! Take that as you will.