Yes, frequent downtimes can negatively impact your SEO as search engines favor reliable and accessible sites.