By themselves, categories and tags don't impact site speed. However, if they lead to the creation of numerous pages (due to pagination), they could potentially slow down site crawling without optimization. Ensure your site is optimized for speed, regardless of how you utilize categories and tags.