No, using the Rank Math plugin for the website will not hamper the speed. The Rank Math code is built and optimized for maximum performance. But on the contrary, Rank Math has a better chance that the website will perform better as it performs the job for multiple plugins.