For the most part, yes. Optimal performance on search engines requires ongoing work, so ending your collaboration with an SEO agency could affect your rankings. However, most of what was built will remain. Your website’s foundations will stay solid, your traffic will not vanish.