Over time, you'll probably lose rankings. It can take 3 - 6 months for you to notice, especially if you've been running a successful SEO campaign for a long time. It can happen faster or slower depending on how competitive your industry is online and how much SEO your competitors are doing.