Accidentally swallowing the CBD oil won't pose any risks to your body. However, once you swallow the substance, you are no longer taking it sublingually.
Instead, you are consuming it, which means that it will have to be metabolised through your digestive system before your body can utilise it. Although this isn't dangerous, it does mean decreased bioavailability and slower onset of effects.