If you've signed a non-compete and break the agreement, you could, in theory, be sued. State laws (which differ) set the enforceability (or not) of non-compete agreements.