A recovery phrase is usually generated from a specific list of 2,048 words. That means that your 12-word seed phrase has an iteration of 2,048 words. Therefore, it's almost impossible that someone could successfully guess your seed phrase.