No, fortunately, it is not that easy. If you store your Bitcoins on a desktop wallet, they would first have to learn your security key or phrase.