No. A public key only allows someone to send funds to you. To withdraw or spend, the private key is essential.