If you want to withdraw your passport because you have to travel to another country or have some other need, you must submit a written application to the Indian High Commission. And they will dispatch your passport if your reason to withdraw is valid.