'At' is specific while 'in' is general. In the sentences, the only location mentioned is Delhi. So 'in' is the right preposition. Suppose you want to mention a particular hospital in Delhi, then it would be: I was born at a hospital in Delhi.