Yes, it is a punishable offense. If a person owns two PAN cards he/she might have to pay a penalty.