Yes, you do need to pay this overpayment back. To not do so would constitute "unjust enrichment", something which the law disfavors. And think about it, had you been mistakenly underpaid, then you woud have the right to get the shortage made up (just like your employer having the right to get the overpayment refunded).