If you are taking a loan against your fixed deposit then you have to pay penalties on your withdrawal amount.