Yes, but only in the case of an emergency. If you withdraw money from your nest egg it can be very costly. You will not be charged interest on the amount of money you take out, but there will usually be a fee that is set by your bank or financial institution.