Some of the turnips have got the outer layer, just under the skin with a bit of a bitter taste. This is the part where most of the bitterness is present. If that is the case, try to peel them a bit further down.