No, the alcohol does not stay in the pumped milk. After the alcohol consumption pumping and dumping the milk will not reduce the alcohol level. It will be there in your milk as long as it is in the bloodstream. As the alcohol in the blood level decreases, the alcohol in the breast milk also comes down.