Yes, you can remove the yellow leaves of the cucumber plant. If you will not, then it will spread all around and you will lose your plant.