I rule at my own games that you can, but in the case of Vampiric Touch, I'm not sure why you would want to. The returns would be diminishing, and you'd essentially just be losing half the hit points of whatever damage you rolled.