Handle constants without going through SCEV.