Take a cheap early exit for const, * and & (ROOT-6909).