Don't do any simplification in is_constant when simplify=False