Remove some unnecessary associativity checks