Check for boxed tau types in the LHS of type family instances

Fixes Trac #9357