Don't inline wrappers if they are in an argument position

This happens when a wrapper in a left-over higher-order function,
in the argument position of a primitive.