Make STRICTENC invalid pubkeys fail the script rather than the opcode.

This turns STRICTENC turn into a softforking change, and as a result
guarantee that using it for mempool validation only results in
consensus-valid transactions in the mempool.