Correctly detect mutation on serialized columns mapping to binary

Fixes #16701
Merge pull request #16702 from sgrif/sg-binary-serialized

Correctly detect mutation on serialized columns mapping to binary