If they're different, they might still both `respond_to?(:to_bytes)`, which is why I make the check