Make the '=' stripping specific to base64.

Since base64 doesn't add an '=' at the start, we don't
need to strip for that.

See http://en.wikipedia.org/wiki/Base64