Remove support for ~ and ^

Since we don't have & nor | we might as well remove the other bitwise
operators too.

BUG=None
R=rafaelw@chromium.org

Review URL: https://codereview.appspot.com/14419067