Fast hack to make pycrypto to work with pypy

Just don't build Crypto.PublicKey._fastmath if run in pypy