Revert "Build on pypy3"

This reverts commit 75aca45cf31b85bb056b4fde20dfc98deede8cbf.