check OOG in SHA3

also fixes https://github.com/ethereum/ethereumjs-lib/issues/23