I tried to do this here: enriquez/sjcl@750b670de0353729e6c00d79142edf75a9c2da92

Using the tests as a benchmark, I didn't see much improvement. It was actually a bit slower.