Starting to back out numba.

It is an awesome package, but is too hard to build to have as a dep.
Removed numba dep