ENH: Numba support for installed without binary installs

Enables optimal support for Numba in the recursions

[skip ci]