BUG: special: fix up ellip_harm build

The ellip_harm build in special links in too many files, fix this up.
(Doesn't build in win32 due to mixing c++ and fortran.)