Remove the fusion sublibrary as we apparently don't need it.
Also remove the spirit library.