Revert "Build DSPManager"

This reverts commit c977f9a9521c7b605385011d39ec990e702af460.