If you want a proper challenge, then no, as the specter is very helpful in this fight. However, if you just want to get through this fight, you should absolutely use the Specter, as they serve as a wonderful distraction.