You definitely can and it actually may make the spider look a bit cleaner. I personally prefer the flavor and texture of the cooked olives but you can totally wait and add at the end.