Fix and clean up SSE side build after the previous NEON commit.