When you need to do one shuffle per add, or generally only use the "_ss" ones, I doubt it's worth to use SSE intrinsics, instead let the compiler do its thing. However things like FromRGBA which you also did is worth it because you get parallelism without any shuffling work, definitely saving instructions.