Drop alpha channel during resizing to test speed difference (most input images are 24-bit, so separate routines may be a worthwile optimization)
Using a char->float lookup table seems to save about 4%.