Reset color after prefix if neutral