Avoid unnecessarily setting channel position

If we aren't doing RGB merged data, we only need to set the C position
once per channel.