OpenGL2: Fix inaccurate RGBM calculation.