BVF/VSFilter: Pass through and actually use colorimetry information

This enables the usage of colorimetry information passed down the
filter chain from the decoder. Also sets range and colormatrix
from this information if available.

Currently limited to a white list of filters:
 - VMR7,9
 - EVR
 - madVR
Subtitles: Catch certain memory allocation failures to fix a crash

This is in no way a complete solution, but this seems to fix a
crash with a certain sample on 32bit systems.

Also fixes xy_malloc to not fail within itself in case of allocation
failure.