Avoid type conversion errors with VLC_TS_*

Without the INT64_C, ES_OUT_SET_PCR was being called with garbage values
(when not on 64-bit systems).
Refs #9828
flac: fix extradata clamping check