avformat/nutdec: improve probe speed by 30%

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>