vf: fix filter initialization error check

vf_open returns 0 on error, 1 on success. Oops. Accidentally broken
with 6629a95.