vf_dlopen: remove buggy private name -> imgfmt conversion

This was presumably for backward compatibility,
but it was preventing the use of the new names.
vf_dlopen: update usage message to new-style args
TOOLS/vf_dlopen: use new pixelformats, fix usage for newstyle args