transcode: use user given width/height on calculations

regression from 808e6123ff6f1850d274d921cf35dc78c7903d4c as calculations
still used with/height instead of visible_width/height